Nov 06 13:06:20 user nova-compute[74821]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74821) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 06 13:06:20 user nova-compute[74821]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74821) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 06 13:06:20 user nova-compute[74821]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74821) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 06 13:06:20 user nova-compute[74821]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 06 13:06:20 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:06:20 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:06:21 user nova-compute[74821]: INFO nova.virt.driver [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 06 13:06:21 user nova-compute[74821]: INFO nova.compute.provider_config [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] Acquiring lock "singleton_lock" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] Acquired lock "singleton_lock" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] Releasing lock "singleton_lock" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] Full set of CONF: {{(pid=74821) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] ******************************************************************************** {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] Configuration options gathered from: {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] ================================================================================ {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] allow_resize_to_same_host      = True {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] arq_binding_timeout            = 300 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] backdoor_port                  = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] backdoor_socket                = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] block_device_allocate_retries  = 300 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] block_device_allocate_retries_interval = 5 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cert                           = self.pem {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] compute_monitors               = [] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] config_dir                     = [] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] config_drive_format            = iso9660 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] config_source                  = [] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] console_host                   = user {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] control_exchange               = nova {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cpu_allocation_ratio           = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] daemon                         = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] debug                          = True {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] default_access_ip_network_name = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] default_availability_zone      = nova {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] default_ephemeral_format       = ext4 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] default_green_pool_size        = 1000 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] default_schedule_zone          = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] disk_allocation_ratio          = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] enable_new_services            = True {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] enabled_ssl_apis               = [] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] flat_injected                  = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] force_config_drive             = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] force_raw_images               = True {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] graceful_shutdown_timeout      = 5 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] heal_instance_info_cache_interval = 60 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] host                           = user {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] instance_build_timeout         = 0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] instance_delete_interval       = 300 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] instance_name_template         = instance-%08x {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] instance_usage_audit           = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] instance_usage_audit_period    = month {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] internal_service_availability_zone = internal {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] key                            = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] live_migration_retry_count     = 30 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] log_config_append              = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] log_dir                        = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] log_file                       = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] log_options                    = True {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] log_rotate_interval            = 1 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] log_rotate_interval_type       = days {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] log_rotation_type              = none {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] long_rpc_timeout               = 1800 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] max_concurrent_builds          = 10 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] max_concurrent_live_migrations = 1 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] max_concurrent_snapshots       = 5 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] max_local_block_devices        = 3 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] max_logfile_count              = 30 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] max_logfile_size_mb            = 200 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] maximum_instance_delete_attempts = 5 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] metadata_listen                = 0.0.0.0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] metadata_listen_port           = 8775 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] metadata_workers               = 3 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] migrate_max_retries            = -1 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] mkisofs_cmd                    = genisoimage {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] my_ip                          = 10.0.0.210 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] network_allocate_retries       = 0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] osapi_compute_listen_port      = 8774 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] osapi_compute_unique_server_name_scope =  {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] osapi_compute_workers          = 3 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] password_length                = 12 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] periodic_enable                = True {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] periodic_fuzzy_delay           = 60 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] pointer_model                  = ps2mouse {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] preallocate_images             = none {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] publish_errors                 = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] pybasedir                      = /opt/stack/nova {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] ram_allocation_ratio           = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] rate_limit_burst               = 0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] rate_limit_except_level        = CRITICAL {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] rate_limit_interval            = 0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] reboot_timeout                 = 0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] reclaim_instance_interval      = 0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] record                         = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] reimage_timeout_per_gb         = 60 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] report_interval                = 120 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] rescue_timeout                 = 0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] reserved_host_cpus             = 0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] reserved_host_disk_mb          = 0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] reserved_host_memory_mb        = 512 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] reserved_huge_pages            = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] resize_confirm_window          = 0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] resize_fs_using_block_device   = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] resume_guests_state_on_host_boot = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] rpc_response_timeout           = 60 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] run_external_periodic_tasks    = True {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] running_deleted_instance_action = reap {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] running_deleted_instance_timeout = 0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] scheduler_instance_sync_interval = 120 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] service_down_time              = 720 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] servicegroup_driver            = db {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] shelved_offload_time           = 0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] shelved_poll_interval          = 3600 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] shutdown_timeout               = 0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] source_is_ipv6                 = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] ssl_only                       = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] state_path                     = /opt/stack/data/nova {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] sync_power_state_interval      = 600 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] sync_power_state_pool_size     = 1000 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] syslog_log_facility            = LOG_USER {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] tempdir                        = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] timeout_nbd                    = 10 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] transport_url                  = **** {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] update_resources_interval      = 0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] use_cow_images                 = True {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] use_eventlog                   = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] use_journal                    = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] use_json                       = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] use_rootwrap_daemon            = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] use_stderr                     = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] use_syslog                     = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vcpu_pin_set                   = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vif_plugging_is_fatal          = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vif_plugging_timeout           = 0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] virt_mkfs                      = [] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] volume_usage_poll_interval     = 0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] watch_log_file                 = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] web                            = /usr/share/spice-html5 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_concurrency.disable_process_locking = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api.auth_strategy              = keystone {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api.compute_link_prefix        = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api.dhcp_domain                = novalocal {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api.enable_instance_password   = True {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api.glance_link_prefix         = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api.instance_list_per_project_cells = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api.list_records_by_skipping_down_cells = True {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api.local_metadata_per_cell    = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api.max_limit                  = 1000 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api.metadata_cache_expiration  = 15 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api.neutron_default_tenant_id  = default {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api.use_forwarded_for          = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api.use_neutron_default_nets   = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api.vendordata_dynamic_targets = [] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api.vendordata_jsonfile_path   = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cache.backend_argument         = **** {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cache.config_prefix            = cache.oslo {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cache.dead_timeout             = 60.0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cache.debug_cache_backend      = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cache.enable_retry_client      = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cache.enable_socket_keepalive  = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cache.enabled                  = True {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cache.expiration_time          = 600 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cache.hashclient_retry_attempts = 2 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cache.memcache_dead_retry      = 300 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cache.memcache_password        =  {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cache.memcache_sasl_enabled    = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cache.memcache_username        =  {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cache.proxies                  = [] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cache.retry_attempts           = 2 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cache.retry_delay              = 0.0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cache.socket_keepalive_count   = 1 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cache.socket_keepalive_idle    = 1 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cache.socket_keepalive_interval = 1 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cache.tls_allowed_ciphers      = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cache.tls_cafile               = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cache.tls_certfile             = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cache.tls_enabled              = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cache.tls_keyfile              = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cinder.auth_section            = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cinder.auth_type               = password {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cinder.cafile                  = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cinder.certfile                = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cinder.collect_timing          = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cinder.cross_az_attach         = True {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cinder.debug                   = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cinder.endpoint_template       = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cinder.http_retries            = 3 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cinder.insecure                = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cinder.keyfile                 = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cinder.os_region_name          = RegionOne {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cinder.split_loggers           = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cinder.timeout                 = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] compute.cpu_dedicated_set      = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] compute.cpu_shared_set         = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] compute.image_type_exclude_list = [] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] compute.resource_provider_association_refresh = 300 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] compute.shutdown_retry_interval = 10 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] conductor.workers              = 3 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] console.allowed_origins        = [] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] console.ssl_ciphers            = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] console.ssl_minimum_version    = default {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] consoleauth.token_ttl          = 600 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cyborg.cafile                  = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cyborg.certfile                = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cyborg.collect_timing          = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cyborg.connect_retries         = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cyborg.connect_retry_delay     = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cyborg.endpoint_override       = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cyborg.insecure                = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cyborg.keyfile                 = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cyborg.max_version             = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cyborg.min_version             = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cyborg.region_name             = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cyborg.service_name            = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cyborg.service_type            = accelerator {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cyborg.split_loggers           = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cyborg.status_code_retries     = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cyborg.status_code_retry_delay = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cyborg.timeout                 = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] cyborg.version                 = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] database.backend               = sqlalchemy {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] database.connection            = **** {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] database.connection_debug      = 0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] database.connection_parameters =  {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] database.connection_recycle_time = 3600 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] database.connection_trace      = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] database.db_inc_retry_interval = True {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] database.db_max_retries        = 20 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] database.db_max_retry_interval = 10 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] database.db_retry_interval     = 1 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] database.max_overflow          = 50 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] database.max_pool_size         = 5 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] database.max_retries           = 10 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] database.mysql_wsrep_sync_wait = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] database.pool_timeout          = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] database.retry_interval        = 10 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] database.slave_connection      = **** {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] database.sqlite_synchronous    = True {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api_database.backend           = sqlalchemy {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api_database.connection        = **** {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api_database.connection_debug  = 0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api_database.connection_parameters =  {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api_database.connection_recycle_time = 3600 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api_database.connection_trace  = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api_database.db_inc_retry_interval = True {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api_database.db_max_retries    = 20 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api_database.db_max_retry_interval = 10 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api_database.db_retry_interval = 1 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api_database.max_overflow      = 50 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api_database.max_pool_size     = 5 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api_database.max_retries       = 10 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api_database.pool_timeout      = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api_database.retry_interval    = 10 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api_database.slave_connection  = **** {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] api_database.sqlite_synchronous = True {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] devices.enabled_mdev_types     = [] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] ephemeral_storage_encryption.enabled = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] glance.api_servers             = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] glance.cafile                  = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] glance.certfile                = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] glance.collect_timing          = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] glance.connect_retries         = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] glance.connect_retry_delay     = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] glance.debug                   = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] glance.default_trusted_certificate_ids = [] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] glance.enable_certificate_validation = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] glance.enable_rbd_download     = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] glance.endpoint_override       = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] glance.insecure                = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] glance.keyfile                 = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] glance.max_version             = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] glance.min_version             = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] glance.num_retries             = 3 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] glance.rbd_ceph_conf           =  {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] glance.rbd_connect_timeout     = 5 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] glance.rbd_pool                =  {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] glance.rbd_user                =  {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] glance.region_name             = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] glance.service_name            = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] glance.service_type            = image {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] glance.split_loggers           = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] glance.status_code_retries     = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] glance.status_code_retry_delay = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] glance.timeout                 = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] glance.verify_glance_signatures = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] glance.version                 = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] guestfs.debug                  = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] hyperv.config_drive_cdrom      = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] hyperv.config_drive_inject_password = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] hyperv.enable_remotefx         = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] hyperv.instances_path_share    =  {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] hyperv.limit_cpu_features      = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] hyperv.use_multipath_io        = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] hyperv.vswitch_name            = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] mks.enabled                    = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] image_cache.manager_interval   = 2400 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] image_cache.precache_concurrency = 1 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] image_cache.remove_unused_base_images = True {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] image_cache.subdirectory_name  = _base {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] ironic.api_max_retries         = 60 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] ironic.api_retry_interval      = 2 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] ironic.auth_section            = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] ironic.auth_type               = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] ironic.cafile                  = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] ironic.certfile                = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] ironic.collect_timing          = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] ironic.conductor_group         = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] ironic.connect_retries         = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] ironic.connect_retry_delay     = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] ironic.endpoint_override       = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] ironic.insecure                = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] ironic.keyfile                 = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] ironic.max_version             = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] ironic.min_version             = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] ironic.peer_list               = [] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] ironic.region_name             = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] ironic.serial_console_state_timeout = 10 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] ironic.service_name            = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] ironic.service_type            = baremetal {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] ironic.split_loggers           = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] ironic.status_code_retries     = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] ironic.status_code_retry_delay = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] ironic.timeout                 = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] ironic.version                 = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] key_manager.fixed_key          = **** {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] barbican.barbican_api_version  = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] barbican.barbican_endpoint     = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] barbican.barbican_endpoint_type = public {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] barbican.barbican_region_name  = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] barbican.cafile                = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] barbican.certfile              = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] barbican.collect_timing        = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] barbican.insecure              = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] barbican.keyfile               = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] barbican.number_of_retries     = 60 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] barbican.retry_delay           = 1 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] barbican.send_service_user_token = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] barbican.split_loggers         = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] barbican.timeout               = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] barbican.verify_ssl            = True {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] barbican.verify_ssl_path       = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] barbican_service_user.auth_section = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] barbican_service_user.auth_type = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] barbican_service_user.cafile   = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] barbican_service_user.certfile = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] barbican_service_user.collect_timing = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] barbican_service_user.insecure = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] barbican_service_user.keyfile  = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] barbican_service_user.split_loggers = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] barbican_service_user.timeout  = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vault.approle_role_id          = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vault.approle_secret_id        = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vault.cafile                   = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vault.certfile                 = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vault.collect_timing           = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vault.insecure                 = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vault.keyfile                  = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vault.kv_mountpoint            = secret {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vault.kv_path                  = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vault.kv_version               = 2 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vault.namespace                = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vault.root_token_id            = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vault.split_loggers            = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vault.ssl_ca_crt_file          = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vault.timeout                  = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vault.use_ssl                  = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] keystone.auth_section          = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] keystone.auth_type             = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] keystone.cafile                = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] keystone.certfile              = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] keystone.collect_timing        = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] keystone.connect_retries       = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] keystone.connect_retry_delay   = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] keystone.endpoint_override     = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] keystone.insecure              = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] keystone.keyfile               = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] keystone.max_version           = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] keystone.min_version           = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] keystone.region_name           = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] keystone.service_name          = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] keystone.service_type          = identity {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] keystone.split_loggers         = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] keystone.status_code_retries   = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] keystone.status_code_retry_delay = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] keystone.timeout               = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] keystone.version               = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.connection_uri         =  {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.cpu_mode               = custom {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: WARNING oslo_config.cfg [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.cpu_power_governor_high = performance {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.cpu_power_management   = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.device_detach_attempts = 8 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.device_detach_timeout  = 20 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.disk_cachemodes        = [] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.disk_prefix            = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.enabled_perf_events    = [] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.file_backed_memory     = 0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.gid_maps               = [] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.hw_disk_discard        = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.hw_machine_type        = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.images_rbd_pool        = rbd {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.images_type            = default {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.images_volume_group    = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.inject_key             = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.inject_partition       = -2 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.inject_password        = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.iscsi_iface            = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.iser_use_multipath     = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.live_migration_downtime = 500 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.live_migration_inbound_addr = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.live_migration_scheme  = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.live_migration_timeout_action = abort {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.live_migration_tunnelled = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: WARNING oslo_config.cfg [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 06 13:06:21 user nova-compute[74821]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 06 13:06:21 user nova-compute[74821]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 06 13:06:21 user nova-compute[74821]: and ``live_migration_inbound_addr`` respectively.
Nov 06 13:06:21 user nova-compute[74821]: ).  Its value may be silently ignored in the future.
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.live_migration_with_native_tls = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.max_queues             = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.nfs_mount_options      = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.num_pcie_ports         = 0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.pmem_namespaces        = [] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.quobyte_client_cfg     = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.rbd_secret_uuid        = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.rbd_user               = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.rescue_image_id        = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.rescue_kernel_id       = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.rx_queue_size          = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.smbfs_mount_options    =  {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.snapshot_compression   = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.snapshot_image_format  = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.sparse_logical_volumes = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.swtpm_enabled          = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.swtpm_group            = tss {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.swtpm_user             = tss {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.sysinfo_serial         = unique {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.tb_cache_size          = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.tx_queue_size          = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.uid_maps               = [] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.use_virtio_for_bridges = True {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.virt_type              = kvm {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.volume_clear           = zero {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.volume_clear_size      = 0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.volume_use_multipath   = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.vzstorage_cache_path   = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] neutron.auth_section           = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] neutron.auth_type              = password {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] neutron.cafile                 = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] neutron.certfile               = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] neutron.collect_timing         = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] neutron.connect_retries        = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] neutron.connect_retry_delay    = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] neutron.default_floating_pool  = public {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] neutron.endpoint_override      = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] neutron.extension_sync_interval = 600 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] neutron.http_retries           = 3 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] neutron.insecure               = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] neutron.keyfile                = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] neutron.max_version            = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] neutron.min_version            = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] neutron.ovs_bridge             = br-int {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] neutron.physnets               = [] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] neutron.region_name            = RegionOne {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] neutron.service_metadata_proxy = True {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] neutron.service_name           = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] neutron.service_type           = network {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] neutron.split_loggers          = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] neutron.status_code_retries    = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] neutron.status_code_retry_delay = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] neutron.timeout                = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] neutron.version                = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] notifications.bdms_in_notifications = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] notifications.default_level    = INFO {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] notifications.notification_format = unversioned {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] notifications.notify_on_state_change = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] pci.alias                      = [] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] pci.device_spec                = [] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] pci.report_in_placement        = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.auth_section         = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.auth_type            = password {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.cafile               = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.certfile             = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.collect_timing       = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.connect_retries      = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.connect_retry_delay  = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.default_domain_id    = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.default_domain_name  = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.domain_id            = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.domain_name          = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.endpoint_override    = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.insecure             = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.keyfile              = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.max_version          = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.min_version          = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.password             = **** {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.project_domain_id    = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.project_domain_name  = Default {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.project_id           = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.project_name         = service {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.region_name          = RegionOne {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.service_name         = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.service_type         = placement {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.split_loggers        = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.status_code_retries  = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.status_code_retry_delay = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.system_scope         = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.timeout              = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.trust_id             = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.user_domain_id       = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.user_domain_name     = Default {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.user_id              = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.username             = placement {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] placement.version              = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] quota.cores                    = 20 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] quota.count_usage_from_placement = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] quota.injected_file_content_bytes = 10240 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] quota.injected_file_path_length = 255 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] quota.injected_files           = 5 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] quota.instances                = 10 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] quota.key_pairs                = 100 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] quota.metadata_items           = 128 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] quota.ram                      = 51200 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] quota.recheck_quota            = True {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] quota.server_group_members     = 10 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] quota.server_groups            = 10 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] rdp.enabled                    = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] scheduler.image_metadata_prefilter = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] scheduler.max_attempts         = 3 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] scheduler.max_placement_results = 1000 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] scheduler.workers              = 3 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] filter_scheduler.host_subset_size = 1 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] filter_scheduler.isolated_hosts = [] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] filter_scheduler.isolated_images = [] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] filter_scheduler.pci_in_placement = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] filter_scheduler.track_instance_changes = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] metrics.required               = True {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] metrics.weight_multiplier      = 1.0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] metrics.weight_setting         = [] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] serial_console.enabled         = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] serial_console.port_range      = 10000:20000 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] serial_console.serialproxy_port = 6083 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] service_user.auth_section      = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] service_user.auth_type         = password {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] service_user.cafile            = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] service_user.certfile          = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] service_user.collect_timing    = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] service_user.insecure          = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] service_user.keyfile           = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] service_user.send_service_user_token = True {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] service_user.split_loggers     = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] service_user.timeout           = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] spice.agent_enabled            = True {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] spice.enabled                  = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] spice.html5proxy_port          = 6082 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] spice.image_compression        = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] spice.jpeg_compression         = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] spice.playback_compression     = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] spice.server_listen            = 127.0.0.1 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] spice.streaming_mode           = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] spice.zlib_compression         = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] upgrade_levels.baseapi         = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] upgrade_levels.cert            = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] upgrade_levels.compute         = auto {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] upgrade_levels.conductor       = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] upgrade_levels.scheduler       = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vendordata_dynamic_auth.cafile = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vendordata_dynamic_auth.certfile = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vendordata_dynamic_auth.insecure = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vendordata_dynamic_auth.timeout = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vmware.api_retry_count         = 10 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vmware.ca_file                 = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vmware.cache_prefix            = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vmware.cluster_name            = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vmware.connection_pool_size    = 10 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vmware.console_delay_seconds   = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vmware.datastore_regex         = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vmware.host_ip                 = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vmware.host_password           = **** {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vmware.host_port               = 443 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vmware.host_username           = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vmware.insecure                = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vmware.integration_bridge      = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vmware.maximum_objects         = 100 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vmware.pbm_default_policy      = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vmware.pbm_enabled             = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vmware.pbm_wsdl_location       = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vmware.serial_port_proxy_uri   = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vmware.serial_port_service_uri = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vmware.task_poll_interval      = 0.5 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vmware.use_linked_clone        = True {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vmware.vnc_keymap              = en-us {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vmware.vnc_port                = 5900 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vmware.vnc_port_total          = 10000 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vnc.auth_schemes               = ['none'] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vnc.enabled                    = True {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vnc.novncproxy_port            = 6080 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vnc.vencrypt_ca_certs          = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vnc.vencrypt_client_cert       = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vnc.vencrypt_client_key        = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] workarounds.disable_rootwrap   = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] workarounds.enable_numa_live_migration = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] workarounds.libvirt_disable_apic = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] wsgi.client_socket_timeout     = 900 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] wsgi.default_pool_size         = 1000 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] wsgi.keep_alive                = True {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] wsgi.max_header_line           = 16384 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] wsgi.ssl_ca_file               = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] wsgi.ssl_cert_file             = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] wsgi.ssl_key_file              = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] wsgi.tcp_keepidle              = 600 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] zvm.ca_file                    = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] zvm.cloud_connector_url        = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] zvm.reachable_timeout          = 300 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_policy.enforce_new_defaults = True {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_policy.enforce_scope      = True {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_policy.policy_default_rule = default {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] profiler.connection_string     = messaging:// {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] profiler.enabled               = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] profiler.es_doc_type           = notification {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] profiler.es_scroll_size        = 10000 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] profiler.es_scroll_time        = 2m {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] profiler.filter_error_trace    = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] profiler.hmac_keys             = **** {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] profiler.sentinel_service_name = mymaster {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] profiler.socket_timeout        = 0.1 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] profiler.trace_requests        = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] profiler.trace_sqlalchemy      = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] profiler_jaeger.process_tags   = {} {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] profiler_jaeger.service_name_prefix = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] profiler_otlp.service_name_prefix = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] remote_debug.host              = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] remote_debug.port              = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_notifications.retry = -1 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_limit.auth_section        = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_limit.auth_type           = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_limit.cafile              = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_limit.certfile            = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_limit.collect_timing      = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_limit.connect_retries     = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_limit.connect_retry_delay = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_limit.endpoint_id         = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_limit.endpoint_override   = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_limit.insecure            = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_limit.keyfile             = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_limit.max_version         = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_limit.min_version         = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_limit.region_name         = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_limit.service_name        = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_limit.service_type        = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_limit.split_loggers       = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_limit.status_code_retries = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_limit.status_code_retry_delay = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_limit.timeout             = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_limit.valid_interfaces    = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_limit.version             = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_reports.file_event_handler = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] oslo_reports.log_dir           = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vif_plug_ovs_privileged.group  = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] vif_plug_ovs_privileged.user   = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] os_vif_ovs.isolate_vif         = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] os_brick.lock_path             = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] privsep_osbrick.capabilities   = [21] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] privsep_osbrick.group          = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] privsep_osbrick.helper_command = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] privsep_osbrick.user           = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] nova_sys_admin.group           = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] nova_sys_admin.helper_command  = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] nova_sys_admin.user            = None {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG oslo_service.service [None req-59ba5a30-7607-4bcd-a983-b15dfe8612c8 None None] ******************************************************************************** {{(pid=74821) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 06 13:06:21 user nova-compute[74821]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 06 13:06:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Connecting to libvirt: qemu:///system {{(pid=74821) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f7e5875b040> {{(pid=74821) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 06 13:06:21 user nova-compute[74821]: libvirt:  error : internal error: could not initialize domain event timer
Nov 06 13:06:21 user nova-compute[74821]: WARNING nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 06 13:06:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f7e5875b040> {{(pid=74821) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Starting native event thread {{(pid=74821) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Starting green dispatch thread {{(pid=74821) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 06 13:06:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Starting connection event dispatch thread {{(pid=74821) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 06 13:06:21 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Connection event '1' reason 'None'
Nov 06 13:06:21 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 06 13:06:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.mount [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Initialising _HostMountState generation 0 {{(pid=74821) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 06 13:06:28 user nova-compute[74821]: INFO nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Libvirt host capabilities <capabilities>
Nov 06 13:06:28 user nova-compute[74821]:   <host>
Nov 06 13:06:28 user nova-compute[74821]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 06 13:06:28 user nova-compute[74821]:     <cpu>
Nov 06 13:06:28 user nova-compute[74821]:       <arch>x86_64</arch>
Nov 06 13:06:28 user nova-compute[74821]:       <model>IvyBridge-IBRS</model>
Nov 06 13:06:28 user nova-compute[74821]:       <vendor>Intel</vendor>
Nov 06 13:06:28 user nova-compute[74821]:       <microcode version='1070'/>
Nov 06 13:06:28 user nova-compute[74821]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 06 13:06:28 user nova-compute[74821]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 06 13:06:28 user nova-compute[74821]:       <feature name='ss'/>
Nov 06 13:06:28 user nova-compute[74821]:       <feature name='vmx'/>
Nov 06 13:06:28 user nova-compute[74821]:       <feature name='pcid'/>
Nov 06 13:06:28 user nova-compute[74821]:       <feature name='osxsave'/>
Nov 06 13:06:28 user nova-compute[74821]:       <feature name='hypervisor'/>
Nov 06 13:06:28 user nova-compute[74821]:       <feature name='arat'/>
Nov 06 13:06:28 user nova-compute[74821]:       <feature name='tsc_adjust'/>
Nov 06 13:06:28 user nova-compute[74821]:       <feature name='md-clear'/>
Nov 06 13:06:28 user nova-compute[74821]:       <feature name='stibp'/>
Nov 06 13:06:28 user nova-compute[74821]:       <feature name='arch-capabilities'/>
Nov 06 13:06:28 user nova-compute[74821]:       <feature name='ssbd'/>
Nov 06 13:06:28 user nova-compute[74821]:       <feature name='invtsc'/>
Nov 06 13:06:28 user nova-compute[74821]:       <feature name='rsba'/>
Nov 06 13:06:28 user nova-compute[74821]:       <feature name='skip-l1dfl-vmentry'/>
Nov 06 13:06:28 user nova-compute[74821]:       <pages unit='KiB' size='4'/>
Nov 06 13:06:28 user nova-compute[74821]:       <pages unit='KiB' size='2048'/>
Nov 06 13:06:28 user nova-compute[74821]:     </cpu>
Nov 06 13:06:28 user nova-compute[74821]:     <power_management>
Nov 06 13:06:28 user nova-compute[74821]:       <suspend_mem/>
Nov 06 13:06:28 user nova-compute[74821]:       <suspend_disk/>
Nov 06 13:06:28 user nova-compute[74821]:       <suspend_hybrid/>
Nov 06 13:06:28 user nova-compute[74821]:     </power_management>
Nov 06 13:06:28 user nova-compute[74821]:     <iommu support='no'/>
Nov 06 13:06:28 user nova-compute[74821]:     <migration_features>
Nov 06 13:06:28 user nova-compute[74821]:       <live/>
Nov 06 13:06:28 user nova-compute[74821]:       <uri_transports>
Nov 06 13:06:28 user nova-compute[74821]:         <uri_transport>tcp</uri_transport>
Nov 06 13:06:28 user nova-compute[74821]:         <uri_transport>rdma</uri_transport>
Nov 06 13:06:28 user nova-compute[74821]:       </uri_transports>
Nov 06 13:06:28 user nova-compute[74821]:     </migration_features>
Nov 06 13:06:28 user nova-compute[74821]:     <topology>
Nov 06 13:06:28 user nova-compute[74821]:       <cells num='2'>
Nov 06 13:06:28 user nova-compute[74821]:         <cell id='0'>
Nov 06 13:06:28 user nova-compute[74821]:           <memory unit='KiB'>8140616</memory>
Nov 06 13:06:28 user nova-compute[74821]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 06 13:06:28 user nova-compute[74821]:           <pages unit='KiB' size='2048'>0</pages>
Nov 06 13:06:28 user nova-compute[74821]:           <distances>
Nov 06 13:06:28 user nova-compute[74821]:             <sibling id='0' value='10'/>
Nov 06 13:06:28 user nova-compute[74821]:             <sibling id='1' value='20'/>
Nov 06 13:06:28 user nova-compute[74821]:           </distances>
Nov 06 13:06:28 user nova-compute[74821]:           <cpus num='6'>
Nov 06 13:06:28 user nova-compute[74821]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 06 13:06:28 user nova-compute[74821]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 06 13:06:28 user nova-compute[74821]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 06 13:06:28 user nova-compute[74821]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 06 13:06:28 user nova-compute[74821]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 06 13:06:28 user nova-compute[74821]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 06 13:06:28 user nova-compute[74821]:           </cpus>
Nov 06 13:06:28 user nova-compute[74821]:         </cell>
Nov 06 13:06:28 user nova-compute[74821]:         <cell id='1'>
Nov 06 13:06:28 user nova-compute[74821]:           <memory unit='KiB'>8255100</memory>
Nov 06 13:06:28 user nova-compute[74821]:           <pages unit='KiB' size='4'>2063775</pages>
Nov 06 13:06:28 user nova-compute[74821]:           <pages unit='KiB' size='2048'>0</pages>
Nov 06 13:06:28 user nova-compute[74821]:           <distances>
Nov 06 13:06:28 user nova-compute[74821]:             <sibling id='0' value='20'/>
Nov 06 13:06:28 user nova-compute[74821]:             <sibling id='1' value='10'/>
Nov 06 13:06:28 user nova-compute[74821]:           </distances>
Nov 06 13:06:28 user nova-compute[74821]:           <cpus num='6'>
Nov 06 13:06:28 user nova-compute[74821]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 06 13:06:28 user nova-compute[74821]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 06 13:06:28 user nova-compute[74821]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 06 13:06:28 user nova-compute[74821]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 06 13:06:28 user nova-compute[74821]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 06 13:06:28 user nova-compute[74821]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 06 13:06:28 user nova-compute[74821]:           </cpus>
Nov 06 13:06:28 user nova-compute[74821]:         </cell>
Nov 06 13:06:28 user nova-compute[74821]:       </cells>
Nov 06 13:06:28 user nova-compute[74821]:     </topology>
Nov 06 13:06:28 user nova-compute[74821]:     <cache>
Nov 06 13:06:28 user nova-compute[74821]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 06 13:06:28 user nova-compute[74821]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 06 13:06:28 user nova-compute[74821]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 06 13:06:28 user nova-compute[74821]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 06 13:06:28 user nova-compute[74821]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 06 13:06:28 user nova-compute[74821]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 06 13:06:28 user nova-compute[74821]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 06 13:06:28 user nova-compute[74821]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 06 13:06:28 user nova-compute[74821]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 06 13:06:28 user nova-compute[74821]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 06 13:06:28 user nova-compute[74821]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 06 13:06:28 user nova-compute[74821]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 06 13:06:28 user nova-compute[74821]:     </cache>
Nov 06 13:06:28 user nova-compute[74821]:     <secmodel>
Nov 06 13:06:28 user nova-compute[74821]:       <model>apparmor</model>
Nov 06 13:06:28 user nova-compute[74821]:       <doi>0</doi>
Nov 06 13:06:28 user nova-compute[74821]:     </secmodel>
Nov 06 13:06:28 user nova-compute[74821]:     <secmodel>
Nov 06 13:06:28 user nova-compute[74821]:       <model>dac</model>
Nov 06 13:06:28 user nova-compute[74821]:       <doi>0</doi>
Nov 06 13:06:28 user nova-compute[74821]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 06 13:06:28 user nova-compute[74821]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 06 13:06:28 user nova-compute[74821]:     </secmodel>
Nov 06 13:06:28 user nova-compute[74821]:   </host>
Nov 06 13:06:28 user nova-compute[74821]:   <guest>
Nov 06 13:06:28 user nova-compute[74821]:     <os_type>hvm</os_type>
Nov 06 13:06:28 user nova-compute[74821]:     <arch name='alpha'>
Nov 06 13:06:28 user nova-compute[74821]:       <wordsize>64</wordsize>
Nov 06 13:06:28 user nova-compute[74821]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='4'>clipper</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <domain type='qemu'/>
Nov 06 13:06:28 user nova-compute[74821]:     </arch>
Nov 06 13:06:28 user nova-compute[74821]:     <features>
Nov 06 13:06:28 user nova-compute[74821]:       <cpuselection/>
Nov 06 13:06:28 user nova-compute[74821]:       <deviceboot/>
Nov 06 13:06:28 user nova-compute[74821]:       <disksnapshot default='on' toggle='no'/>
Nov 06 13:06:28 user nova-compute[74821]:     </features>
Nov 06 13:06:28 user nova-compute[74821]:   </guest>
Nov 06 13:06:28 user nova-compute[74821]:   <guest>
Nov 06 13:06:28 user nova-compute[74821]:     <os_type>hvm</os_type>
Nov 06 13:06:28 user nova-compute[74821]:     <arch name='armv6l'>
Nov 06 13:06:28 user nova-compute[74821]:       <wordsize>32</wordsize>
Nov 06 13:06:28 user nova-compute[74821]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>integratorcp</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>borzoi</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>spitz</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>nuri</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>musca-b1</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>versatileab</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>kzm</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>musca-a</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>smdkc210</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>sx1</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>z2</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>tosa</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='4'>sabrelite</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>realview-eb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>n810</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>n800</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>versatilepb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>terrier</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>mainstone</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='4'>midway</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>musicpal</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>microbit</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>cubieboard</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>verdex</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>netduino2</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='4'>raspi2b</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>cheetah</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='4'>highbank</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>akita</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>connex</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>collie</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>raspi0</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <domain type='qemu'/>
Nov 06 13:06:28 user nova-compute[74821]:     </arch>
Nov 06 13:06:28 user nova-compute[74821]:     <features>
Nov 06 13:06:28 user nova-compute[74821]:       <cpuselection/>
Nov 06 13:06:28 user nova-compute[74821]:       <deviceboot/>
Nov 06 13:06:28 user nova-compute[74821]:       <disksnapshot default='on' toggle='no'/>
Nov 06 13:06:28 user nova-compute[74821]:     </features>
Nov 06 13:06:28 user nova-compute[74821]:   </guest>
Nov 06 13:06:28 user nova-compute[74821]:   <guest>
Nov 06 13:06:28 user nova-compute[74821]:     <os_type>hvm</os_type>
Nov 06 13:06:28 user nova-compute[74821]:     <arch name='armv7l'>
Nov 06 13:06:28 user nova-compute[74821]:       <wordsize>32</wordsize>
Nov 06 13:06:28 user nova-compute[74821]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>integratorcp</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>borzoi</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>spitz</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>nuri</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>musca-b1</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>versatileab</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>kzm</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>musca-a</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>smdkc210</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>sx1</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>z2</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>tosa</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='4'>sabrelite</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>realview-eb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>n810</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>n800</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>versatilepb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>terrier</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>mainstone</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='4'>midway</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>musicpal</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>microbit</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>cubieboard</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>verdex</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>netduino2</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='4'>raspi2b</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>cheetah</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='4'>highbank</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>akita</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>connex</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>collie</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>raspi0</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <domain type='qemu'/>
Nov 06 13:06:28 user nova-compute[74821]:     </arch>
Nov 06 13:06:28 user nova-compute[74821]:     <features>
Nov 06 13:06:28 user nova-compute[74821]:       <cpuselection/>
Nov 06 13:06:28 user nova-compute[74821]:       <deviceboot/>
Nov 06 13:06:28 user nova-compute[74821]:       <disksnapshot default='on' toggle='no'/>
Nov 06 13:06:28 user nova-compute[74821]:     </features>
Nov 06 13:06:28 user nova-compute[74821]:   </guest>
Nov 06 13:06:28 user nova-compute[74821]:   <guest>
Nov 06 13:06:28 user nova-compute[74821]:     <os_type>hvm</os_type>
Nov 06 13:06:28 user nova-compute[74821]:     <arch name='aarch64'>
Nov 06 13:06:28 user nova-compute[74821]:       <wordsize>64</wordsize>
Nov 06 13:06:28 user nova-compute[74821]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>integratorcp</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>borzoi</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>spitz</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>nuri</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>musca-b1</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>versatileab</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>kzm</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>musca-a</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>smdkc210</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>sx1</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>z2</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>tosa</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='4'>sabrelite</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>realview-eb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>n810</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>n800</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>versatilepb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>terrier</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>mainstone</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='4'>midway</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>musicpal</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>microbit</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>cubieboard</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>verdex</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>netduino2</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='4'>raspi3b</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='4'>raspi2b</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>cheetah</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='4'>highbank</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>akita</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>connex</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>collie</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>raspi0</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <domain type='qemu'/>
Nov 06 13:06:28 user nova-compute[74821]:     </arch>
Nov 06 13:06:28 user nova-compute[74821]:     <features>
Nov 06 13:06:28 user nova-compute[74821]:       <acpi default='on' toggle='yes'/>
Nov 06 13:06:28 user nova-compute[74821]:       <cpuselection/>
Nov 06 13:06:28 user nova-compute[74821]:       <deviceboot/>
Nov 06 13:06:28 user nova-compute[74821]:       <disksnapshot default='on' toggle='no'/>
Nov 06 13:06:28 user nova-compute[74821]:     </features>
Nov 06 13:06:28 user nova-compute[74821]:   </guest>
Nov 06 13:06:28 user nova-compute[74821]:   <guest>
Nov 06 13:06:28 user nova-compute[74821]:     <os_type>hvm</os_type>
Nov 06 13:06:28 user nova-compute[74821]:     <arch name='cris'>
Nov 06 13:06:28 user nova-compute[74821]:       <wordsize>32</wordsize>
Nov 06 13:06:28 user nova-compute[74821]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <domain type='qemu'/>
Nov 06 13:06:28 user nova-compute[74821]:     </arch>
Nov 06 13:06:28 user nova-compute[74821]:     <features>
Nov 06 13:06:28 user nova-compute[74821]:       <cpuselection/>
Nov 06 13:06:28 user nova-compute[74821]:       <deviceboot/>
Nov 06 13:06:28 user nova-compute[74821]:       <disksnapshot default='on' toggle='no'/>
Nov 06 13:06:28 user nova-compute[74821]:     </features>
Nov 06 13:06:28 user nova-compute[74821]:   </guest>
Nov 06 13:06:28 user nova-compute[74821]:   <guest>
Nov 06 13:06:28 user nova-compute[74821]:     <os_type>hvm</os_type>
Nov 06 13:06:28 user nova-compute[74821]:     <arch name='i686'>
Nov 06 13:06:28 user nova-compute[74821]:       <wordsize>32</wordsize>
Nov 06 13:06:28 user nova-compute[74821]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>x-remote</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>isapc</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>microvm</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <domain type='qemu'/>
Nov 06 13:06:28 user nova-compute[74821]:       <domain type='kvm'/>
Nov 06 13:06:28 user nova-compute[74821]:     </arch>
Nov 06 13:06:28 user nova-compute[74821]:     <features>
Nov 06 13:06:28 user nova-compute[74821]:       <pae/>
Nov 06 13:06:28 user nova-compute[74821]:       <nonpae/>
Nov 06 13:06:28 user nova-compute[74821]:       <acpi default='on' toggle='yes'/>
Nov 06 13:06:28 user nova-compute[74821]:       <apic default='on' toggle='no'/>
Nov 06 13:06:28 user nova-compute[74821]:       <cpuselection/>
Nov 06 13:06:28 user nova-compute[74821]:       <deviceboot/>
Nov 06 13:06:28 user nova-compute[74821]:       <disksnapshot default='on' toggle='no'/>
Nov 06 13:06:28 user nova-compute[74821]:     </features>
Nov 06 13:06:28 user nova-compute[74821]:   </guest>
Nov 06 13:06:28 user nova-compute[74821]:   <guest>
Nov 06 13:06:28 user nova-compute[74821]:     <os_type>hvm</os_type>
Nov 06 13:06:28 user nova-compute[74821]:     <arch name='m68k'>
Nov 06 13:06:28 user nova-compute[74821]:       <wordsize>32</wordsize>
Nov 06 13:06:28 user nova-compute[74821]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>an5206</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>q800</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>next-cube</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <domain type='qemu'/>
Nov 06 13:06:28 user nova-compute[74821]:     </arch>
Nov 06 13:06:28 user nova-compute[74821]:     <features>
Nov 06 13:06:28 user nova-compute[74821]:       <cpuselection/>
Nov 06 13:06:28 user nova-compute[74821]:       <deviceboot/>
Nov 06 13:06:28 user nova-compute[74821]:       <disksnapshot default='on' toggle='no'/>
Nov 06 13:06:28 user nova-compute[74821]:     </features>
Nov 06 13:06:28 user nova-compute[74821]:   </guest>
Nov 06 13:06:28 user nova-compute[74821]:   <guest>
Nov 06 13:06:28 user nova-compute[74821]:     <os_type>hvm</os_type>
Nov 06 13:06:28 user nova-compute[74821]:     <arch name='microblaze'>
Nov 06 13:06:28 user nova-compute[74821]:       <wordsize>32</wordsize>
Nov 06 13:06:28 user nova-compute[74821]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <domain type='qemu'/>
Nov 06 13:06:28 user nova-compute[74821]:     </arch>
Nov 06 13:06:28 user nova-compute[74821]:     <features>
Nov 06 13:06:28 user nova-compute[74821]:       <cpuselection/>
Nov 06 13:06:28 user nova-compute[74821]:       <deviceboot/>
Nov 06 13:06:28 user nova-compute[74821]:       <disksnapshot default='on' toggle='no'/>
Nov 06 13:06:28 user nova-compute[74821]:     </features>
Nov 06 13:06:28 user nova-compute[74821]:   </guest>
Nov 06 13:06:28 user nova-compute[74821]:   <guest>
Nov 06 13:06:28 user nova-compute[74821]:     <os_type>hvm</os_type>
Nov 06 13:06:28 user nova-compute[74821]:     <arch name='microblazeel'>
Nov 06 13:06:28 user nova-compute[74821]:       <wordsize>32</wordsize>
Nov 06 13:06:28 user nova-compute[74821]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <domain type='qemu'/>
Nov 06 13:06:28 user nova-compute[74821]:     </arch>
Nov 06 13:06:28 user nova-compute[74821]:     <features>
Nov 06 13:06:28 user nova-compute[74821]:       <cpuselection/>
Nov 06 13:06:28 user nova-compute[74821]:       <deviceboot/>
Nov 06 13:06:28 user nova-compute[74821]:       <disksnapshot default='on' toggle='no'/>
Nov 06 13:06:28 user nova-compute[74821]:     </features>
Nov 06 13:06:28 user nova-compute[74821]:   </guest>
Nov 06 13:06:28 user nova-compute[74821]:   <guest>
Nov 06 13:06:28 user nova-compute[74821]:     <os_type>hvm</os_type>
Nov 06 13:06:28 user nova-compute[74821]:     <arch name='mips'>
Nov 06 13:06:28 user nova-compute[74821]:       <wordsize>32</wordsize>
Nov 06 13:06:28 user nova-compute[74821]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='16'>malta</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>mipssim</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <domain type='qemu'/>
Nov 06 13:06:28 user nova-compute[74821]:     </arch>
Nov 06 13:06:28 user nova-compute[74821]:     <features>
Nov 06 13:06:28 user nova-compute[74821]:       <cpuselection/>
Nov 06 13:06:28 user nova-compute[74821]:       <deviceboot/>
Nov 06 13:06:28 user nova-compute[74821]:       <disksnapshot default='on' toggle='no'/>
Nov 06 13:06:28 user nova-compute[74821]:     </features>
Nov 06 13:06:28 user nova-compute[74821]:   </guest>
Nov 06 13:06:28 user nova-compute[74821]:   <guest>
Nov 06 13:06:28 user nova-compute[74821]:     <os_type>hvm</os_type>
Nov 06 13:06:28 user nova-compute[74821]:     <arch name='mipsel'>
Nov 06 13:06:28 user nova-compute[74821]:       <wordsize>32</wordsize>
Nov 06 13:06:28 user nova-compute[74821]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='16'>malta</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>mipssim</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <domain type='qemu'/>
Nov 06 13:06:28 user nova-compute[74821]:     </arch>
Nov 06 13:06:28 user nova-compute[74821]:     <features>
Nov 06 13:06:28 user nova-compute[74821]:       <cpuselection/>
Nov 06 13:06:28 user nova-compute[74821]:       <deviceboot/>
Nov 06 13:06:28 user nova-compute[74821]:       <disksnapshot default='on' toggle='no'/>
Nov 06 13:06:28 user nova-compute[74821]:     </features>
Nov 06 13:06:28 user nova-compute[74821]:   </guest>
Nov 06 13:06:28 user nova-compute[74821]:   <guest>
Nov 06 13:06:28 user nova-compute[74821]:     <os_type>hvm</os_type>
Nov 06 13:06:28 user nova-compute[74821]:     <arch name='mips64'>
Nov 06 13:06:28 user nova-compute[74821]:       <wordsize>64</wordsize>
Nov 06 13:06:28 user nova-compute[74821]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='16'>malta</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>mipssim</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>pica61</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>magnum</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <domain type='qemu'/>
Nov 06 13:06:28 user nova-compute[74821]:     </arch>
Nov 06 13:06:28 user nova-compute[74821]:     <features>
Nov 06 13:06:28 user nova-compute[74821]:       <cpuselection/>
Nov 06 13:06:28 user nova-compute[74821]:       <deviceboot/>
Nov 06 13:06:28 user nova-compute[74821]:       <disksnapshot default='on' toggle='no'/>
Nov 06 13:06:28 user nova-compute[74821]:     </features>
Nov 06 13:06:28 user nova-compute[74821]:   </guest>
Nov 06 13:06:28 user nova-compute[74821]:   <guest>
Nov 06 13:06:28 user nova-compute[74821]:     <os_type>hvm</os_type>
Nov 06 13:06:28 user nova-compute[74821]:     <arch name='mips64el'>
Nov 06 13:06:28 user nova-compute[74821]:       <wordsize>64</wordsize>
Nov 06 13:06:28 user nova-compute[74821]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='16'>malta</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>mipssim</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>pica61</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>magnum</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='16'>boston</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <domain type='qemu'/>
Nov 06 13:06:28 user nova-compute[74821]:     </arch>
Nov 06 13:06:28 user nova-compute[74821]:     <features>
Nov 06 13:06:28 user nova-compute[74821]:       <cpuselection/>
Nov 06 13:06:28 user nova-compute[74821]:       <deviceboot/>
Nov 06 13:06:28 user nova-compute[74821]:       <disksnapshot default='on' toggle='no'/>
Nov 06 13:06:28 user nova-compute[74821]:     </features>
Nov 06 13:06:28 user nova-compute[74821]:   </guest>
Nov 06 13:06:28 user nova-compute[74821]:   <guest>
Nov 06 13:06:28 user nova-compute[74821]:     <os_type>hvm</os_type>
Nov 06 13:06:28 user nova-compute[74821]:     <arch name='ppc'>
Nov 06 13:06:28 user nova-compute[74821]:       <wordsize>32</wordsize>
Nov 06 13:06:28 user nova-compute[74821]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>g3beige</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>mac99</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='32'>ppce500</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>pegasos2</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>sam460ex</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>bamboo</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>40p</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>ref405ep</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='1'>taihu</machine>
Nov 06 13:06:28 user nova-compute[74821]:       <domain type='qemu'/>
Nov 06 13:06:28 user nova-compute[74821]:     </arch>
Nov 06 13:06:28 user nova-compute[74821]:     <features>
Nov 06 13:06:28 user nova-compute[74821]:       <cpuselection/>
Nov 06 13:06:28 user nova-compute[74821]:       <deviceboot/>
Nov 06 13:06:28 user nova-compute[74821]:       <disksnapshot default='on' toggle='no'/>
Nov 06 13:06:28 user nova-compute[74821]:     </features>
Nov 06 13:06:28 user nova-compute[74821]:   </guest>
Nov 06 13:06:28 user nova-compute[74821]:   <guest>
Nov 06 13:06:28 user nova-compute[74821]:     <os_type>hvm</os_type>
Nov 06 13:06:28 user nova-compute[74821]:     <arch name='ppc64'>
Nov 06 13:06:28 user nova-compute[74821]:       <wordsize>64</wordsize>
Nov 06 13:06:28 user nova-compute[74821]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 06 13:06:28 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2048'>powernv9</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>taihu</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2048'>powernv10</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='32'>ppce500</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>40p</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>pegasos2</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>bamboo</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>g3beige</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>mac99</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>sam460ex</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>ref405ep</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2048'>powernv8</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <domain type='qemu'/>
Nov 06 13:06:29 user nova-compute[74821]:     </arch>
Nov 06 13:06:29 user nova-compute[74821]:     <features>
Nov 06 13:06:29 user nova-compute[74821]:       <cpuselection/>
Nov 06 13:06:29 user nova-compute[74821]:       <deviceboot/>
Nov 06 13:06:29 user nova-compute[74821]:       <disksnapshot default='on' toggle='no'/>
Nov 06 13:06:29 user nova-compute[74821]:     </features>
Nov 06 13:06:29 user nova-compute[74821]:   </guest>
Nov 06 13:06:29 user nova-compute[74821]:   <guest>
Nov 06 13:06:29 user nova-compute[74821]:     <os_type>hvm</os_type>
Nov 06 13:06:29 user nova-compute[74821]:     <arch name='ppc64le'>
Nov 06 13:06:29 user nova-compute[74821]:       <wordsize>64</wordsize>
Nov 06 13:06:29 user nova-compute[74821]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2048'>powernv9</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>taihu</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2048'>powernv10</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='32'>ppce500</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>40p</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>pegasos2</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>bamboo</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>g3beige</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>mac99</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>sam460ex</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>ref405ep</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2048'>powernv8</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <domain type='qemu'/>
Nov 06 13:06:29 user nova-compute[74821]:     </arch>
Nov 06 13:06:29 user nova-compute[74821]:     <features>
Nov 06 13:06:29 user nova-compute[74821]:       <cpuselection/>
Nov 06 13:06:29 user nova-compute[74821]:       <deviceboot/>
Nov 06 13:06:29 user nova-compute[74821]:       <disksnapshot default='on' toggle='no'/>
Nov 06 13:06:29 user nova-compute[74821]:     </features>
Nov 06 13:06:29 user nova-compute[74821]:   </guest>
Nov 06 13:06:29 user nova-compute[74821]:   <guest>
Nov 06 13:06:29 user nova-compute[74821]:     <os_type>hvm</os_type>
Nov 06 13:06:29 user nova-compute[74821]:     <arch name='riscv32'>
Nov 06 13:06:29 user nova-compute[74821]:       <wordsize>32</wordsize>
Nov 06 13:06:29 user nova-compute[74821]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='8'>spike</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>opentitan</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='5'>sifive_u</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>sifive_e</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='8'>virt</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <domain type='qemu'/>
Nov 06 13:06:29 user nova-compute[74821]:     </arch>
Nov 06 13:06:29 user nova-compute[74821]:     <features>
Nov 06 13:06:29 user nova-compute[74821]:       <cpuselection/>
Nov 06 13:06:29 user nova-compute[74821]:       <deviceboot/>
Nov 06 13:06:29 user nova-compute[74821]:       <disksnapshot default='on' toggle='no'/>
Nov 06 13:06:29 user nova-compute[74821]:     </features>
Nov 06 13:06:29 user nova-compute[74821]:   </guest>
Nov 06 13:06:29 user nova-compute[74821]:   <guest>
Nov 06 13:06:29 user nova-compute[74821]:     <os_type>hvm</os_type>
Nov 06 13:06:29 user nova-compute[74821]:     <arch name='riscv64'>
Nov 06 13:06:29 user nova-compute[74821]:       <wordsize>64</wordsize>
Nov 06 13:06:29 user nova-compute[74821]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='8'>spike</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='5'>sifive_u</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>shakti_c</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>sifive_e</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='8'>virt</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <domain type='qemu'/>
Nov 06 13:06:29 user nova-compute[74821]:     </arch>
Nov 06 13:06:29 user nova-compute[74821]:     <features>
Nov 06 13:06:29 user nova-compute[74821]:       <cpuselection/>
Nov 06 13:06:29 user nova-compute[74821]:       <deviceboot/>
Nov 06 13:06:29 user nova-compute[74821]:       <disksnapshot default='on' toggle='no'/>
Nov 06 13:06:29 user nova-compute[74821]:     </features>
Nov 06 13:06:29 user nova-compute[74821]:   </guest>
Nov 06 13:06:29 user nova-compute[74821]:   <guest>
Nov 06 13:06:29 user nova-compute[74821]:     <os_type>hvm</os_type>
Nov 06 13:06:29 user nova-compute[74821]:     <arch name='s390x'>
Nov 06 13:06:29 user nova-compute[74821]:       <wordsize>64</wordsize>
Nov 06 13:06:29 user nova-compute[74821]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <domain type='qemu'/>
Nov 06 13:06:29 user nova-compute[74821]:     </arch>
Nov 06 13:06:29 user nova-compute[74821]:     <features>
Nov 06 13:06:29 user nova-compute[74821]:       <cpuselection/>
Nov 06 13:06:29 user nova-compute[74821]:       <deviceboot/>
Nov 06 13:06:29 user nova-compute[74821]:       <disksnapshot default='on' toggle='no'/>
Nov 06 13:06:29 user nova-compute[74821]:     </features>
Nov 06 13:06:29 user nova-compute[74821]:   </guest>
Nov 06 13:06:29 user nova-compute[74821]:   <guest>
Nov 06 13:06:29 user nova-compute[74821]:     <os_type>hvm</os_type>
Nov 06 13:06:29 user nova-compute[74821]:     <arch name='sh4'>
Nov 06 13:06:29 user nova-compute[74821]:       <wordsize>32</wordsize>
Nov 06 13:06:29 user nova-compute[74821]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>shix</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>r2d</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <domain type='qemu'/>
Nov 06 13:06:29 user nova-compute[74821]:     </arch>
Nov 06 13:06:29 user nova-compute[74821]:     <features>
Nov 06 13:06:29 user nova-compute[74821]:       <cpuselection/>
Nov 06 13:06:29 user nova-compute[74821]:       <deviceboot/>
Nov 06 13:06:29 user nova-compute[74821]:       <disksnapshot default='on' toggle='no'/>
Nov 06 13:06:29 user nova-compute[74821]:     </features>
Nov 06 13:06:29 user nova-compute[74821]:   </guest>
Nov 06 13:06:29 user nova-compute[74821]:   <guest>
Nov 06 13:06:29 user nova-compute[74821]:     <os_type>hvm</os_type>
Nov 06 13:06:29 user nova-compute[74821]:     <arch name='sh4eb'>
Nov 06 13:06:29 user nova-compute[74821]:       <wordsize>64</wordsize>
Nov 06 13:06:29 user nova-compute[74821]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>shix</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>r2d</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <domain type='qemu'/>
Nov 06 13:06:29 user nova-compute[74821]:     </arch>
Nov 06 13:06:29 user nova-compute[74821]:     <features>
Nov 06 13:06:29 user nova-compute[74821]:       <cpuselection/>
Nov 06 13:06:29 user nova-compute[74821]:       <deviceboot/>
Nov 06 13:06:29 user nova-compute[74821]:       <disksnapshot default='on' toggle='no'/>
Nov 06 13:06:29 user nova-compute[74821]:     </features>
Nov 06 13:06:29 user nova-compute[74821]:   </guest>
Nov 06 13:06:29 user nova-compute[74821]:   <guest>
Nov 06 13:06:29 user nova-compute[74821]:     <os_type>hvm</os_type>
Nov 06 13:06:29 user nova-compute[74821]:     <arch name='sparc'>
Nov 06 13:06:29 user nova-compute[74821]:       <wordsize>32</wordsize>
Nov 06 13:06:29 user nova-compute[74821]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>SS-5</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='4'>SS-20</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>LX</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>SS-4</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='4'>SS-10</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>Voyager</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <domain type='qemu'/>
Nov 06 13:06:29 user nova-compute[74821]:     </arch>
Nov 06 13:06:29 user nova-compute[74821]:     <features>
Nov 06 13:06:29 user nova-compute[74821]:       <cpuselection/>
Nov 06 13:06:29 user nova-compute[74821]:       <deviceboot/>
Nov 06 13:06:29 user nova-compute[74821]:       <disksnapshot default='on' toggle='no'/>
Nov 06 13:06:29 user nova-compute[74821]:     </features>
Nov 06 13:06:29 user nova-compute[74821]:   </guest>
Nov 06 13:06:29 user nova-compute[74821]:   <guest>
Nov 06 13:06:29 user nova-compute[74821]:     <os_type>hvm</os_type>
Nov 06 13:06:29 user nova-compute[74821]:     <arch name='sparc64'>
Nov 06 13:06:29 user nova-compute[74821]:       <wordsize>64</wordsize>
Nov 06 13:06:29 user nova-compute[74821]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>sun4u</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>niagara</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>sun4v</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <domain type='qemu'/>
Nov 06 13:06:29 user nova-compute[74821]:     </arch>
Nov 06 13:06:29 user nova-compute[74821]:     <features>
Nov 06 13:06:29 user nova-compute[74821]:       <cpuselection/>
Nov 06 13:06:29 user nova-compute[74821]:       <deviceboot/>
Nov 06 13:06:29 user nova-compute[74821]:       <disksnapshot default='on' toggle='no'/>
Nov 06 13:06:29 user nova-compute[74821]:     </features>
Nov 06 13:06:29 user nova-compute[74821]:   </guest>
Nov 06 13:06:29 user nova-compute[74821]:   <guest>
Nov 06 13:06:29 user nova-compute[74821]:     <os_type>hvm</os_type>
Nov 06 13:06:29 user nova-compute[74821]:     <arch name='x86_64'>
Nov 06 13:06:29 user nova-compute[74821]:       <wordsize>64</wordsize>
Nov 06 13:06:29 user nova-compute[74821]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>x-remote</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='1'>isapc</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>microvm</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <domain type='qemu'/>
Nov 06 13:06:29 user nova-compute[74821]:       <domain type='kvm'/>
Nov 06 13:06:29 user nova-compute[74821]:     </arch>
Nov 06 13:06:29 user nova-compute[74821]:     <features>
Nov 06 13:06:29 user nova-compute[74821]:       <acpi default='on' toggle='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:       <apic default='on' toggle='no'/>
Nov 06 13:06:29 user nova-compute[74821]:       <cpuselection/>
Nov 06 13:06:29 user nova-compute[74821]:       <deviceboot/>
Nov 06 13:06:29 user nova-compute[74821]:       <disksnapshot default='on' toggle='no'/>
Nov 06 13:06:29 user nova-compute[74821]:     </features>
Nov 06 13:06:29 user nova-compute[74821]:   </guest>
Nov 06 13:06:29 user nova-compute[74821]:   <guest>
Nov 06 13:06:29 user nova-compute[74821]:     <os_type>hvm</os_type>
Nov 06 13:06:29 user nova-compute[74821]:     <arch name='xtensa'>
Nov 06 13:06:29 user nova-compute[74821]:       <wordsize>32</wordsize>
Nov 06 13:06:29 user nova-compute[74821]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='4'>sim</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='32'>kc705</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='32'>ml605</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='32'>virt</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='32'>lx200</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='32'>lx60</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <domain type='qemu'/>
Nov 06 13:06:29 user nova-compute[74821]:     </arch>
Nov 06 13:06:29 user nova-compute[74821]:     <features>
Nov 06 13:06:29 user nova-compute[74821]:       <cpuselection/>
Nov 06 13:06:29 user nova-compute[74821]:       <deviceboot/>
Nov 06 13:06:29 user nova-compute[74821]:       <disksnapshot default='on' toggle='no'/>
Nov 06 13:06:29 user nova-compute[74821]:     </features>
Nov 06 13:06:29 user nova-compute[74821]:   </guest>
Nov 06 13:06:29 user nova-compute[74821]:   <guest>
Nov 06 13:06:29 user nova-compute[74821]:     <os_type>hvm</os_type>
Nov 06 13:06:29 user nova-compute[74821]:     <arch name='xtensaeb'>
Nov 06 13:06:29 user nova-compute[74821]:       <wordsize>32</wordsize>
Nov 06 13:06:29 user nova-compute[74821]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='4'>sim</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='32'>kc705</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='32'>ml605</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='32'>virt</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='32'>lx200</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='32'>lx60</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 06 13:06:29 user nova-compute[74821]:       <domain type='qemu'/>
Nov 06 13:06:29 user nova-compute[74821]:     </arch>
Nov 06 13:06:29 user nova-compute[74821]:     <features>
Nov 06 13:06:29 user nova-compute[74821]:       <cpuselection/>
Nov 06 13:06:29 user nova-compute[74821]:       <deviceboot/>
Nov 06 13:06:29 user nova-compute[74821]:       <disksnapshot default='on' toggle='no'/>
Nov 06 13:06:29 user nova-compute[74821]:     </features>
Nov 06 13:06:29 user nova-compute[74821]:   </guest>
Nov 06 13:06:29 user nova-compute[74821]: </capabilities>
Nov 06 13:06:29 user nova-compute[74821]: 
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74821) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74821) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74821) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74821) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74821) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74821) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74821) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74821) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74821) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74821) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74821) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'pc', 'ubuntu', 'q35'} {{(pid=74821) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 06 13:06:29 user nova-compute[74821]: <domainCapabilities>
Nov 06 13:06:29 user nova-compute[74821]:   <path>/usr/bin/qemu-system-i386</path>
Nov 06 13:06:29 user nova-compute[74821]:   <domain>kvm</domain>
Nov 06 13:06:29 user nova-compute[74821]:   <machine>pc-q35-jammy</machine>
Nov 06 13:06:29 user nova-compute[74821]:   <arch>i686</arch>
Nov 06 13:06:29 user nova-compute[74821]:   <vcpu max='288'/>
Nov 06 13:06:29 user nova-compute[74821]:   <iothreads supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:   <os supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:     <enum name='firmware'/>
Nov 06 13:06:29 user nova-compute[74821]:     <loader supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 06 13:06:29 user nova-compute[74821]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 06 13:06:29 user nova-compute[74821]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 06 13:06:29 user nova-compute[74821]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 06 13:06:29 user nova-compute[74821]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='type'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>rom</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>pflash</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='readonly'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>yes</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>no</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='secure'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>no</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </loader>
Nov 06 13:06:29 user nova-compute[74821]:   </os>
Nov 06 13:06:29 user nova-compute[74821]:   <cpu>
Nov 06 13:06:29 user nova-compute[74821]:     <mode name='host-passthrough' supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='hostPassthroughMigratable'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>off</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </mode>
Nov 06 13:06:29 user nova-compute[74821]:     <mode name='maximum' supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='maximumMigratable'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>on</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>off</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </mode>
Nov 06 13:06:29 user nova-compute[74821]:     <mode name='host-model' supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <vendor>Intel</vendor>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='ss'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='vmx'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='pcid'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='hypervisor'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='arat'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='tsc_adjust'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='umip'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='md-clear'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='stibp'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='arch-capabilities'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='ssbd'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='ibpb'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='ibrs'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='amd-stibp'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='amd-ssbd'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='disable' name='erms'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='disable' name='xsaveopt'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='disable' name='lm'/>
Nov 06 13:06:29 user nova-compute[74821]:     </mode>
Nov 06 13:06:29 user nova-compute[74821]:     <mode name='custom' supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>qemu64</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>qemu32</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>phenom</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>pentium3</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>pentium2</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>pentium</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>n270</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>kvm64</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>kvm32</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>coreduo</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>core2duo</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>athlon</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Westmere-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Westmere</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Snowridge</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Server</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Client</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>SandyBridge</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Penryn</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Opteron_G5</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Opteron_G4</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Opteron_G3</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Opteron_G2</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Opteron_G1</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Nehalem-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Nehalem</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>IvyBridge</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Icelake-Server</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Haswell-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Haswell-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Haswell</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>EPYC-Rome</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>EPYC-Milan</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>EPYC-IBPB</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>EPYC</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Dhyana</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Cooperlake</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Conroe</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Cascadelake-Server</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Broadwell-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Broadwell-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Broadwell</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>486</model>
Nov 06 13:06:29 user nova-compute[74821]:     </mode>
Nov 06 13:06:29 user nova-compute[74821]:   </cpu>
Nov 06 13:06:29 user nova-compute[74821]:   <memoryBacking supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:     <enum name='sourceType'>
Nov 06 13:06:29 user nova-compute[74821]:       <value>file</value>
Nov 06 13:06:29 user nova-compute[74821]:       <value>anonymous</value>
Nov 06 13:06:29 user nova-compute[74821]:       <value>memfd</value>
Nov 06 13:06:29 user nova-compute[74821]:     </enum>
Nov 06 13:06:29 user nova-compute[74821]:   </memoryBacking>
Nov 06 13:06:29 user nova-compute[74821]:   <devices>
Nov 06 13:06:29 user nova-compute[74821]:     <disk supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='diskDevice'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>disk</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>cdrom</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>floppy</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>lun</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='bus'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>fdc</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>scsi</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>usb</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>sata</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='model'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio-transitional</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio-non-transitional</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </disk>
Nov 06 13:06:29 user nova-compute[74821]:     <graphics supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='type'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>sdl</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>vnc</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>spice</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>egl-headless</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </graphics>
Nov 06 13:06:29 user nova-compute[74821]:     <video supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='modelType'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>vga</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>cirrus</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>vmvga</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>qxl</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>none</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>bochs</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>ramfb</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </video>
Nov 06 13:06:29 user nova-compute[74821]:     <hostdev supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='mode'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>subsystem</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='startupPolicy'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>default</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>mandatory</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>requisite</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>optional</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='subsysType'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>usb</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>pci</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>scsi</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='capsType'/>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='pciBackend'/>
Nov 06 13:06:29 user nova-compute[74821]:     </hostdev>
Nov 06 13:06:29 user nova-compute[74821]:     <rng supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='model'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio-transitional</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio-non-transitional</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='backendModel'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>random</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>egd</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>builtin</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </rng>
Nov 06 13:06:29 user nova-compute[74821]:     <filesystem supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='driverType'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>path</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>handle</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtiofs</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </filesystem>
Nov 06 13:06:29 user nova-compute[74821]:     <tpm supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='model'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>tpm-tis</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>tpm-crb</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='backendModel'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>passthrough</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>emulator</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </tpm>
Nov 06 13:06:29 user nova-compute[74821]:   </devices>
Nov 06 13:06:29 user nova-compute[74821]:   <features>
Nov 06 13:06:29 user nova-compute[74821]:     <gic supported='no'/>
Nov 06 13:06:29 user nova-compute[74821]:     <vmcoreinfo supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:     <genid supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:     <backingStoreInput supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:     <backup supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:     <sev supported='no'/>
Nov 06 13:06:29 user nova-compute[74821]:   </features>
Nov 06 13:06:29 user nova-compute[74821]: </domainCapabilities>
Nov 06 13:06:29 user nova-compute[74821]:  {{(pid=74821) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 06 13:06:29 user nova-compute[74821]: <domainCapabilities>
Nov 06 13:06:29 user nova-compute[74821]:   <path>/usr/bin/qemu-system-i386</path>
Nov 06 13:06:29 user nova-compute[74821]:   <domain>kvm</domain>
Nov 06 13:06:29 user nova-compute[74821]:   <machine>pc-i440fx-6.2</machine>
Nov 06 13:06:29 user nova-compute[74821]:   <arch>i686</arch>
Nov 06 13:06:29 user nova-compute[74821]:   <vcpu max='255'/>
Nov 06 13:06:29 user nova-compute[74821]:   <iothreads supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:   <os supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:     <enum name='firmware'/>
Nov 06 13:06:29 user nova-compute[74821]:     <loader supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 06 13:06:29 user nova-compute[74821]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 06 13:06:29 user nova-compute[74821]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 06 13:06:29 user nova-compute[74821]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 06 13:06:29 user nova-compute[74821]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='type'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>rom</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>pflash</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='readonly'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>yes</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>no</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='secure'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>no</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </loader>
Nov 06 13:06:29 user nova-compute[74821]:   </os>
Nov 06 13:06:29 user nova-compute[74821]:   <cpu>
Nov 06 13:06:29 user nova-compute[74821]:     <mode name='host-passthrough' supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='hostPassthroughMigratable'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>off</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </mode>
Nov 06 13:06:29 user nova-compute[74821]:     <mode name='maximum' supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='maximumMigratable'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>on</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>off</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </mode>
Nov 06 13:06:29 user nova-compute[74821]:     <mode name='host-model' supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <vendor>Intel</vendor>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='ss'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='vmx'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='pcid'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='hypervisor'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='arat'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='tsc_adjust'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='umip'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='md-clear'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='stibp'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='arch-capabilities'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='ssbd'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='ibpb'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='ibrs'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='amd-stibp'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='amd-ssbd'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='disable' name='erms'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='disable' name='xsaveopt'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='disable' name='lm'/>
Nov 06 13:06:29 user nova-compute[74821]:     </mode>
Nov 06 13:06:29 user nova-compute[74821]:     <mode name='custom' supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>qemu64</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>qemu32</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>phenom</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>pentium3</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>pentium2</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>pentium</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>n270</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>kvm64</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>kvm32</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>coreduo</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>core2duo</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>athlon</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Westmere-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Westmere</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Snowridge</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Server</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Client</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>SandyBridge</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Penryn</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Opteron_G5</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Opteron_G4</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Opteron_G3</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Opteron_G2</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Opteron_G1</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Nehalem-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Nehalem</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>IvyBridge</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Icelake-Server</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Haswell-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Haswell-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Haswell</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>EPYC-Rome</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>EPYC-Milan</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>EPYC-IBPB</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>EPYC</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Dhyana</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Cooperlake</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Conroe</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Cascadelake-Server</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Broadwell-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Broadwell-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Broadwell</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>486</model>
Nov 06 13:06:29 user nova-compute[74821]:     </mode>
Nov 06 13:06:29 user nova-compute[74821]:   </cpu>
Nov 06 13:06:29 user nova-compute[74821]:   <memoryBacking supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:     <enum name='sourceType'>
Nov 06 13:06:29 user nova-compute[74821]:       <value>file</value>
Nov 06 13:06:29 user nova-compute[74821]:       <value>anonymous</value>
Nov 06 13:06:29 user nova-compute[74821]:       <value>memfd</value>
Nov 06 13:06:29 user nova-compute[74821]:     </enum>
Nov 06 13:06:29 user nova-compute[74821]:   </memoryBacking>
Nov 06 13:06:29 user nova-compute[74821]:   <devices>
Nov 06 13:06:29 user nova-compute[74821]:     <disk supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='diskDevice'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>disk</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>cdrom</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>floppy</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>lun</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='bus'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>ide</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>fdc</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>scsi</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>usb</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>sata</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='model'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio-transitional</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio-non-transitional</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </disk>
Nov 06 13:06:29 user nova-compute[74821]:     <graphics supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='type'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>sdl</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>vnc</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>spice</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>egl-headless</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </graphics>
Nov 06 13:06:29 user nova-compute[74821]:     <video supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='modelType'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>vga</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>cirrus</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>vmvga</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>qxl</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>none</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>bochs</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>ramfb</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </video>
Nov 06 13:06:29 user nova-compute[74821]:     <hostdev supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='mode'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>subsystem</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='startupPolicy'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>default</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>mandatory</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>requisite</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>optional</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='subsysType'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>usb</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>pci</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>scsi</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='capsType'/>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='pciBackend'/>
Nov 06 13:06:29 user nova-compute[74821]:     </hostdev>
Nov 06 13:06:29 user nova-compute[74821]:     <rng supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='model'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio-transitional</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio-non-transitional</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='backendModel'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>random</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>egd</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>builtin</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </rng>
Nov 06 13:06:29 user nova-compute[74821]:     <filesystem supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='driverType'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>path</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>handle</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtiofs</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </filesystem>
Nov 06 13:06:29 user nova-compute[74821]:     <tpm supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='model'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>tpm-tis</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>tpm-crb</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='backendModel'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>passthrough</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>emulator</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </tpm>
Nov 06 13:06:29 user nova-compute[74821]:   </devices>
Nov 06 13:06:29 user nova-compute[74821]:   <features>
Nov 06 13:06:29 user nova-compute[74821]:     <gic supported='no'/>
Nov 06 13:06:29 user nova-compute[74821]:     <vmcoreinfo supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:     <genid supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:     <backingStoreInput supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:     <backup supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:     <sev supported='no'/>
Nov 06 13:06:29 user nova-compute[74821]:   </features>
Nov 06 13:06:29 user nova-compute[74821]: </domainCapabilities>
Nov 06 13:06:29 user nova-compute[74821]:  {{(pid=74821) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 06 13:06:29 user nova-compute[74821]: <domainCapabilities>
Nov 06 13:06:29 user nova-compute[74821]:   <path>/usr/bin/qemu-system-i386</path>
Nov 06 13:06:29 user nova-compute[74821]:   <domain>kvm</domain>
Nov 06 13:06:29 user nova-compute[74821]:   <machine>pc-i440fx-jammy</machine>
Nov 06 13:06:29 user nova-compute[74821]:   <arch>i686</arch>
Nov 06 13:06:29 user nova-compute[74821]:   <vcpu max='255'/>
Nov 06 13:06:29 user nova-compute[74821]:   <iothreads supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:   <os supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:     <enum name='firmware'/>
Nov 06 13:06:29 user nova-compute[74821]:     <loader supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 06 13:06:29 user nova-compute[74821]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 06 13:06:29 user nova-compute[74821]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 06 13:06:29 user nova-compute[74821]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 06 13:06:29 user nova-compute[74821]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='type'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>rom</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>pflash</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='readonly'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>yes</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>no</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='secure'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>no</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </loader>
Nov 06 13:06:29 user nova-compute[74821]:   </os>
Nov 06 13:06:29 user nova-compute[74821]:   <cpu>
Nov 06 13:06:29 user nova-compute[74821]:     <mode name='host-passthrough' supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='hostPassthroughMigratable'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>off</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </mode>
Nov 06 13:06:29 user nova-compute[74821]:     <mode name='maximum' supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='maximumMigratable'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>on</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>off</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </mode>
Nov 06 13:06:29 user nova-compute[74821]:     <mode name='host-model' supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <vendor>Intel</vendor>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='ss'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='vmx'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='pcid'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='hypervisor'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='arat'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='tsc_adjust'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='umip'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='md-clear'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='stibp'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='arch-capabilities'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='ssbd'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='ibpb'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='ibrs'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='amd-stibp'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='amd-ssbd'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='disable' name='erms'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='disable' name='xsaveopt'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='disable' name='lm'/>
Nov 06 13:06:29 user nova-compute[74821]:     </mode>
Nov 06 13:06:29 user nova-compute[74821]:     <mode name='custom' supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>qemu64</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>qemu32</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>phenom</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>pentium3</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>pentium2</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>pentium</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>n270</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>kvm64</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>kvm32</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>coreduo</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>core2duo</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>athlon</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Westmere-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Westmere</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Snowridge</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Server</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Client</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>SandyBridge</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Penryn</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Opteron_G5</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Opteron_G4</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Opteron_G3</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Opteron_G2</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Opteron_G1</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Nehalem-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Nehalem</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>IvyBridge</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Icelake-Server</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Haswell-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Haswell-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Haswell</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>EPYC-Rome</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>EPYC-Milan</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>EPYC-IBPB</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>EPYC</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Dhyana</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Cooperlake</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Conroe</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Cascadelake-Server</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Broadwell-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Broadwell-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Broadwell</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>486</model>
Nov 06 13:06:29 user nova-compute[74821]:     </mode>
Nov 06 13:06:29 user nova-compute[74821]:   </cpu>
Nov 06 13:06:29 user nova-compute[74821]:   <memoryBacking supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:     <enum name='sourceType'>
Nov 06 13:06:29 user nova-compute[74821]:       <value>file</value>
Nov 06 13:06:29 user nova-compute[74821]:       <value>anonymous</value>
Nov 06 13:06:29 user nova-compute[74821]:       <value>memfd</value>
Nov 06 13:06:29 user nova-compute[74821]:     </enum>
Nov 06 13:06:29 user nova-compute[74821]:   </memoryBacking>
Nov 06 13:06:29 user nova-compute[74821]:   <devices>
Nov 06 13:06:29 user nova-compute[74821]:     <disk supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='diskDevice'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>disk</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>cdrom</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>floppy</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>lun</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='bus'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>ide</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>fdc</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>scsi</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>usb</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>sata</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='model'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio-transitional</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio-non-transitional</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </disk>
Nov 06 13:06:29 user nova-compute[74821]:     <graphics supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='type'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>sdl</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>vnc</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>spice</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>egl-headless</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </graphics>
Nov 06 13:06:29 user nova-compute[74821]:     <video supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='modelType'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>vga</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>cirrus</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>vmvga</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>qxl</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>none</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>bochs</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>ramfb</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </video>
Nov 06 13:06:29 user nova-compute[74821]:     <hostdev supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='mode'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>subsystem</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='startupPolicy'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>default</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>mandatory</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>requisite</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>optional</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='subsysType'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>usb</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>pci</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>scsi</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='capsType'/>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='pciBackend'/>
Nov 06 13:06:29 user nova-compute[74821]:     </hostdev>
Nov 06 13:06:29 user nova-compute[74821]:     <rng supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='model'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio-transitional</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio-non-transitional</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='backendModel'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>random</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>egd</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>builtin</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </rng>
Nov 06 13:06:29 user nova-compute[74821]:     <filesystem supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='driverType'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>path</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>handle</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtiofs</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </filesystem>
Nov 06 13:06:29 user nova-compute[74821]:     <tpm supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='model'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>tpm-tis</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>tpm-crb</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='backendModel'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>passthrough</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>emulator</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </tpm>
Nov 06 13:06:29 user nova-compute[74821]:   </devices>
Nov 06 13:06:29 user nova-compute[74821]:   <features>
Nov 06 13:06:29 user nova-compute[74821]:     <gic supported='no'/>
Nov 06 13:06:29 user nova-compute[74821]:     <vmcoreinfo supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:     <genid supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:     <backingStoreInput supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:     <backup supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:     <sev supported='no'/>
Nov 06 13:06:29 user nova-compute[74821]:   </features>
Nov 06 13:06:29 user nova-compute[74821]: </domainCapabilities>
Nov 06 13:06:29 user nova-compute[74821]:  {{(pid=74821) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 06 13:06:29 user nova-compute[74821]: <domainCapabilities>
Nov 06 13:06:29 user nova-compute[74821]:   <path>/usr/bin/qemu-system-i386</path>
Nov 06 13:06:29 user nova-compute[74821]:   <domain>kvm</domain>
Nov 06 13:06:29 user nova-compute[74821]:   <machine>pc-q35-6.2</machine>
Nov 06 13:06:29 user nova-compute[74821]:   <arch>i686</arch>
Nov 06 13:06:29 user nova-compute[74821]:   <vcpu max='288'/>
Nov 06 13:06:29 user nova-compute[74821]:   <iothreads supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:   <os supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:     <enum name='firmware'/>
Nov 06 13:06:29 user nova-compute[74821]:     <loader supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 06 13:06:29 user nova-compute[74821]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 06 13:06:29 user nova-compute[74821]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 06 13:06:29 user nova-compute[74821]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 06 13:06:29 user nova-compute[74821]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='type'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>rom</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>pflash</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='readonly'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>yes</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>no</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='secure'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>no</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </loader>
Nov 06 13:06:29 user nova-compute[74821]:   </os>
Nov 06 13:06:29 user nova-compute[74821]:   <cpu>
Nov 06 13:06:29 user nova-compute[74821]:     <mode name='host-passthrough' supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='hostPassthroughMigratable'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>off</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </mode>
Nov 06 13:06:29 user nova-compute[74821]:     <mode name='maximum' supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='maximumMigratable'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>on</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>off</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </mode>
Nov 06 13:06:29 user nova-compute[74821]:     <mode name='host-model' supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <vendor>Intel</vendor>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='ss'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='vmx'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='pcid'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='hypervisor'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='arat'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='tsc_adjust'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='umip'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='md-clear'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='stibp'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='arch-capabilities'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='ssbd'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='ibpb'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='ibrs'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='amd-stibp'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='amd-ssbd'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='disable' name='erms'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='disable' name='xsaveopt'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='disable' name='lm'/>
Nov 06 13:06:29 user nova-compute[74821]:     </mode>
Nov 06 13:06:29 user nova-compute[74821]:     <mode name='custom' supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>qemu64</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>qemu32</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>phenom</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>pentium3</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>pentium2</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>pentium</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>n270</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>kvm64</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>kvm32</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>coreduo</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>core2duo</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>athlon</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Westmere-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Westmere</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Snowridge</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Server</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Client</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>SandyBridge</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Penryn</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Opteron_G5</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Opteron_G4</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Opteron_G3</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Opteron_G2</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Opteron_G1</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Nehalem-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Nehalem</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>IvyBridge</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Icelake-Server</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Haswell-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Haswell-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Haswell</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>EPYC-Rome</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>EPYC-Milan</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>EPYC-IBPB</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>EPYC</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Dhyana</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Cooperlake</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Conroe</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Cascadelake-Server</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Broadwell-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Broadwell-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Broadwell</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>486</model>
Nov 06 13:06:29 user nova-compute[74821]:     </mode>
Nov 06 13:06:29 user nova-compute[74821]:   </cpu>
Nov 06 13:06:29 user nova-compute[74821]:   <memoryBacking supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:     <enum name='sourceType'>
Nov 06 13:06:29 user nova-compute[74821]:       <value>file</value>
Nov 06 13:06:29 user nova-compute[74821]:       <value>anonymous</value>
Nov 06 13:06:29 user nova-compute[74821]:       <value>memfd</value>
Nov 06 13:06:29 user nova-compute[74821]:     </enum>
Nov 06 13:06:29 user nova-compute[74821]:   </memoryBacking>
Nov 06 13:06:29 user nova-compute[74821]:   <devices>
Nov 06 13:06:29 user nova-compute[74821]:     <disk supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='diskDevice'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>disk</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>cdrom</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>floppy</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>lun</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='bus'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>fdc</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>scsi</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>usb</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>sata</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='model'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio-transitional</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio-non-transitional</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </disk>
Nov 06 13:06:29 user nova-compute[74821]:     <graphics supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='type'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>sdl</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>vnc</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>spice</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>egl-headless</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </graphics>
Nov 06 13:06:29 user nova-compute[74821]:     <video supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='modelType'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>vga</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>cirrus</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>vmvga</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>qxl</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>none</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>bochs</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>ramfb</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </video>
Nov 06 13:06:29 user nova-compute[74821]:     <hostdev supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='mode'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>subsystem</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='startupPolicy'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>default</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>mandatory</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>requisite</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>optional</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='subsysType'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>usb</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>pci</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>scsi</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='capsType'/>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='pciBackend'/>
Nov 06 13:06:29 user nova-compute[74821]:     </hostdev>
Nov 06 13:06:29 user nova-compute[74821]:     <rng supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='model'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio-transitional</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio-non-transitional</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='backendModel'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>random</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>egd</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>builtin</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </rng>
Nov 06 13:06:29 user nova-compute[74821]:     <filesystem supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='driverType'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>path</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>handle</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtiofs</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </filesystem>
Nov 06 13:06:29 user nova-compute[74821]:     <tpm supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='model'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>tpm-tis</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>tpm-crb</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='backendModel'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>passthrough</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>emulator</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </tpm>
Nov 06 13:06:29 user nova-compute[74821]:   </devices>
Nov 06 13:06:29 user nova-compute[74821]:   <features>
Nov 06 13:06:29 user nova-compute[74821]:     <gic supported='no'/>
Nov 06 13:06:29 user nova-compute[74821]:     <vmcoreinfo supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:     <genid supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:     <backingStoreInput supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:     <backup supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:     <sev supported='no'/>
Nov 06 13:06:29 user nova-compute[74821]:   </features>
Nov 06 13:06:29 user nova-compute[74821]: </domainCapabilities>
Nov 06 13:06:29 user nova-compute[74821]:  {{(pid=74821) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74821) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74821) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74821) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74821) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74821) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74821) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74821) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74821) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74821) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74821) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74821) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74821) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74821) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74821) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74821) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74821) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74821) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=74821) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74821) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74821) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74821) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=74821) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74821) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74821) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74821) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74821) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74821) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74821) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74821) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74821) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74821) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74821) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74821) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74821) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74821) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74821) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74821) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74821) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'pc', 'ubuntu', 'q35'} {{(pid=74821) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 06 13:06:29 user nova-compute[74821]: <domainCapabilities>
Nov 06 13:06:29 user nova-compute[74821]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 06 13:06:29 user nova-compute[74821]:   <domain>kvm</domain>
Nov 06 13:06:29 user nova-compute[74821]:   <machine>pc-q35-jammy</machine>
Nov 06 13:06:29 user nova-compute[74821]:   <arch>x86_64</arch>
Nov 06 13:06:29 user nova-compute[74821]:   <vcpu max='288'/>
Nov 06 13:06:29 user nova-compute[74821]:   <iothreads supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:   <os supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:     <enum name='firmware'>
Nov 06 13:06:29 user nova-compute[74821]:       <value>efi</value>
Nov 06 13:06:29 user nova-compute[74821]:     </enum>
Nov 06 13:06:29 user nova-compute[74821]:     <loader supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 06 13:06:29 user nova-compute[74821]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 06 13:06:29 user nova-compute[74821]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='type'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>rom</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>pflash</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='readonly'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>yes</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>no</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='secure'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>yes</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>no</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </loader>
Nov 06 13:06:29 user nova-compute[74821]:   </os>
Nov 06 13:06:29 user nova-compute[74821]:   <cpu>
Nov 06 13:06:29 user nova-compute[74821]:     <mode name='host-passthrough' supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='hostPassthroughMigratable'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>on</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>off</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </mode>
Nov 06 13:06:29 user nova-compute[74821]:     <mode name='maximum' supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='maximumMigratable'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>on</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>off</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </mode>
Nov 06 13:06:29 user nova-compute[74821]:     <mode name='host-model' supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <vendor>Intel</vendor>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='ss'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='vmx'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='pcid'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='hypervisor'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='arat'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='tsc_adjust'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='umip'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='md-clear'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='stibp'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='arch-capabilities'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='ssbd'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='invtsc'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='ibpb'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='ibrs'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='amd-stibp'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='amd-ssbd'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='rsba'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='pschange-mc-no'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='disable' name='erms'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='disable' name='xsaveopt'/>
Nov 06 13:06:29 user nova-compute[74821]:     </mode>
Nov 06 13:06:29 user nova-compute[74821]:     <mode name='custom' supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>qemu64</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>qemu32</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>phenom</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>pentium3</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>pentium2</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>pentium</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>n270</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>kvm64</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>kvm32</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>coreduo</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>core2duo</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>athlon</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>Westmere-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>Westmere</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Snowridge</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Server</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Client</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>SandyBridge</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>Penryn</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Opteron_G5</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Opteron_G4</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Opteron_G3</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Opteron_G2</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>Opteron_G1</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>Nehalem</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>IvyBridge</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Icelake-Server</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Haswell-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Haswell-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Haswell</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>EPYC-Rome</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>EPYC-Milan</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>EPYC-IBPB</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>EPYC</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Dhyana</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Cooperlake</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>Conroe</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Cascadelake-Server</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Broadwell-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Broadwell-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Broadwell</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>486</model>
Nov 06 13:06:29 user nova-compute[74821]:     </mode>
Nov 06 13:06:29 user nova-compute[74821]:   </cpu>
Nov 06 13:06:29 user nova-compute[74821]:   <memoryBacking supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:     <enum name='sourceType'>
Nov 06 13:06:29 user nova-compute[74821]:       <value>file</value>
Nov 06 13:06:29 user nova-compute[74821]:       <value>anonymous</value>
Nov 06 13:06:29 user nova-compute[74821]:       <value>memfd</value>
Nov 06 13:06:29 user nova-compute[74821]:     </enum>
Nov 06 13:06:29 user nova-compute[74821]:   </memoryBacking>
Nov 06 13:06:29 user nova-compute[74821]:   <devices>
Nov 06 13:06:29 user nova-compute[74821]:     <disk supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='diskDevice'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>disk</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>cdrom</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>floppy</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>lun</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='bus'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>fdc</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>scsi</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>usb</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>sata</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='model'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio-transitional</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio-non-transitional</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </disk>
Nov 06 13:06:29 user nova-compute[74821]:     <graphics supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='type'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>sdl</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>vnc</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>spice</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>egl-headless</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </graphics>
Nov 06 13:06:29 user nova-compute[74821]:     <video supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='modelType'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>vga</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>cirrus</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>vmvga</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>qxl</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>none</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>bochs</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>ramfb</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </video>
Nov 06 13:06:29 user nova-compute[74821]:     <hostdev supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='mode'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>subsystem</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='startupPolicy'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>default</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>mandatory</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>requisite</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>optional</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='subsysType'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>usb</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>pci</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>scsi</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='capsType'/>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='pciBackend'/>
Nov 06 13:06:29 user nova-compute[74821]:     </hostdev>
Nov 06 13:06:29 user nova-compute[74821]:     <rng supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='model'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio-transitional</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio-non-transitional</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='backendModel'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>random</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>egd</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>builtin</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </rng>
Nov 06 13:06:29 user nova-compute[74821]:     <filesystem supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='driverType'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>path</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>handle</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtiofs</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </filesystem>
Nov 06 13:06:29 user nova-compute[74821]:     <tpm supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='model'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>tpm-tis</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>tpm-crb</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='backendModel'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>passthrough</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>emulator</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </tpm>
Nov 06 13:06:29 user nova-compute[74821]:   </devices>
Nov 06 13:06:29 user nova-compute[74821]:   <features>
Nov 06 13:06:29 user nova-compute[74821]:     <gic supported='no'/>
Nov 06 13:06:29 user nova-compute[74821]:     <vmcoreinfo supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:     <genid supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:     <backingStoreInput supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:     <backup supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:     <sev supported='no'/>
Nov 06 13:06:29 user nova-compute[74821]:   </features>
Nov 06 13:06:29 user nova-compute[74821]: </domainCapabilities>
Nov 06 13:06:29 user nova-compute[74821]:  {{(pid=74821) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 06 13:06:29 user nova-compute[74821]: <domainCapabilities>
Nov 06 13:06:29 user nova-compute[74821]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 06 13:06:29 user nova-compute[74821]:   <domain>kvm</domain>
Nov 06 13:06:29 user nova-compute[74821]:   <machine>pc-i440fx-6.2</machine>
Nov 06 13:06:29 user nova-compute[74821]:   <arch>x86_64</arch>
Nov 06 13:06:29 user nova-compute[74821]:   <vcpu max='255'/>
Nov 06 13:06:29 user nova-compute[74821]:   <iothreads supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:   <os supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:     <enum name='firmware'>
Nov 06 13:06:29 user nova-compute[74821]:       <value>efi</value>
Nov 06 13:06:29 user nova-compute[74821]:     </enum>
Nov 06 13:06:29 user nova-compute[74821]:     <loader supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='type'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>rom</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>pflash</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='readonly'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>yes</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>no</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='secure'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>no</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </loader>
Nov 06 13:06:29 user nova-compute[74821]:   </os>
Nov 06 13:06:29 user nova-compute[74821]:   <cpu>
Nov 06 13:06:29 user nova-compute[74821]:     <mode name='host-passthrough' supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='hostPassthroughMigratable'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>on</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>off</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </mode>
Nov 06 13:06:29 user nova-compute[74821]:     <mode name='maximum' supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='maximumMigratable'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>on</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>off</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </mode>
Nov 06 13:06:29 user nova-compute[74821]:     <mode name='host-model' supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <vendor>Intel</vendor>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='ss'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='vmx'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='pcid'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='hypervisor'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='arat'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='tsc_adjust'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='umip'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='md-clear'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='stibp'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='arch-capabilities'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='ssbd'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='invtsc'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='ibpb'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='ibrs'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='amd-stibp'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='amd-ssbd'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='rsba'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='pschange-mc-no'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='disable' name='erms'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='disable' name='xsaveopt'/>
Nov 06 13:06:29 user nova-compute[74821]:     </mode>
Nov 06 13:06:29 user nova-compute[74821]:     <mode name='custom' supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>qemu64</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>qemu32</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>phenom</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>pentium3</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>pentium2</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>pentium</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>n270</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>kvm64</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>kvm32</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>coreduo</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>core2duo</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>athlon</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>Westmere-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>Westmere</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Snowridge</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Server</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Client</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>SandyBridge</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>Penryn</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Opteron_G5</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Opteron_G4</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Opteron_G3</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Opteron_G2</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>Opteron_G1</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>Nehalem</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>IvyBridge</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Icelake-Server</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Haswell-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Haswell-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Haswell</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>EPYC-Rome</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>EPYC-Milan</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>EPYC-IBPB</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>EPYC</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Dhyana</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Cooperlake</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>Conroe</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Cascadelake-Server</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Broadwell-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Broadwell-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Broadwell</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>486</model>
Nov 06 13:06:29 user nova-compute[74821]:     </mode>
Nov 06 13:06:29 user nova-compute[74821]:   </cpu>
Nov 06 13:06:29 user nova-compute[74821]:   <memoryBacking supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:     <enum name='sourceType'>
Nov 06 13:06:29 user nova-compute[74821]:       <value>file</value>
Nov 06 13:06:29 user nova-compute[74821]:       <value>anonymous</value>
Nov 06 13:06:29 user nova-compute[74821]:       <value>memfd</value>
Nov 06 13:06:29 user nova-compute[74821]:     </enum>
Nov 06 13:06:29 user nova-compute[74821]:   </memoryBacking>
Nov 06 13:06:29 user nova-compute[74821]:   <devices>
Nov 06 13:06:29 user nova-compute[74821]:     <disk supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='diskDevice'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>disk</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>cdrom</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>floppy</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>lun</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='bus'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>ide</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>fdc</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>scsi</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>usb</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>sata</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='model'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio-transitional</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio-non-transitional</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </disk>
Nov 06 13:06:29 user nova-compute[74821]:     <graphics supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='type'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>sdl</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>vnc</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>spice</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>egl-headless</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </graphics>
Nov 06 13:06:29 user nova-compute[74821]:     <video supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='modelType'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>vga</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>cirrus</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>vmvga</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>qxl</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>none</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>bochs</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>ramfb</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </video>
Nov 06 13:06:29 user nova-compute[74821]:     <hostdev supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='mode'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>subsystem</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='startupPolicy'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>default</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>mandatory</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>requisite</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>optional</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='subsysType'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>usb</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>pci</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>scsi</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='capsType'/>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='pciBackend'/>
Nov 06 13:06:29 user nova-compute[74821]:     </hostdev>
Nov 06 13:06:29 user nova-compute[74821]:     <rng supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='model'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio-transitional</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio-non-transitional</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='backendModel'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>random</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>egd</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>builtin</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </rng>
Nov 06 13:06:29 user nova-compute[74821]:     <filesystem supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='driverType'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>path</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>handle</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtiofs</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </filesystem>
Nov 06 13:06:29 user nova-compute[74821]:     <tpm supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='model'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>tpm-tis</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>tpm-crb</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='backendModel'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>passthrough</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>emulator</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </tpm>
Nov 06 13:06:29 user nova-compute[74821]:   </devices>
Nov 06 13:06:29 user nova-compute[74821]:   <features>
Nov 06 13:06:29 user nova-compute[74821]:     <gic supported='no'/>
Nov 06 13:06:29 user nova-compute[74821]:     <vmcoreinfo supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:     <genid supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:     <backingStoreInput supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:     <backup supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:     <sev supported='no'/>
Nov 06 13:06:29 user nova-compute[74821]:   </features>
Nov 06 13:06:29 user nova-compute[74821]: </domainCapabilities>
Nov 06 13:06:29 user nova-compute[74821]:  {{(pid=74821) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 06 13:06:29 user nova-compute[74821]: <domainCapabilities>
Nov 06 13:06:29 user nova-compute[74821]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 06 13:06:29 user nova-compute[74821]:   <domain>kvm</domain>
Nov 06 13:06:29 user nova-compute[74821]:   <machine>pc-i440fx-jammy</machine>
Nov 06 13:06:29 user nova-compute[74821]:   <arch>x86_64</arch>
Nov 06 13:06:29 user nova-compute[74821]:   <vcpu max='255'/>
Nov 06 13:06:29 user nova-compute[74821]:   <iothreads supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:   <os supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:     <enum name='firmware'>
Nov 06 13:06:29 user nova-compute[74821]:       <value>efi</value>
Nov 06 13:06:29 user nova-compute[74821]:     </enum>
Nov 06 13:06:29 user nova-compute[74821]:     <loader supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='type'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>rom</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>pflash</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='readonly'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>yes</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>no</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='secure'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>no</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </loader>
Nov 06 13:06:29 user nova-compute[74821]:   </os>
Nov 06 13:06:29 user nova-compute[74821]:   <cpu>
Nov 06 13:06:29 user nova-compute[74821]:     <mode name='host-passthrough' supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='hostPassthroughMigratable'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>on</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>off</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </mode>
Nov 06 13:06:29 user nova-compute[74821]:     <mode name='maximum' supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='maximumMigratable'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>on</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>off</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </mode>
Nov 06 13:06:29 user nova-compute[74821]:     <mode name='host-model' supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <vendor>Intel</vendor>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='ss'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='vmx'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='pcid'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='hypervisor'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='arat'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='tsc_adjust'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='umip'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='md-clear'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='stibp'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='arch-capabilities'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='ssbd'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='invtsc'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='ibpb'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='ibrs'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='amd-stibp'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='amd-ssbd'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='rsba'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='pschange-mc-no'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='disable' name='erms'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='disable' name='xsaveopt'/>
Nov 06 13:06:29 user nova-compute[74821]:     </mode>
Nov 06 13:06:29 user nova-compute[74821]:     <mode name='custom' supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>qemu64</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>qemu32</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>phenom</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>pentium3</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>pentium2</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>pentium</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>n270</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>kvm64</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>kvm32</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>coreduo</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>core2duo</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>athlon</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>Westmere-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>Westmere</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Snowridge</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Server</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Client</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>SandyBridge</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>Penryn</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Opteron_G5</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Opteron_G4</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Opteron_G3</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Opteron_G2</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>Opteron_G1</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>Nehalem</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>IvyBridge</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Icelake-Server</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Haswell-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Haswell-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Haswell</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>EPYC-Rome</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>EPYC-Milan</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>EPYC-IBPB</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>EPYC</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Dhyana</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Cooperlake</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>Conroe</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Cascadelake-Server</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Broadwell-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Broadwell-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Broadwell</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>486</model>
Nov 06 13:06:29 user nova-compute[74821]:     </mode>
Nov 06 13:06:29 user nova-compute[74821]:   </cpu>
Nov 06 13:06:29 user nova-compute[74821]:   <memoryBacking supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:     <enum name='sourceType'>
Nov 06 13:06:29 user nova-compute[74821]:       <value>file</value>
Nov 06 13:06:29 user nova-compute[74821]:       <value>anonymous</value>
Nov 06 13:06:29 user nova-compute[74821]:       <value>memfd</value>
Nov 06 13:06:29 user nova-compute[74821]:     </enum>
Nov 06 13:06:29 user nova-compute[74821]:   </memoryBacking>
Nov 06 13:06:29 user nova-compute[74821]:   <devices>
Nov 06 13:06:29 user nova-compute[74821]:     <disk supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='diskDevice'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>disk</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>cdrom</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>floppy</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>lun</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='bus'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>ide</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>fdc</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>scsi</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>usb</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>sata</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='model'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio-transitional</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio-non-transitional</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </disk>
Nov 06 13:06:29 user nova-compute[74821]:     <graphics supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='type'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>sdl</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>vnc</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>spice</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>egl-headless</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </graphics>
Nov 06 13:06:29 user nova-compute[74821]:     <video supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='modelType'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>vga</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>cirrus</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>vmvga</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>qxl</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>none</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>bochs</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>ramfb</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </video>
Nov 06 13:06:29 user nova-compute[74821]:     <hostdev supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='mode'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>subsystem</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='startupPolicy'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>default</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>mandatory</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>requisite</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>optional</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='subsysType'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>usb</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>pci</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>scsi</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='capsType'/>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='pciBackend'/>
Nov 06 13:06:29 user nova-compute[74821]:     </hostdev>
Nov 06 13:06:29 user nova-compute[74821]:     <rng supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='model'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio-transitional</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio-non-transitional</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='backendModel'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>random</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>egd</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>builtin</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </rng>
Nov 06 13:06:29 user nova-compute[74821]:     <filesystem supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='driverType'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>path</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>handle</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtiofs</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </filesystem>
Nov 06 13:06:29 user nova-compute[74821]:     <tpm supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='model'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>tpm-tis</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>tpm-crb</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='backendModel'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>passthrough</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>emulator</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </tpm>
Nov 06 13:06:29 user nova-compute[74821]:   </devices>
Nov 06 13:06:29 user nova-compute[74821]:   <features>
Nov 06 13:06:29 user nova-compute[74821]:     <gic supported='no'/>
Nov 06 13:06:29 user nova-compute[74821]:     <vmcoreinfo supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:     <genid supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:     <backingStoreInput supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:     <backup supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:     <sev supported='no'/>
Nov 06 13:06:29 user nova-compute[74821]:   </features>
Nov 06 13:06:29 user nova-compute[74821]: </domainCapabilities>
Nov 06 13:06:29 user nova-compute[74821]:  {{(pid=74821) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 06 13:06:29 user nova-compute[74821]: <domainCapabilities>
Nov 06 13:06:29 user nova-compute[74821]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 06 13:06:29 user nova-compute[74821]:   <domain>kvm</domain>
Nov 06 13:06:29 user nova-compute[74821]:   <machine>pc-q35-6.2</machine>
Nov 06 13:06:29 user nova-compute[74821]:   <arch>x86_64</arch>
Nov 06 13:06:29 user nova-compute[74821]:   <vcpu max='288'/>
Nov 06 13:06:29 user nova-compute[74821]:   <iothreads supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:   <os supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:     <enum name='firmware'>
Nov 06 13:06:29 user nova-compute[74821]:       <value>efi</value>
Nov 06 13:06:29 user nova-compute[74821]:     </enum>
Nov 06 13:06:29 user nova-compute[74821]:     <loader supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 06 13:06:29 user nova-compute[74821]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 06 13:06:29 user nova-compute[74821]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='type'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>rom</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>pflash</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='readonly'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>yes</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>no</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='secure'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>yes</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>no</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </loader>
Nov 06 13:06:29 user nova-compute[74821]:   </os>
Nov 06 13:06:29 user nova-compute[74821]:   <cpu>
Nov 06 13:06:29 user nova-compute[74821]:     <mode name='host-passthrough' supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='hostPassthroughMigratable'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>on</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>off</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </mode>
Nov 06 13:06:29 user nova-compute[74821]:     <mode name='maximum' supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='maximumMigratable'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>on</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>off</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </mode>
Nov 06 13:06:29 user nova-compute[74821]:     <mode name='host-model' supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <vendor>Intel</vendor>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='ss'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='vmx'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='pcid'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='hypervisor'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='arat'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='tsc_adjust'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='umip'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='md-clear'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='stibp'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='arch-capabilities'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='ssbd'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='invtsc'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='ibpb'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='ibrs'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='amd-stibp'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='amd-ssbd'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='rsba'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='require' name='pschange-mc-no'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='disable' name='erms'/>
Nov 06 13:06:29 user nova-compute[74821]:       <feature policy='disable' name='xsaveopt'/>
Nov 06 13:06:29 user nova-compute[74821]:     </mode>
Nov 06 13:06:29 user nova-compute[74821]:     <mode name='custom' supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>qemu64</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>qemu32</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>phenom</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>pentium3</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>pentium2</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>pentium</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>n270</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>kvm64</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>kvm32</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>coreduo</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>core2duo</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>athlon</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>Westmere-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>Westmere</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Snowridge</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Server</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Skylake-Client</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>SandyBridge</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>Penryn</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Opteron_G5</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Opteron_G4</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Opteron_G3</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Opteron_G2</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>Opteron_G1</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>Nehalem</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>IvyBridge</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Icelake-Server</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Haswell-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Haswell-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Haswell</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>EPYC-Rome</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>EPYC-Milan</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>EPYC-IBPB</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>EPYC</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Dhyana</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Cooperlake</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>Conroe</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Cascadelake-Server</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Broadwell-noTSX</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Broadwell-IBRS</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='no'>Broadwell</model>
Nov 06 13:06:29 user nova-compute[74821]:       <model usable='yes'>486</model>
Nov 06 13:06:29 user nova-compute[74821]:     </mode>
Nov 06 13:06:29 user nova-compute[74821]:   </cpu>
Nov 06 13:06:29 user nova-compute[74821]:   <memoryBacking supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:     <enum name='sourceType'>
Nov 06 13:06:29 user nova-compute[74821]:       <value>file</value>
Nov 06 13:06:29 user nova-compute[74821]:       <value>anonymous</value>
Nov 06 13:06:29 user nova-compute[74821]:       <value>memfd</value>
Nov 06 13:06:29 user nova-compute[74821]:     </enum>
Nov 06 13:06:29 user nova-compute[74821]:   </memoryBacking>
Nov 06 13:06:29 user nova-compute[74821]:   <devices>
Nov 06 13:06:29 user nova-compute[74821]:     <disk supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='diskDevice'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>disk</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>cdrom</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>floppy</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>lun</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='bus'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>fdc</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>scsi</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>usb</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>sata</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='model'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio-transitional</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio-non-transitional</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </disk>
Nov 06 13:06:29 user nova-compute[74821]:     <graphics supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='type'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>sdl</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>vnc</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>spice</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>egl-headless</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </graphics>
Nov 06 13:06:29 user nova-compute[74821]:     <video supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='modelType'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>vga</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>cirrus</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>vmvga</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>qxl</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>none</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>bochs</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>ramfb</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </video>
Nov 06 13:06:29 user nova-compute[74821]:     <hostdev supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='mode'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>subsystem</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='startupPolicy'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>default</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>mandatory</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>requisite</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>optional</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='subsysType'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>usb</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>pci</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>scsi</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='capsType'/>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='pciBackend'/>
Nov 06 13:06:29 user nova-compute[74821]:     </hostdev>
Nov 06 13:06:29 user nova-compute[74821]:     <rng supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='model'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio-transitional</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtio-non-transitional</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='backendModel'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>random</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>egd</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>builtin</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </rng>
Nov 06 13:06:29 user nova-compute[74821]:     <filesystem supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='driverType'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>path</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>handle</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>virtiofs</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </filesystem>
Nov 06 13:06:29 user nova-compute[74821]:     <tpm supported='yes'>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='model'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>tpm-tis</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>tpm-crb</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:       <enum name='backendModel'>
Nov 06 13:06:29 user nova-compute[74821]:         <value>passthrough</value>
Nov 06 13:06:29 user nova-compute[74821]:         <value>emulator</value>
Nov 06 13:06:29 user nova-compute[74821]:       </enum>
Nov 06 13:06:29 user nova-compute[74821]:     </tpm>
Nov 06 13:06:29 user nova-compute[74821]:   </devices>
Nov 06 13:06:29 user nova-compute[74821]:   <features>
Nov 06 13:06:29 user nova-compute[74821]:     <gic supported='no'/>
Nov 06 13:06:29 user nova-compute[74821]:     <vmcoreinfo supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:     <genid supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:     <backingStoreInput supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:     <backup supported='yes'/>
Nov 06 13:06:29 user nova-compute[74821]:     <sev supported='no'/>
Nov 06 13:06:29 user nova-compute[74821]:   </features>
Nov 06 13:06:29 user nova-compute[74821]: </domainCapabilities>
Nov 06 13:06:29 user nova-compute[74821]:  {{(pid=74821) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74821) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74821) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74821) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74821) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Checking secure boot support for host arch (x86_64) {{(pid=74821) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 06 13:06:29 user nova-compute[74821]: INFO nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Secure Boot support detected
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] cpu compare xml: <cpu match="exact">
Nov 06 13:06:29 user nova-compute[74821]:   <model>Nehalem</model>
Nov 06 13:06:29 user nova-compute[74821]: </cpu>
Nov 06 13:06:29 user nova-compute[74821]:  {{(pid=74821) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 06 13:06:29 user nova-compute[74821]: INFO nova.virt.node [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Generated node identity a45ec519-15f5-48fe-877b-466db09f8afe
Nov 06 13:06:29 user nova-compute[74821]: INFO nova.virt.node [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Wrote node identity a45ec519-15f5-48fe-877b-466db09f8afe to /opt/stack/data/nova/compute_id
Nov 06 13:06:29 user nova-compute[74821]: WARNING nova.compute.manager [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Compute nodes ['a45ec519-15f5-48fe-877b-466db09f8afe'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 06 13:06:29 user nova-compute[74821]: INFO nova.compute.manager [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 06 13:06:29 user nova-compute[74821]: WARNING nova.compute.manager [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 06 13:06:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:06:29 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:06:29 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Hypervisor/Node resource view: name=user free_ram=11001MB free_disk=26.271747589111328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:06:29 user nova-compute[74821]: WARNING nova.compute.resource_tracker [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] No compute node record for user:a45ec519-15f5-48fe-877b-466db09f8afe: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host a45ec519-15f5-48fe-877b-466db09f8afe could not be found.
Nov 06 13:06:29 user nova-compute[74821]: INFO nova.compute.resource_tracker [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Compute node record created for user:user with uuid: a45ec519-15f5-48fe-877b-466db09f8afe
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:06:29 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] [req-addc4df7-25e2-49bc-b948-a7d1517cfeb7] Created resource provider record via placement API for resource provider with UUID a45ec519-15f5-48fe-877b-466db09f8afe and name user.
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74821) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 06 13:06:29 user nova-compute[74821]: INFO nova.virt.libvirt.host [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] kernel doesn't support AMD SEV
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Updating inventory in ProviderTree for provider a45ec519-15f5-48fe-877b-466db09f8afe with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:06:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Libvirt baseline CPU <cpu>
Nov 06 13:06:29 user nova-compute[74821]:   <arch>x86_64</arch>
Nov 06 13:06:29 user nova-compute[74821]:   <model>Nehalem</model>
Nov 06 13:06:29 user nova-compute[74821]:   <vendor>Intel</vendor>
Nov 06 13:06:29 user nova-compute[74821]:   <topology sockets="6" cores="1" threads="1"/>
Nov 06 13:06:29 user nova-compute[74821]: </cpu>
Nov 06 13:06:29 user nova-compute[74821]:  {{(pid=74821) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 06 13:06:30 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Updated inventory for provider a45ec519-15f5-48fe-877b-466db09f8afe with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 06 13:06:30 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Updating resource provider a45ec519-15f5-48fe-877b-466db09f8afe generation from 0 to 1 during operation: update_inventory {{(pid=74821) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 06 13:06:30 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Updating inventory in ProviderTree for provider a45ec519-15f5-48fe-877b-466db09f8afe with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 13:06:30 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Updating resource provider a45ec519-15f5-48fe-877b-466db09f8afe generation from 1 to 2 during operation: update_traits {{(pid=74821) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 06 13:06:30 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:06:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.623s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:06:30 user nova-compute[74821]: DEBUG nova.service [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Creating RPC server for service compute {{(pid=74821) start /opt/stack/nova/nova/service.py:182}}
Nov 06 13:06:30 user nova-compute[74821]: DEBUG nova.service [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] Join ServiceGroup membership for this service compute {{(pid=74821) start /opt/stack/nova/nova/service.py:199}}
Nov 06 13:06:30 user nova-compute[74821]: DEBUG nova.servicegroup.drivers.db [None req-5070354a-c004-4a00-8049-e96bc9f74cf4 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74821) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 06 13:07:24 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:07:24 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:07:24 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:07:24 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Rebuilding the list of instances to heal {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 13:07:24 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Didn't find any instances for network info cache update. {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 13:07:24 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:07:24 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:07:24 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:07:24 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:07:24 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:07:24 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._sync_power_states {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:07:24 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:07:24 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:07:24 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:07:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:07:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:07:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:07:24 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:07:24 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:07:24 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:07:24 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=10323MB free_disk=26.17551040649414GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:07:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:07:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:07:24 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:07:24 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:07:24 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:07:24 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:07:24 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:07:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:07:24 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:08:21 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:08:21 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:08:21 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:08:21 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:08:21 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Rebuilding the list of instances to heal {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 13:08:21 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Didn't find any instances for network info cache update. {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 13:08:21 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:08:21 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:08:21 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:08:21 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:08:22 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:08:22 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:08:22 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:08:22 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:08:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:08:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:08:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:08:22 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:08:23 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:08:23 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:08:23 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=10352MB free_disk=26.228797912597656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:08:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:08:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:08:23 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:08:23 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:08:23 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:08:23 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:08:23 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:08:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:09:21 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:09:21 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:09:21 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Rebuilding the list of instances to heal {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 13:09:21 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Didn't find any instances for network info cache update. {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 13:09:21 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:09:21 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:09:21 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:09:22 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:09:22 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:09:22 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:09:22 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:09:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:09:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:09:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:09:23 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:09:23 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:09:23 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:09:23 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=10371MB free_disk=25.993289947509766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:09:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:09:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:09:23 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:09:23 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:09:23 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:09:23 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:09:23 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:09:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.129s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:09:24 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:09:24 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:10:21 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:10:21 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:10:21 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Rebuilding the list of instances to heal {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 13:10:21 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Didn't find any instances for network info cache update. {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 13:10:21 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:10:21 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:10:21 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:10:22 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:10:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:22 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:10:23 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:10:23 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:10:23 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=9615MB free_disk=26.020957946777344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:10:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:23 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:10:23 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:10:23 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:10:23 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:10:23 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:10:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.149s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:24 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:10:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "3e21d005-f190-478a-a911-e483e1235057" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "3e21d005-f190-478a-a911-e483e1235057" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:24 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:10:24 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:10:24 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:10:24 user nova-compute[74821]: DEBUG nova.compute.manager [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:10:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:25 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:10:25 user nova-compute[74821]: INFO nova.compute.claims [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Claim successful on node user
Nov 06 13:10:25 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:10:25 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:10:25 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:10:26 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:10:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.335s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:10:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:10:26 user nova-compute[74821]: DEBUG nova.network.neutron [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:10:26 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:10:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:10:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:10:26 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:10:26 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Creating image(s)
Nov 06 13:10:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "/opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "/opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "/opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "311817c5-7b08-4da9-98eb-c685f37e6fd3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "311817c5-7b08-4da9-98eb-c685f37e6fd3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:10:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374.part --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:10:27 user nova-compute[74821]: DEBUG nova.policy [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a0f35998b664c32990f079ca1cd5e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e246e1fd12054401988f9d49f6ad9373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:10:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Acquiring lock "f8c537c6-fa3e-4842-9471-7258a22c01f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Lock "f8c537c6-fa3e-4842-9471-7258a22c01f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:27 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:10:27 user nova-compute[74821]: INFO nova.compute.claims [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Claim successful on node user
Nov 06 13:10:27 user nova-compute[74821]: DEBUG nova.compute.manager [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:10:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374.part --force-share --output=json" returned: 0 in 0.159s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:10:27 user nova-compute[74821]: DEBUG nova.virt.images [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] bbed6343-3ff2-4f28-897a-55ddcbbc8268 was qcow2, converting to raw {{(pid=74821) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 13:10:27 user nova-compute[74821]: DEBUG nova.privsep.utils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74821) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 13:10:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374.part /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374.converted {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:10:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374.part /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374.converted" returned: 0 in 0.252s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:10:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374.converted --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:10:27 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:10:27 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:10:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:27 user nova-compute[74821]: DEBUG nova.compute.manager [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:10:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.271s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:27 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:10:27 user nova-compute[74821]: INFO nova.compute.claims [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Claim successful on node user
Nov 06 13:10:27 user nova-compute[74821]: DEBUG nova.compute.manager [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:10:27 user nova-compute[74821]: DEBUG nova.network.neutron [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:10:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374.converted --force-share --output=json" returned: 0 in 0.249s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:10:27 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:10:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.338s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:27 user nova-compute[74821]: INFO oslo.privsep.daemon [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpvb41sr4h/privsep.sock']
Nov 06 13:10:27 user sudo[84077]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpvb41sr4h/privsep.sock
Nov 06 13:10:27 user sudo[84077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 06 13:10:27 user nova-compute[74821]: DEBUG nova.compute.manager [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:10:28 user nova-compute[74821]: DEBUG nova.compute.manager [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:10:28 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:10:28 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Creating image(s)
Nov 06 13:10:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "/opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "/opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "/opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:28 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:10:28 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:10:28 user nova-compute[74821]: DEBUG nova.policy [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a0f35998b664c32990f079ca1cd5e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e246e1fd12054401988f9d49f6ad9373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:10:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:28 user nova-compute[74821]: DEBUG nova.compute.manager [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:10:28 user nova-compute[74821]: DEBUG nova.compute.manager [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:10:28 user nova-compute[74821]: DEBUG nova.network.neutron [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:10:28 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:10:28 user nova-compute[74821]: DEBUG nova.compute.manager [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:10:28 user nova-compute[74821]: DEBUG nova.policy [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '166c2e871760499ab517261aa874f8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86724840a9ba4cc486fd1d0d0477c778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:10:28 user nova-compute[74821]: DEBUG nova.compute.manager [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:10:28 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:10:28 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Creating image(s)
Nov 06 13:10:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Acquiring lock "/opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Lock "/opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Lock "/opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:29 user sudo[84077]: pam_unix(sudo:session): session closed for user root
Nov 06 13:10:29 user nova-compute[74821]: INFO oslo.privsep.daemon [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Spawned new privsep daemon via rootwrap
Nov 06 13:10:29 user nova-compute[74821]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 06 13:10:29 user nova-compute[74821]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 06 13:10:29 user nova-compute[74821]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 06 13:10:29 user nova-compute[74821]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84080
Nov 06 13:10:29 user nova-compute[74821]: WARNING oslo_privsep.priv_context [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] privsep daemon already running
Nov 06 13:10:29 user nova-compute[74821]: WARNING oslo_privsep.priv_context [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] privsep daemon already running
Nov 06 13:10:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:10:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:10:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:10:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.178s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:10:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:10:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.240s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:10:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.189s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:10:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.177s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG nova.network.neutron [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Successfully created port: 05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG nova.network.neutron [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Successfully created port: 1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk 1073741824" returned: 0 in 0.229s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.410s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.406s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.189s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG nova.network.neutron [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Successfully created port: be99c620-c497-4810-8aac-8793f2b2baa7 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.207s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk 1073741824" returned: 0 in 0.047s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.691s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Cannot resize image /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Ensure instance console log exists: /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.182s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Checking if we can resize image /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.248s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk 1073741824" returned: 0 in 0.044s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Cannot resize image /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Ensure instance console log exists: /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.198s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:10:31 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:10:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:10:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:10:31 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Cannot resize image /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:10:31 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:10:31 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Ensure instance console log exists: /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:10:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:31 user nova-compute[74821]: DEBUG nova.network.neutron [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Successfully updated port: be99c620-c497-4810-8aac-8793f2b2baa7 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:10:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "refresh_cache-311817c5-7b08-4da9-98eb-c685f37e6fd3" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:10:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquired lock "refresh_cache-311817c5-7b08-4da9-98eb-c685f37e6fd3" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:10:31 user nova-compute[74821]: DEBUG nova.network.neutron [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.network.neutron [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.compute.manager [req-600498c4-6321-4d3f-b110-3787d0bf0ead req-76b4d889-62d7-4745-9867-ac9bb9f28479 service nova] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Received event network-changed-be99c620-c497-4810-8aac-8793f2b2baa7 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.compute.manager [req-600498c4-6321-4d3f-b110-3787d0bf0ead req-76b4d889-62d7-4745-9867-ac9bb9f28479 service nova] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Refreshing instance network info cache due to event network-changed-be99c620-c497-4810-8aac-8793f2b2baa7. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-600498c4-6321-4d3f-b110-3787d0bf0ead req-76b4d889-62d7-4745-9867-ac9bb9f28479 service nova] Acquiring lock "refresh_cache-311817c5-7b08-4da9-98eb-c685f37e6fd3" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.network.neutron [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Successfully updated port: 1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "refresh_cache-3e21d005-f190-478a-a911-e483e1235057" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquired lock "refresh_cache-3e21d005-f190-478a-a911-e483e1235057" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.network.neutron [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.network.neutron [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.network.neutron [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Updating instance_info_cache with network_info: [{"id": "be99c620-c497-4810-8aac-8793f2b2baa7", "address": "fa:16:3e:2e:e6:6b", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe99c620-c4", "ovs_interfaceid": "be99c620-c497-4810-8aac-8793f2b2baa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.compute.manager [req-971908df-c469-4075-bfa0-018f23b6d1f8 req-c55b3dd5-172a-47af-87f8-30119d1b1b2c service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] Received event network-changed-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.compute.manager [req-971908df-c469-4075-bfa0-018f23b6d1f8 req-c55b3dd5-172a-47af-87f8-30119d1b1b2c service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] Refreshing instance network info cache due to event network-changed-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-971908df-c469-4075-bfa0-018f23b6d1f8 req-c55b3dd5-172a-47af-87f8-30119d1b1b2c service nova] Acquiring lock "refresh_cache-3e21d005-f190-478a-a911-e483e1235057" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Releasing lock "refresh_cache-311817c5-7b08-4da9-98eb-c685f37e6fd3" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.compute.manager [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Instance network_info: |[{"id": "be99c620-c497-4810-8aac-8793f2b2baa7", "address": "fa:16:3e:2e:e6:6b", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe99c620-c4", "ovs_interfaceid": "be99c620-c497-4810-8aac-8793f2b2baa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-600498c4-6321-4d3f-b110-3787d0bf0ead req-76b4d889-62d7-4745-9867-ac9bb9f28479 service nova] Acquired lock "refresh_cache-311817c5-7b08-4da9-98eb-c685f37e6fd3" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.network.neutron [req-600498c4-6321-4d3f-b110-3787d0bf0ead req-76b4d889-62d7-4745-9867-ac9bb9f28479 service nova] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Refreshing network info cache for port be99c620-c497-4810-8aac-8793f2b2baa7 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Start _get_guest_xml network_info=[{"id": "be99c620-c497-4810-8aac-8793f2b2baa7", "address": "fa:16:3e:2e:e6:6b", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe99c620-c4", "ovs_interfaceid": "be99c620-c497-4810-8aac-8793f2b2baa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:10:32 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:10:32 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.privsep.utils [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74821) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:10:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1158306045',display_name='tempest-ServerRescueNegativeTestJSON-server-1158306045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1158306045',id=2,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e246e1fd12054401988f9d49f6ad9373',ramdisk_id='',reservation_id='r-xaq5aeap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1107947568',owner_user_name='tempest-ServerRescueNegativeTestJSON-1107947568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:10:28Z,user_data=None,user_id='4a0f35998b664c32990f079ca1cd5e6d',uuid=311817c5-7b08-4da9-98eb-c685f37e6fd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be99c620-c497-4810-8aac-8793f2b2baa7", "address": "fa:16:3e:2e:e6:6b", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe99c620-c4", "ovs_interfaceid": "be99c620-c497-4810-8aac-8793f2b2baa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Converting VIF {"id": "be99c620-c497-4810-8aac-8793f2b2baa7", "address": "fa:16:3e:2e:e6:6b", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe99c620-c4", "ovs_interfaceid": "be99c620-c497-4810-8aac-8793f2b2baa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:e6:6b,bridge_name='br-int',has_traffic_filtering=True,id=be99c620-c497-4810-8aac-8793f2b2baa7,network=Network(45ec1f7e-dbfa-4746-8d35-e32f7c938a0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe99c620-c4') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.objects.instance [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lazy-loading 'pci_devices' on Instance uuid 311817c5-7b08-4da9-98eb-c685f37e6fd3 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Acquiring lock "a2b373e1-f872-4263-808c-ce5fbddf907c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Lock "a2b373e1-f872-4263-808c-ce5fbddf907c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:10:32 user nova-compute[74821]:   <uuid>311817c5-7b08-4da9-98eb-c685f37e6fd3</uuid>
Nov 06 13:10:32 user nova-compute[74821]:   <name>instance-00000002</name>
Nov 06 13:10:32 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:10:32 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:10:32 user nova-compute[74821]:   <metadata>
Nov 06 13:10:32 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:10:32 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:10:32 user nova-compute[74821]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1158306045</nova:name>
Nov 06 13:10:32 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:10:32</nova:creationTime>
Nov 06 13:10:32 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:10:32 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:10:32 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:10:32 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:10:32 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:10:32 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:10:32 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:10:32 user nova-compute[74821]:       <nova:owner>
Nov 06 13:10:32 user nova-compute[74821]:         <nova:user uuid="4a0f35998b664c32990f079ca1cd5e6d">tempest-ServerRescueNegativeTestJSON-1107947568-project-member</nova:user>
Nov 06 13:10:32 user nova-compute[74821]:         <nova:project uuid="e246e1fd12054401988f9d49f6ad9373">tempest-ServerRescueNegativeTestJSON-1107947568</nova:project>
Nov 06 13:10:32 user nova-compute[74821]:       </nova:owner>
Nov 06 13:10:32 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:10:32 user nova-compute[74821]:       <nova:ports>
Nov 06 13:10:32 user nova-compute[74821]:         <nova:port uuid="be99c620-c497-4810-8aac-8793f2b2baa7">
Nov 06 13:10:32 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 06 13:10:32 user nova-compute[74821]:         </nova:port>
Nov 06 13:10:32 user nova-compute[74821]:       </nova:ports>
Nov 06 13:10:32 user nova-compute[74821]:     </nova:instance>
Nov 06 13:10:32 user nova-compute[74821]:   </metadata>
Nov 06 13:10:32 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:10:32 user nova-compute[74821]:     <system>
Nov 06 13:10:32 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:10:32 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:10:32 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:10:32 user nova-compute[74821]:       <entry name="serial">311817c5-7b08-4da9-98eb-c685f37e6fd3</entry>
Nov 06 13:10:32 user nova-compute[74821]:       <entry name="uuid">311817c5-7b08-4da9-98eb-c685f37e6fd3</entry>
Nov 06 13:10:32 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:10:32 user nova-compute[74821]:     </system>
Nov 06 13:10:32 user nova-compute[74821]:   </sysinfo>
Nov 06 13:10:32 user nova-compute[74821]:   <os>
Nov 06 13:10:32 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:10:32 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:10:32 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:10:32 user nova-compute[74821]:   </os>
Nov 06 13:10:32 user nova-compute[74821]:   <features>
Nov 06 13:10:32 user nova-compute[74821]:     <acpi/>
Nov 06 13:10:32 user nova-compute[74821]:     <apic/>
Nov 06 13:10:32 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:10:32 user nova-compute[74821]:   </features>
Nov 06 13:10:32 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:10:32 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:10:32 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:10:32 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:10:32 user nova-compute[74821]:   </clock>
Nov 06 13:10:32 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:10:32 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:10:32 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:10:32 user nova-compute[74821]:   </cpu>
Nov 06 13:10:32 user nova-compute[74821]:   <devices>
Nov 06 13:10:32 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:10:32 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:10:32 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk"/>
Nov 06 13:10:32 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:10:32 user nova-compute[74821]:     </disk>
Nov 06 13:10:32 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:10:32 user nova-compute[74821]:       <mac address="fa:16:3e:2e:e6:6b"/>
Nov 06 13:10:32 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:10:32 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:10:32 user nova-compute[74821]:       <target dev="tapbe99c620-c4"/>
Nov 06 13:10:32 user nova-compute[74821]:     </interface>
Nov 06 13:10:32 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:10:32 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/console.log" append="off"/>
Nov 06 13:10:32 user nova-compute[74821]:     </serial>
Nov 06 13:10:32 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:10:32 user nova-compute[74821]:     <video>
Nov 06 13:10:32 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:10:32 user nova-compute[74821]:     </video>
Nov 06 13:10:32 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:10:32 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:10:32 user nova-compute[74821]:     </rng>
Nov 06 13:10:32 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:10:32 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:10:32 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:10:32 user nova-compute[74821]:     </memballoon>
Nov 06 13:10:32 user nova-compute[74821]:   </devices>
Nov 06 13:10:32 user nova-compute[74821]: </domain>
Nov 06 13:10:32 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:10:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1158306045',display_name='tempest-ServerRescueNegativeTestJSON-server-1158306045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1158306045',id=2,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e246e1fd12054401988f9d49f6ad9373',ramdisk_id='',reservation_id='r-xaq5aeap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1107947568',owner_user_name='tempest-ServerRescueNegativeTestJSON-1107947568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:10:28Z,user_data=None,user_id='4a0f35998b664c32990f079ca1cd5e6d',uuid=311817c5-7b08-4da9-98eb-c685f37e6fd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be99c620-c497-4810-8aac-8793f2b2baa7", "address": "fa:16:3e:2e:e6:6b", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe99c620-c4", "ovs_interfaceid": "be99c620-c497-4810-8aac-8793f2b2baa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Converting VIF {"id": "be99c620-c497-4810-8aac-8793f2b2baa7", "address": "fa:16:3e:2e:e6:6b", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe99c620-c4", "ovs_interfaceid": "be99c620-c497-4810-8aac-8793f2b2baa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:e6:6b,bridge_name='br-int',has_traffic_filtering=True,id=be99c620-c497-4810-8aac-8793f2b2baa7,network=Network(45ec1f7e-dbfa-4746-8d35-e32f7c938a0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe99c620-c4') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG os_vif [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:e6:6b,bridge_name='br-int',has_traffic_filtering=True,id=be99c620-c497-4810-8aac-8793f2b2baa7,network=Network(45ec1f7e-dbfa-4746-8d35-e32f7c938a0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe99c620-c4') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG nova.compute.manager [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Created schema index Interface.name {{(pid=74821) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Created schema index Port.name {{(pid=74821) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Created schema index Bridge.name {{(pid=74821) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [POLLOUT] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '853f385a-236f-57ac-ba2a-95beb89f43a5', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:10:33 user nova-compute[74821]: INFO oslo.privsep.daemon [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp3lrutfw5/privsep.sock']
Nov 06 13:10:33 user sudo[84136]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp3lrutfw5/privsep.sock
Nov 06 13:10:33 user sudo[84136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 06 13:10:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:10:33 user nova-compute[74821]: INFO nova.compute.claims [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Claim successful on node user
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.409s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.compute.manager [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.compute.manager [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.network.neutron [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:10:33 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.compute.manager [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.network.neutron [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Updating instance_info_cache with network_info: [{"id": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "address": "fa:16:3e:e0:fc:40", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6fb684-24", "ovs_interfaceid": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Releasing lock "refresh_cache-3e21d005-f190-478a-a911-e483e1235057" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.compute.manager [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Instance network_info: |[{"id": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "address": "fa:16:3e:e0:fc:40", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6fb684-24", "ovs_interfaceid": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-971908df-c469-4075-bfa0-018f23b6d1f8 req-c55b3dd5-172a-47af-87f8-30119d1b1b2c service nova] Acquired lock "refresh_cache-3e21d005-f190-478a-a911-e483e1235057" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.network.neutron [req-971908df-c469-4075-bfa0-018f23b6d1f8 req-c55b3dd5-172a-47af-87f8-30119d1b1b2c service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] Refreshing network info cache for port 1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Start _get_guest_xml network_info=[{"id": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "address": "fa:16:3e:e0:fc:40", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6fb684-24", "ovs_interfaceid": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:10:33 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:10:33 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.policy [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'de7b96cf6d1643b18d7619f9f4076ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed493ef8770740f4a63b0baa352933a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1653169687',display_name='tempest-ServerRescueNegativeTestJSON-server-1653169687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1653169687',id=1,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e246e1fd12054401988f9d49f6ad9373',ramdisk_id='',reservation_id='r-zs0g66cj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1107947568',owner_user_name='tempest-ServerRescueNegativeTestJSON-1107947568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:10:26Z,user_data=None,user_id='4a0f35998b664c32990f079ca1cd5e6d',uuid=3e21d005-f190-478a-a911-e483e1235057,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "address": "fa:16:3e:e0:fc:40", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6fb684-24", "ovs_interfaceid": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Converting VIF {"id": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "address": "fa:16:3e:e0:fc:40", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6fb684-24", "ovs_interfaceid": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:fc:40,bridge_name='br-int',has_traffic_filtering=True,id=1f6fb684-24b2-4edc-a5c7-e5097ef2fb16,network=Network(45ec1f7e-dbfa-4746-8d35-e32f7c938a0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6fb684-24') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.objects.instance [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e21d005-f190-478a-a911-e483e1235057 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.compute.manager [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:10:33 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Creating image(s)
Nov 06 13:10:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Acquiring lock "/opt/stack/data/nova/instances/a2b373e1-f872-4263-808c-ce5fbddf907c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Lock "/opt/stack/data/nova/instances/a2b373e1-f872-4263-808c-ce5fbddf907c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Lock "/opt/stack/data/nova/instances/a2b373e1-f872-4263-808c-ce5fbddf907c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.network.neutron [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Successfully updated port: 05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:10:33 user nova-compute[74821]:   <uuid>3e21d005-f190-478a-a911-e483e1235057</uuid>
Nov 06 13:10:33 user nova-compute[74821]:   <name>instance-00000001</name>
Nov 06 13:10:33 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:10:33 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:10:33 user nova-compute[74821]:   <metadata>
Nov 06 13:10:33 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:10:33 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:10:33 user nova-compute[74821]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1653169687</nova:name>
Nov 06 13:10:33 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:10:33</nova:creationTime>
Nov 06 13:10:33 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:10:33 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:10:33 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:10:33 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:10:33 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:10:33 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:10:33 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:10:33 user nova-compute[74821]:       <nova:owner>
Nov 06 13:10:33 user nova-compute[74821]:         <nova:user uuid="4a0f35998b664c32990f079ca1cd5e6d">tempest-ServerRescueNegativeTestJSON-1107947568-project-member</nova:user>
Nov 06 13:10:33 user nova-compute[74821]:         <nova:project uuid="e246e1fd12054401988f9d49f6ad9373">tempest-ServerRescueNegativeTestJSON-1107947568</nova:project>
Nov 06 13:10:33 user nova-compute[74821]:       </nova:owner>
Nov 06 13:10:33 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:10:33 user nova-compute[74821]:       <nova:ports>
Nov 06 13:10:33 user nova-compute[74821]:         <nova:port uuid="1f6fb684-24b2-4edc-a5c7-e5097ef2fb16">
Nov 06 13:10:33 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 13:10:33 user nova-compute[74821]:         </nova:port>
Nov 06 13:10:33 user nova-compute[74821]:       </nova:ports>
Nov 06 13:10:33 user nova-compute[74821]:     </nova:instance>
Nov 06 13:10:33 user nova-compute[74821]:   </metadata>
Nov 06 13:10:33 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:10:33 user nova-compute[74821]:     <system>
Nov 06 13:10:33 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:10:33 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:10:33 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:10:33 user nova-compute[74821]:       <entry name="serial">3e21d005-f190-478a-a911-e483e1235057</entry>
Nov 06 13:10:33 user nova-compute[74821]:       <entry name="uuid">3e21d005-f190-478a-a911-e483e1235057</entry>
Nov 06 13:10:33 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:10:33 user nova-compute[74821]:     </system>
Nov 06 13:10:33 user nova-compute[74821]:   </sysinfo>
Nov 06 13:10:33 user nova-compute[74821]:   <os>
Nov 06 13:10:33 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:10:33 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:10:33 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:10:33 user nova-compute[74821]:   </os>
Nov 06 13:10:33 user nova-compute[74821]:   <features>
Nov 06 13:10:33 user nova-compute[74821]:     <acpi/>
Nov 06 13:10:33 user nova-compute[74821]:     <apic/>
Nov 06 13:10:33 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:10:33 user nova-compute[74821]:   </features>
Nov 06 13:10:33 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:10:33 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:10:33 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:10:33 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:10:33 user nova-compute[74821]:   </clock>
Nov 06 13:10:33 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:10:33 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:10:33 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:10:33 user nova-compute[74821]:   </cpu>
Nov 06 13:10:33 user nova-compute[74821]:   <devices>
Nov 06 13:10:33 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:10:33 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:10:33 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk"/>
Nov 06 13:10:33 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:10:33 user nova-compute[74821]:     </disk>
Nov 06 13:10:33 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:10:33 user nova-compute[74821]:       <mac address="fa:16:3e:e0:fc:40"/>
Nov 06 13:10:33 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:10:33 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:10:33 user nova-compute[74821]:       <target dev="tap1f6fb684-24"/>
Nov 06 13:10:33 user nova-compute[74821]:     </interface>
Nov 06 13:10:33 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:10:33 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/console.log" append="off"/>
Nov 06 13:10:33 user nova-compute[74821]:     </serial>
Nov 06 13:10:33 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:10:33 user nova-compute[74821]:     <video>
Nov 06 13:10:33 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:10:33 user nova-compute[74821]:     </video>
Nov 06 13:10:33 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:10:33 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:10:33 user nova-compute[74821]:     </rng>
Nov 06 13:10:33 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:10:33 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:10:33 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:10:33 user nova-compute[74821]:     </memballoon>
Nov 06 13:10:33 user nova-compute[74821]:   </devices>
Nov 06 13:10:33 user nova-compute[74821]: </domain>
Nov 06 13:10:33 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1653169687',display_name='tempest-ServerRescueNegativeTestJSON-server-1653169687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1653169687',id=1,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e246e1fd12054401988f9d49f6ad9373',ramdisk_id='',reservation_id='r-zs0g66cj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1107947568',owner_user_name='tempest-ServerRescueNegativeTestJSON-1107947568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:10:26Z,user_data=None,user_id='4a0f35998b664c32990f079ca1cd5e6d',uuid=3e21d005-f190-478a-a911-e483e1235057,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "address": "fa:16:3e:e0:fc:40", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6fb684-24", "ovs_interfaceid": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Converting VIF {"id": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "address": "fa:16:3e:e0:fc:40", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6fb684-24", "ovs_interfaceid": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:fc:40,bridge_name='br-int',has_traffic_filtering=True,id=1f6fb684-24b2-4edc-a5c7-e5097ef2fb16,network=Network(45ec1f7e-dbfa-4746-8d35-e32f7c938a0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6fb684-24') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG os_vif [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:fc:40,bridge_name='br-int',has_traffic_filtering=True,id=1f6fb684-24b2-4edc-a5c7-e5097ef2fb16,network=Network(45ec1f7e-dbfa-4746-8d35-e32f7c938a0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6fb684-24') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Acquiring lock "refresh_cache-f8c537c6-fa3e-4842-9471-7258a22c01f9" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Acquired lock "refresh_cache-f8c537c6-fa3e-4842-9471-7258a22c01f9" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG nova.network.neutron [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '345de5e7-8e94-5ac4-ab0a-c27620ed75df', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.183s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:10:34 user nova-compute[74821]: DEBUG nova.network.neutron [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:10:34 user nova-compute[74821]: DEBUG nova.network.neutron [req-600498c4-6321-4d3f-b110-3787d0bf0ead req-76b4d889-62d7-4745-9867-ac9bb9f28479 service nova] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Updated VIF entry in instance network info cache for port be99c620-c497-4810-8aac-8793f2b2baa7. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:10:34 user nova-compute[74821]: DEBUG nova.network.neutron [req-600498c4-6321-4d3f-b110-3787d0bf0ead req-76b4d889-62d7-4745-9867-ac9bb9f28479 service nova] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Updating instance_info_cache with network_info: [{"id": "be99c620-c497-4810-8aac-8793f2b2baa7", "address": "fa:16:3e:2e:e6:6b", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe99c620-c4", "ovs_interfaceid": "be99c620-c497-4810-8aac-8793f2b2baa7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:10:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-600498c4-6321-4d3f-b110-3787d0bf0ead req-76b4d889-62d7-4745-9867-ac9bb9f28479 service nova] Releasing lock "refresh_cache-311817c5-7b08-4da9-98eb-c685f37e6fd3" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:10:34 user nova-compute[74821]: DEBUG nova.compute.manager [req-4cf41a9a-0ea8-440b-a91a-086683787697 req-3cb29abc-a217-4104-904d-48245f4dd29a service nova] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Received event network-changed-05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:10:34 user nova-compute[74821]: DEBUG nova.compute.manager [req-4cf41a9a-0ea8-440b-a91a-086683787697 req-3cb29abc-a217-4104-904d-48245f4dd29a service nova] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Refreshing instance network info cache due to event network-changed-05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:10:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4cf41a9a-0ea8-440b-a91a-086683787697 req-3cb29abc-a217-4104-904d-48245f4dd29a service nova] Acquiring lock "refresh_cache-f8c537c6-fa3e-4842-9471-7258a22c01f9" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:10:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.209s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:10:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/a2b373e1-f872-4263-808c-ce5fbddf907c/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:10:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/a2b373e1-f872-4263-808c-ce5fbddf907c/disk 1073741824" returned: 0 in 0.074s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:10:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:10:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.183s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:10:34 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a2b373e1-f872-4263-808c-ce5fbddf907c/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:10:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b373e1-f872-4263-808c-ce5fbddf907c/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:10:34 user sudo[84136]: pam_unix(sudo:session): session closed for user root
Nov 06 13:10:34 user nova-compute[74821]: INFO oslo.privsep.daemon [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Spawned new privsep daemon via rootwrap
Nov 06 13:10:34 user nova-compute[74821]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 06 13:10:34 user nova-compute[74821]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 06 13:10:34 user nova-compute[74821]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 06 13:10:34 user nova-compute[74821]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84171
Nov 06 13:10:34 user nova-compute[74821]: WARNING oslo_privsep.priv_context [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] privsep daemon already running
Nov 06 13:10:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b373e1-f872-4263-808c-ce5fbddf907c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:10:34 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Cannot resize image /opt/stack/data/nova/instances/a2b373e1-f872-4263-808c-ce5fbddf907c/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:10:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:10:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Ensure instance console log exists: /opt/stack/data/nova/instances/a2b373e1-f872-4263-808c-ce5fbddf907c/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:10:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.network.neutron [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Updating instance_info_cache with network_info: [{"id": "05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b", "address": "fa:16:3e:83:64:35", "network": {"id": "d5bae261-3db3-492a-a55e-df6c0fd01fe1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-60002553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86724840a9ba4cc486fd1d0d0477c778", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05f5a65e-3f", "ovs_interfaceid": "05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.network.neutron [req-971908df-c469-4075-bfa0-018f23b6d1f8 req-c55b3dd5-172a-47af-87f8-30119d1b1b2c service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] Updated VIF entry in instance network info cache for port 1f6fb684-24b2-4edc-a5c7-e5097ef2fb16. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.network.neutron [req-971908df-c469-4075-bfa0-018f23b6d1f8 req-c55b3dd5-172a-47af-87f8-30119d1b1b2c service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] Updating instance_info_cache with network_info: [{"id": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "address": "fa:16:3e:e0:fc:40", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6fb684-24", "ovs_interfaceid": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Releasing lock "refresh_cache-f8c537c6-fa3e-4842-9471-7258a22c01f9" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.compute.manager [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Instance network_info: |[{"id": "05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b", "address": "fa:16:3e:83:64:35", "network": {"id": "d5bae261-3db3-492a-a55e-df6c0fd01fe1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-60002553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86724840a9ba4cc486fd1d0d0477c778", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05f5a65e-3f", "ovs_interfaceid": "05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-971908df-c469-4075-bfa0-018f23b6d1f8 req-c55b3dd5-172a-47af-87f8-30119d1b1b2c service nova] Releasing lock "refresh_cache-3e21d005-f190-478a-a911-e483e1235057" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4cf41a9a-0ea8-440b-a91a-086683787697 req-3cb29abc-a217-4104-904d-48245f4dd29a service nova] Acquired lock "refresh_cache-f8c537c6-fa3e-4842-9471-7258a22c01f9" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.network.neutron [req-4cf41a9a-0ea8-440b-a91a-086683787697 req-3cb29abc-a217-4104-904d-48245f4dd29a service nova] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Refreshing network info cache for port 05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Start _get_guest_xml network_info=[{"id": "05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b", "address": "fa:16:3e:83:64:35", "network": {"id": "d5bae261-3db3-492a-a55e-df6c0fd01fe1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-60002553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86724840a9ba4cc486fd1d0d0477c778", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05f5a65e-3f", "ovs_interfaceid": "05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:10:35 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:10:35 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:10:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2113043381',display_name='tempest-ServersNegativeTestJSON-server-2113043381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2113043381',id=3,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86724840a9ba4cc486fd1d0d0477c778',ramdisk_id='',reservation_id='r-ur2yz6ar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-835160312',owner_user_name='tempest-ServersNegativeTestJSON-835160312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:10:28Z,user_data=None,user_id='166c2e871760499ab517261aa874f8da',uuid=f8c537c6-fa3e-4842-9471-7258a22c01f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b", "address": "fa:16:3e:83:64:35", "network": {"id": "d5bae261-3db3-492a-a55e-df6c0fd01fe1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-60002553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86724840a9ba4cc486fd1d0d0477c778", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05f5a65e-3f", "ovs_interfaceid": "05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Converting VIF {"id": "05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b", "address": "fa:16:3e:83:64:35", "network": {"id": "d5bae261-3db3-492a-a55e-df6c0fd01fe1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-60002553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86724840a9ba4cc486fd1d0d0477c778", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05f5a65e-3f", "ovs_interfaceid": "05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:64:35,bridge_name='br-int',has_traffic_filtering=True,id=05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b,network=Network(d5bae261-3db3-492a-a55e-df6c0fd01fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05f5a65e-3f') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.objects.instance [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Lazy-loading 'pci_devices' on Instance uuid f8c537c6-fa3e-4842-9471-7258a22c01f9 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe99c620-c4, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbe99c620-c4, col_values=(('qos', UUID('b0e9ac8e-9625-4a3a-b503-a657046f6697')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbe99c620-c4, col_values=(('external_ids', {'iface-id': 'be99c620-c497-4810-8aac-8793f2b2baa7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:e6:6b', 'vm-uuid': '311817c5-7b08-4da9-98eb-c685f37e6fd3'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:10:35 user nova-compute[74821]:   <uuid>f8c537c6-fa3e-4842-9471-7258a22c01f9</uuid>
Nov 06 13:10:35 user nova-compute[74821]:   <name>instance-00000003</name>
Nov 06 13:10:35 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:10:35 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:10:35 user nova-compute[74821]:   <metadata>
Nov 06 13:10:35 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:10:35 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:10:35 user nova-compute[74821]:       <nova:name>tempest-ServersNegativeTestJSON-server-2113043381</nova:name>
Nov 06 13:10:35 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:10:35</nova:creationTime>
Nov 06 13:10:35 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:10:35 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:10:35 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:10:35 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:10:35 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:10:35 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:10:35 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:10:35 user nova-compute[74821]:       <nova:owner>
Nov 06 13:10:35 user nova-compute[74821]:         <nova:user uuid="166c2e871760499ab517261aa874f8da">tempest-ServersNegativeTestJSON-835160312-project-member</nova:user>
Nov 06 13:10:35 user nova-compute[74821]:         <nova:project uuid="86724840a9ba4cc486fd1d0d0477c778">tempest-ServersNegativeTestJSON-835160312</nova:project>
Nov 06 13:10:35 user nova-compute[74821]:       </nova:owner>
Nov 06 13:10:35 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:10:35 user nova-compute[74821]:       <nova:ports>
Nov 06 13:10:35 user nova-compute[74821]:         <nova:port uuid="05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b">
Nov 06 13:10:35 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 13:10:35 user nova-compute[74821]:         </nova:port>
Nov 06 13:10:35 user nova-compute[74821]:       </nova:ports>
Nov 06 13:10:35 user nova-compute[74821]:     </nova:instance>
Nov 06 13:10:35 user nova-compute[74821]:   </metadata>
Nov 06 13:10:35 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:10:35 user nova-compute[74821]:     <system>
Nov 06 13:10:35 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:10:35 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:10:35 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:10:35 user nova-compute[74821]:       <entry name="serial">f8c537c6-fa3e-4842-9471-7258a22c01f9</entry>
Nov 06 13:10:35 user nova-compute[74821]:       <entry name="uuid">f8c537c6-fa3e-4842-9471-7258a22c01f9</entry>
Nov 06 13:10:35 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:10:35 user nova-compute[74821]:     </system>
Nov 06 13:10:35 user nova-compute[74821]:   </sysinfo>
Nov 06 13:10:35 user nova-compute[74821]:   <os>
Nov 06 13:10:35 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:10:35 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:10:35 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:10:35 user nova-compute[74821]:   </os>
Nov 06 13:10:35 user nova-compute[74821]:   <features>
Nov 06 13:10:35 user nova-compute[74821]:     <acpi/>
Nov 06 13:10:35 user nova-compute[74821]:     <apic/>
Nov 06 13:10:35 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:10:35 user nova-compute[74821]:   </features>
Nov 06 13:10:35 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:10:35 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:10:35 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:10:35 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:10:35 user nova-compute[74821]:   </clock>
Nov 06 13:10:35 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:10:35 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:10:35 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:10:35 user nova-compute[74821]:   </cpu>
Nov 06 13:10:35 user nova-compute[74821]:   <devices>
Nov 06 13:10:35 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:10:35 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:10:35 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk"/>
Nov 06 13:10:35 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:10:35 user nova-compute[74821]:     </disk>
Nov 06 13:10:35 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:10:35 user nova-compute[74821]:       <mac address="fa:16:3e:83:64:35"/>
Nov 06 13:10:35 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:10:35 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:10:35 user nova-compute[74821]:       <target dev="tap05f5a65e-3f"/>
Nov 06 13:10:35 user nova-compute[74821]:     </interface>
Nov 06 13:10:35 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:10:35 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/console.log" append="off"/>
Nov 06 13:10:35 user nova-compute[74821]:     </serial>
Nov 06 13:10:35 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:10:35 user nova-compute[74821]:     <video>
Nov 06 13:10:35 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:10:35 user nova-compute[74821]:     </video>
Nov 06 13:10:35 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:10:35 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:10:35 user nova-compute[74821]:     </rng>
Nov 06 13:10:35 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:10:35 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:10:35 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:10:35 user nova-compute[74821]:     </memballoon>
Nov 06 13:10:35 user nova-compute[74821]:   </devices>
Nov 06 13:10:35 user nova-compute[74821]: </domain>
Nov 06 13:10:35 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:10:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2113043381',display_name='tempest-ServersNegativeTestJSON-server-2113043381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2113043381',id=3,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86724840a9ba4cc486fd1d0d0477c778',ramdisk_id='',reservation_id='r-ur2yz6ar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-835160312',owner_user_name='tempest-ServersNegativeTestJSON-835160312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:10:28Z,user_data=None,user_id='166c2e871760499ab517261aa874f8da',uuid=f8c537c6-fa3e-4842-9471-7258a22c01f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b", "address": "fa:16:3e:83:64:35", "network": {"id": "d5bae261-3db3-492a-a55e-df6c0fd01fe1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-60002553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86724840a9ba4cc486fd1d0d0477c778", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05f5a65e-3f", "ovs_interfaceid": "05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Converting VIF {"id": "05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b", "address": "fa:16:3e:83:64:35", "network": {"id": "d5bae261-3db3-492a-a55e-df6c0fd01fe1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-60002553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86724840a9ba4cc486fd1d0d0477c778", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05f5a65e-3f", "ovs_interfaceid": "05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:64:35,bridge_name='br-int',has_traffic_filtering=True,id=05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b,network=Network(d5bae261-3db3-492a-a55e-df6c0fd01fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05f5a65e-3f') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG os_vif [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:64:35,bridge_name='br-int',has_traffic_filtering=True,id=05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b,network=Network(d5bae261-3db3-492a-a55e-df6c0fd01fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05f5a65e-3f') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:35 user nova-compute[74821]: INFO os_vif [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:e6:6b,bridge_name='br-int',has_traffic_filtering=True,id=be99c620-c497-4810-8aac-8793f2b2baa7,network=Network(45ec1f7e-dbfa-4746-8d35-e32f7c938a0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe99c620-c4')
Nov 06 13:10:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f6fb684-24, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f6fb684-24, col_values=(('qos', UUID('12f1dd44-fab7-4955-a6d5-e076145f9f17')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f6fb684-24, col_values=(('external_ids', {'iface-id': '1f6fb684-24b2-4edc-a5c7-e5097ef2fb16', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:fc:40', 'vm-uuid': '3e21d005-f190-478a-a911-e483e1235057'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:35 user nova-compute[74821]: INFO os_vif [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:fc:40,bridge_name='br-int',has_traffic_filtering=True,id=1f6fb684-24b2-4edc-a5c7-e5097ef2fb16,network=Network(45ec1f7e-dbfa-4746-8d35-e32f7c938a0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6fb684-24')
Nov 06 13:10:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e9fb3292-33f5-5a00-b9ab-7ba63d7780b0', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05f5a65e-3f, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap05f5a65e-3f, col_values=(('qos', UUID('e04782e1-4fde-4879-abce-8072094714c6')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap05f5a65e-3f, col_values=(('external_ids', {'iface-id': '05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:64:35', 'vm-uuid': 'f8c537c6-fa3e-4842-9471-7258a22c01f9'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] No VIF found with MAC fa:16:3e:e0:fc:40, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:35 user nova-compute[74821]: INFO os_vif [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:64:35,bridge_name='br-int',has_traffic_filtering=True,id=05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b,network=Network(d5bae261-3db3-492a-a55e-df6c0fd01fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05f5a65e-3f')
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] No VIF found with MAC fa:16:3e:2e:e6:6b, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] No VIF found with MAC fa:16:3e:83:64:35, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:10:35 user nova-compute[74821]: DEBUG nova.network.neutron [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Successfully created port: 1f3e50b9-2015-4c0b-adbd-fb91bf9d7753 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:10:36 user nova-compute[74821]: DEBUG nova.network.neutron [req-4cf41a9a-0ea8-440b-a91a-086683787697 req-3cb29abc-a217-4104-904d-48245f4dd29a service nova] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Updated VIF entry in instance network info cache for port 05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:10:36 user nova-compute[74821]: DEBUG nova.network.neutron [req-4cf41a9a-0ea8-440b-a91a-086683787697 req-3cb29abc-a217-4104-904d-48245f4dd29a service nova] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Updating instance_info_cache with network_info: [{"id": "05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b", "address": "fa:16:3e:83:64:35", "network": {"id": "d5bae261-3db3-492a-a55e-df6c0fd01fe1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-60002553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86724840a9ba4cc486fd1d0d0477c778", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05f5a65e-3f", "ovs_interfaceid": "05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:10:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4cf41a9a-0ea8-440b-a91a-086683787697 req-3cb29abc-a217-4104-904d-48245f4dd29a service nova] Releasing lock "refresh_cache-f8c537c6-fa3e-4842-9471-7258a22c01f9" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.network.neutron [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Successfully updated port: 1f3e50b9-2015-4c0b-adbd-fb91bf9d7753 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Acquiring lock "refresh_cache-a2b373e1-f872-4263-808c-ce5fbddf907c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Acquired lock "refresh_cache-a2b373e1-f872-4263-808c-ce5fbddf907c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.network.neutron [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "5a715806-ff8b-4502-8435-c5de3e3c688a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "5a715806-ff8b-4502-8435-c5de3e3c688a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.compute.manager [req-bc5e12f7-07ec-4e14-b6e3-9de977894721 req-39e7bb94-b04e-4d61-8d00-b30bba9a9aba service nova] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Received event network-changed-1f3e50b9-2015-4c0b-adbd-fb91bf9d7753 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.compute.manager [req-bc5e12f7-07ec-4e14-b6e3-9de977894721 req-39e7bb94-b04e-4d61-8d00-b30bba9a9aba service nova] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Refreshing instance network info cache due to event network-changed-1f3e50b9-2015-4c0b-adbd-fb91bf9d7753. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-bc5e12f7-07ec-4e14-b6e3-9de977894721 req-39e7bb94-b04e-4d61-8d00-b30bba9a9aba service nova] Acquiring lock "refresh_cache-a2b373e1-f872-4263-808c-ce5fbddf907c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.compute.manager [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.network.neutron [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:10:37 user nova-compute[74821]: INFO nova.compute.claims [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Claim successful on node user
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.network.neutron [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Updating instance_info_cache with network_info: [{"id": "1f3e50b9-2015-4c0b-adbd-fb91bf9d7753", "address": "fa:16:3e:fd:26:b6", "network": {"id": "323a6441-34e6-41af-a08c-908482497062", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-438888055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed493ef8770740f4a63b0baa352933a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f3e50b9-20", "ovs_interfaceid": "1f3e50b9-2015-4c0b-adbd-fb91bf9d7753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Releasing lock "refresh_cache-a2b373e1-f872-4263-808c-ce5fbddf907c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.compute.manager [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Instance network_info: |[{"id": "1f3e50b9-2015-4c0b-adbd-fb91bf9d7753", "address": "fa:16:3e:fd:26:b6", "network": {"id": "323a6441-34e6-41af-a08c-908482497062", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-438888055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed493ef8770740f4a63b0baa352933a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f3e50b9-20", "ovs_interfaceid": "1f3e50b9-2015-4c0b-adbd-fb91bf9d7753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-bc5e12f7-07ec-4e14-b6e3-9de977894721 req-39e7bb94-b04e-4d61-8d00-b30bba9a9aba service nova] Acquired lock "refresh_cache-a2b373e1-f872-4263-808c-ce5fbddf907c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.network.neutron [req-bc5e12f7-07ec-4e14-b6e3-9de977894721 req-39e7bb94-b04e-4d61-8d00-b30bba9a9aba service nova] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Refreshing network info cache for port 1f3e50b9-2015-4c0b-adbd-fb91bf9d7753 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Start _get_guest_xml network_info=[{"id": "1f3e50b9-2015-4c0b-adbd-fb91bf9d7753", "address": "fa:16:3e:fd:26:b6", "network": {"id": "323a6441-34e6-41af-a08c-908482497062", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-438888055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed493ef8770740f4a63b0baa352933a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f3e50b9-20", "ovs_interfaceid": "1f3e50b9-2015-4c0b-adbd-fb91bf9d7753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:10:37 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:10:37 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:10:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-63912502',display_name='tempest-DeleteServersTestJSON-server-63912502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-63912502',id=4,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed493ef8770740f4a63b0baa352933a2',ramdisk_id='',reservation_id='r-wb0jszyw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1732675514',owner_user_name='tempest-DeleteServersTestJSON-1732675514-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:10:34Z,user_data=None,user_id='de7b96cf6d1643b18d7619f9f4076ccf',uuid=a2b373e1-f872-4263-808c-ce5fbddf907c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f3e50b9-2015-4c0b-adbd-fb91bf9d7753", "address": "fa:16:3e:fd:26:b6", "network": {"id": "323a6441-34e6-41af-a08c-908482497062", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-438888055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed493ef8770740f4a63b0baa352933a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f3e50b9-20", "ovs_interfaceid": "1f3e50b9-2015-4c0b-adbd-fb91bf9d7753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Converting VIF {"id": "1f3e50b9-2015-4c0b-adbd-fb91bf9d7753", "address": "fa:16:3e:fd:26:b6", "network": {"id": "323a6441-34e6-41af-a08c-908482497062", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-438888055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed493ef8770740f4a63b0baa352933a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f3e50b9-20", "ovs_interfaceid": "1f3e50b9-2015-4c0b-adbd-fb91bf9d7753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:26:b6,bridge_name='br-int',has_traffic_filtering=True,id=1f3e50b9-2015-4c0b-adbd-fb91bf9d7753,network=Network(323a6441-34e6-41af-a08c-908482497062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f3e50b9-20') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.objects.instance [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Lazy-loading 'pci_devices' on Instance uuid a2b373e1-f872-4263-808c-ce5fbddf907c {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:10:37 user nova-compute[74821]:   <uuid>a2b373e1-f872-4263-808c-ce5fbddf907c</uuid>
Nov 06 13:10:37 user nova-compute[74821]:   <name>instance-00000004</name>
Nov 06 13:10:37 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:10:37 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:10:37 user nova-compute[74821]:   <metadata>
Nov 06 13:10:37 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:10:37 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:10:37 user nova-compute[74821]:       <nova:name>tempest-DeleteServersTestJSON-server-63912502</nova:name>
Nov 06 13:10:37 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:10:37</nova:creationTime>
Nov 06 13:10:37 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:10:37 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:10:37 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:10:37 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:10:37 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:10:37 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:10:37 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:10:37 user nova-compute[74821]:       <nova:owner>
Nov 06 13:10:37 user nova-compute[74821]:         <nova:user uuid="de7b96cf6d1643b18d7619f9f4076ccf">tempest-DeleteServersTestJSON-1732675514-project-member</nova:user>
Nov 06 13:10:37 user nova-compute[74821]:         <nova:project uuid="ed493ef8770740f4a63b0baa352933a2">tempest-DeleteServersTestJSON-1732675514</nova:project>
Nov 06 13:10:37 user nova-compute[74821]:       </nova:owner>
Nov 06 13:10:37 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:10:37 user nova-compute[74821]:       <nova:ports>
Nov 06 13:10:37 user nova-compute[74821]:         <nova:port uuid="1f3e50b9-2015-4c0b-adbd-fb91bf9d7753">
Nov 06 13:10:37 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 13:10:37 user nova-compute[74821]:         </nova:port>
Nov 06 13:10:37 user nova-compute[74821]:       </nova:ports>
Nov 06 13:10:37 user nova-compute[74821]:     </nova:instance>
Nov 06 13:10:37 user nova-compute[74821]:   </metadata>
Nov 06 13:10:37 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:10:37 user nova-compute[74821]:     <system>
Nov 06 13:10:37 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:10:37 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:10:37 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:10:37 user nova-compute[74821]:       <entry name="serial">a2b373e1-f872-4263-808c-ce5fbddf907c</entry>
Nov 06 13:10:37 user nova-compute[74821]:       <entry name="uuid">a2b373e1-f872-4263-808c-ce5fbddf907c</entry>
Nov 06 13:10:37 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:10:37 user nova-compute[74821]:     </system>
Nov 06 13:10:37 user nova-compute[74821]:   </sysinfo>
Nov 06 13:10:37 user nova-compute[74821]:   <os>
Nov 06 13:10:37 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:10:37 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:10:37 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:10:37 user nova-compute[74821]:   </os>
Nov 06 13:10:37 user nova-compute[74821]:   <features>
Nov 06 13:10:37 user nova-compute[74821]:     <acpi/>
Nov 06 13:10:37 user nova-compute[74821]:     <apic/>
Nov 06 13:10:37 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:10:37 user nova-compute[74821]:   </features>
Nov 06 13:10:37 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:10:37 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:10:37 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:10:37 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:10:37 user nova-compute[74821]:   </clock>
Nov 06 13:10:37 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:10:37 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:10:37 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:10:37 user nova-compute[74821]:   </cpu>
Nov 06 13:10:37 user nova-compute[74821]:   <devices>
Nov 06 13:10:37 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:10:37 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:10:37 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/a2b373e1-f872-4263-808c-ce5fbddf907c/disk"/>
Nov 06 13:10:37 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:10:37 user nova-compute[74821]:     </disk>
Nov 06 13:10:37 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:10:37 user nova-compute[74821]:       <mac address="fa:16:3e:fd:26:b6"/>
Nov 06 13:10:37 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:10:37 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:10:37 user nova-compute[74821]:       <target dev="tap1f3e50b9-20"/>
Nov 06 13:10:37 user nova-compute[74821]:     </interface>
Nov 06 13:10:37 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:10:37 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/a2b373e1-f872-4263-808c-ce5fbddf907c/console.log" append="off"/>
Nov 06 13:10:37 user nova-compute[74821]:     </serial>
Nov 06 13:10:37 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:10:37 user nova-compute[74821]:     <video>
Nov 06 13:10:37 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:10:37 user nova-compute[74821]:     </video>
Nov 06 13:10:37 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:10:37 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:10:37 user nova-compute[74821]:     </rng>
Nov 06 13:10:37 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:10:37 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:10:37 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:10:37 user nova-compute[74821]:     </memballoon>
Nov 06 13:10:37 user nova-compute[74821]:   </devices>
Nov 06 13:10:37 user nova-compute[74821]: </domain>
Nov 06 13:10:37 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:10:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-63912502',display_name='tempest-DeleteServersTestJSON-server-63912502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-63912502',id=4,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed493ef8770740f4a63b0baa352933a2',ramdisk_id='',reservation_id='r-wb0jszyw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1732675514',owner_user_name='tempest-DeleteServersTestJSON-1732675514-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:10:34Z,user_data=None,user_id='de7b96cf6d1643b18d7619f9f4076ccf',uuid=a2b373e1-f872-4263-808c-ce5fbddf907c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f3e50b9-2015-4c0b-adbd-fb91bf9d7753", "address": "fa:16:3e:fd:26:b6", "network": {"id": "323a6441-34e6-41af-a08c-908482497062", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-438888055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed493ef8770740f4a63b0baa352933a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f3e50b9-20", "ovs_interfaceid": "1f3e50b9-2015-4c0b-adbd-fb91bf9d7753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Converting VIF {"id": "1f3e50b9-2015-4c0b-adbd-fb91bf9d7753", "address": "fa:16:3e:fd:26:b6", "network": {"id": "323a6441-34e6-41af-a08c-908482497062", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-438888055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed493ef8770740f4a63b0baa352933a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f3e50b9-20", "ovs_interfaceid": "1f3e50b9-2015-4c0b-adbd-fb91bf9d7753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:26:b6,bridge_name='br-int',has_traffic_filtering=True,id=1f3e50b9-2015-4c0b-adbd-fb91bf9d7753,network=Network(323a6441-34e6-41af-a08c-908482497062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f3e50b9-20') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG os_vif [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:26:b6,bridge_name='br-int',has_traffic_filtering=True,id=1f3e50b9-2015-4c0b-adbd-fb91bf9d7753,network=Network(323a6441-34e6-41af-a08c-908482497062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f3e50b9-20') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '80c7719c-450d-5077-b9c2-9aa69fb9d73a', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG nova.compute.manager [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f3e50b9-20, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f3e50b9-20, col_values=(('qos', UUID('6ddea128-7e8a-4869-a15a-7e0b35c51d63')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f3e50b9-20, col_values=(('external_ids', {'iface-id': '1f3e50b9-2015-4c0b-adbd-fb91bf9d7753', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:26:b6', 'vm-uuid': 'a2b373e1-f872-4263-808c-ce5fbddf907c'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:10:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:10:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:38 user nova-compute[74821]: INFO os_vif [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:26:b6,bridge_name='br-int',has_traffic_filtering=True,id=1f3e50b9-2015-4c0b-adbd-fb91bf9d7753,network=Network(323a6441-34e6-41af-a08c-908482497062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f3e50b9-20')
Nov 06 13:10:38 user nova-compute[74821]: DEBUG nova.compute.manager [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:10:38 user nova-compute[74821]: DEBUG nova.network.neutron [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:10:38 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:10:38 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] No VIF found with MAC fa:16:3e:fd:26:b6, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:10:38 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:10:38 user nova-compute[74821]: DEBUG nova.compute.manager [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:10:38 user nova-compute[74821]: DEBUG nova.policy [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c82a5e63234e40f6a8e63b3cb4dc97b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07250ce4ef1b429f8a5c3c7763866763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:10:38 user nova-compute[74821]: DEBUG nova.compute.manager [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:10:38 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:10:38 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Creating image(s)
Nov 06 13:10:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "/opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "/opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:10:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.192s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:10:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:10:38 user nova-compute[74821]: DEBUG nova.network.neutron [req-bc5e12f7-07ec-4e14-b6e3-9de977894721 req-39e7bb94-b04e-4d61-8d00-b30bba9a9aba service nova] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Updated VIF entry in instance network info cache for port 1f3e50b9-2015-4c0b-adbd-fb91bf9d7753. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:10:38 user nova-compute[74821]: DEBUG nova.network.neutron [req-bc5e12f7-07ec-4e14-b6e3-9de977894721 req-39e7bb94-b04e-4d61-8d00-b30bba9a9aba service nova] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Updating instance_info_cache with network_info: [{"id": "1f3e50b9-2015-4c0b-adbd-fb91bf9d7753", "address": "fa:16:3e:fd:26:b6", "network": {"id": "323a6441-34e6-41af-a08c-908482497062", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-438888055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed493ef8770740f4a63b0baa352933a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f3e50b9-20", "ovs_interfaceid": "1f3e50b9-2015-4c0b-adbd-fb91bf9d7753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:10:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-bc5e12f7-07ec-4e14-b6e3-9de977894721 req-39e7bb94-b04e-4d61-8d00-b30bba9a9aba service nova] Releasing lock "refresh_cache-a2b373e1-f872-4263-808c-ce5fbddf907c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:10:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.190s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:10:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:10:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/disk 1073741824" returned: 0 in 0.050s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:10:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:10:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.212s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:10:38 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:10:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:10:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:10:39 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Cannot resize image /opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:10:39 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:10:39 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Ensure instance console log exists: /opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:10:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:39 user nova-compute[74821]: DEBUG nova.network.neutron [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Successfully created port: d69de9b4-5366-4d42-b01d-e4ec468a5aa2 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:10:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:40 user nova-compute[74821]: DEBUG nova.network.neutron [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Successfully updated port: d69de9b4-5366-4d42-b01d-e4ec468a5aa2 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:10:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "refresh_cache-5a715806-ff8b-4502-8435-c5de3e3c688a" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:10:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquired lock "refresh_cache-5a715806-ff8b-4502-8435-c5de3e3c688a" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:10:40 user nova-compute[74821]: DEBUG nova.network.neutron [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:10:40 user nova-compute[74821]: DEBUG nova.network.neutron [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:10:40 user nova-compute[74821]: DEBUG nova.compute.manager [req-d1a198a5-8dd5-44cb-b2fa-da1d117bd26d req-02408802-a358-4d05-abb6-d7f596fed760 service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Received event network-changed-d69de9b4-5366-4d42-b01d-e4ec468a5aa2 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:10:40 user nova-compute[74821]: DEBUG nova.compute.manager [req-d1a198a5-8dd5-44cb-b2fa-da1d117bd26d req-02408802-a358-4d05-abb6-d7f596fed760 service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Refreshing instance network info cache due to event network-changed-d69de9b4-5366-4d42-b01d-e4ec468a5aa2. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:10:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d1a198a5-8dd5-44cb-b2fa-da1d117bd26d req-02408802-a358-4d05-abb6-d7f596fed760 service nova] Acquiring lock "refresh_cache-5a715806-ff8b-4502-8435-c5de3e3c688a" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:10:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG nova.network.neutron [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Updating instance_info_cache with network_info: [{"id": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "address": "fa:16:3e:e1:45:18", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69de9b4-53", "ovs_interfaceid": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Releasing lock "refresh_cache-5a715806-ff8b-4502-8435-c5de3e3c688a" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG nova.compute.manager [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Instance network_info: |[{"id": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "address": "fa:16:3e:e1:45:18", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69de9b4-53", "ovs_interfaceid": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d1a198a5-8dd5-44cb-b2fa-da1d117bd26d req-02408802-a358-4d05-abb6-d7f596fed760 service nova] Acquired lock "refresh_cache-5a715806-ff8b-4502-8435-c5de3e3c688a" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG nova.network.neutron [req-d1a198a5-8dd5-44cb-b2fa-da1d117bd26d req-02408802-a358-4d05-abb6-d7f596fed760 service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Refreshing network info cache for port d69de9b4-5366-4d42-b01d-e4ec468a5aa2 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Start _get_guest_xml network_info=[{"id": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "address": "fa:16:3e:e1:45:18", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69de9b4-53", "ovs_interfaceid": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:10:41 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:10:41 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:10:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:10:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-618364180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-618364180',id=5,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWZZ63YOurS3QQCnNbLxGOa0k9DS7+D4rT/d8IE1TCw1yktKSHhioYCsL5dOWBhVqUbiOYRyokgjKYeQc4mySnCoKy4j7QoOj+bJM6HYi7kjMQxkuBe6IfrmM0otAD68Q==',key_name='tempest-keypair-1555089865',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07250ce4ef1b429f8a5c3c7763866763',ramdisk_id='',reservation_id='r-ls92k48z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-374688010',owner_user_name='tempest-AttachVolumeShelveTestJSON-374688010-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:10:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c82a5e63234e40f6a8e63b3cb4dc97b3',uuid=5a715806-ff8b-4502-8435-c5de3e3c688a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "address": "fa:16:3e:e1:45:18", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69de9b4-53", "ovs_interfaceid": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Converting VIF {"id": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "address": "fa:16:3e:e1:45:18", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69de9b4-53", "ovs_interfaceid": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:45:18,bridge_name='br-int',has_traffic_filtering=True,id=d69de9b4-5366-4d42-b01d-e4ec468a5aa2,network=Network(5318228c-491a-4ea1-a2b2-49ea8e15dccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69de9b4-53') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG nova.objects.instance [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a715806-ff8b-4502-8435-c5de3e3c688a {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:10:41 user nova-compute[74821]:   <uuid>5a715806-ff8b-4502-8435-c5de3e3c688a</uuid>
Nov 06 13:10:41 user nova-compute[74821]:   <name>instance-00000005</name>
Nov 06 13:10:41 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:10:41 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:10:41 user nova-compute[74821]:   <metadata>
Nov 06 13:10:41 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:10:41 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:10:41 user nova-compute[74821]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-618364180</nova:name>
Nov 06 13:10:41 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:10:41</nova:creationTime>
Nov 06 13:10:41 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:10:41 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:10:41 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:10:41 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:10:41 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:10:41 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:10:41 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:10:41 user nova-compute[74821]:       <nova:owner>
Nov 06 13:10:41 user nova-compute[74821]:         <nova:user uuid="c82a5e63234e40f6a8e63b3cb4dc97b3">tempest-AttachVolumeShelveTestJSON-374688010-project-member</nova:user>
Nov 06 13:10:41 user nova-compute[74821]:         <nova:project uuid="07250ce4ef1b429f8a5c3c7763866763">tempest-AttachVolumeShelveTestJSON-374688010</nova:project>
Nov 06 13:10:41 user nova-compute[74821]:       </nova:owner>
Nov 06 13:10:41 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:10:41 user nova-compute[74821]:       <nova:ports>
Nov 06 13:10:41 user nova-compute[74821]:         <nova:port uuid="d69de9b4-5366-4d42-b01d-e4ec468a5aa2">
Nov 06 13:10:41 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 13:10:41 user nova-compute[74821]:         </nova:port>
Nov 06 13:10:41 user nova-compute[74821]:       </nova:ports>
Nov 06 13:10:41 user nova-compute[74821]:     </nova:instance>
Nov 06 13:10:41 user nova-compute[74821]:   </metadata>
Nov 06 13:10:41 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:10:41 user nova-compute[74821]:     <system>
Nov 06 13:10:41 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:10:41 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:10:41 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:10:41 user nova-compute[74821]:       <entry name="serial">5a715806-ff8b-4502-8435-c5de3e3c688a</entry>
Nov 06 13:10:41 user nova-compute[74821]:       <entry name="uuid">5a715806-ff8b-4502-8435-c5de3e3c688a</entry>
Nov 06 13:10:41 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:10:41 user nova-compute[74821]:     </system>
Nov 06 13:10:41 user nova-compute[74821]:   </sysinfo>
Nov 06 13:10:41 user nova-compute[74821]:   <os>
Nov 06 13:10:41 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:10:41 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:10:41 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:10:41 user nova-compute[74821]:   </os>
Nov 06 13:10:41 user nova-compute[74821]:   <features>
Nov 06 13:10:41 user nova-compute[74821]:     <acpi/>
Nov 06 13:10:41 user nova-compute[74821]:     <apic/>
Nov 06 13:10:41 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:10:41 user nova-compute[74821]:   </features>
Nov 06 13:10:41 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:10:41 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:10:41 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:10:41 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:10:41 user nova-compute[74821]:   </clock>
Nov 06 13:10:41 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:10:41 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:10:41 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:10:41 user nova-compute[74821]:   </cpu>
Nov 06 13:10:41 user nova-compute[74821]:   <devices>
Nov 06 13:10:41 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:10:41 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:10:41 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/disk"/>
Nov 06 13:10:41 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:10:41 user nova-compute[74821]:     </disk>
Nov 06 13:10:41 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:10:41 user nova-compute[74821]:       <mac address="fa:16:3e:e1:45:18"/>
Nov 06 13:10:41 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:10:41 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:10:41 user nova-compute[74821]:       <target dev="tapd69de9b4-53"/>
Nov 06 13:10:41 user nova-compute[74821]:     </interface>
Nov 06 13:10:41 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:10:41 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/console.log" append="off"/>
Nov 06 13:10:41 user nova-compute[74821]:     </serial>
Nov 06 13:10:41 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:10:41 user nova-compute[74821]:     <video>
Nov 06 13:10:41 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:10:41 user nova-compute[74821]:     </video>
Nov 06 13:10:41 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:10:41 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:10:41 user nova-compute[74821]:     </rng>
Nov 06 13:10:41 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:10:41 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:10:41 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:10:41 user nova-compute[74821]:     </memballoon>
Nov 06 13:10:41 user nova-compute[74821]:   </devices>
Nov 06 13:10:41 user nova-compute[74821]: </domain>
Nov 06 13:10:41 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:10:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-618364180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-618364180',id=5,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWZZ63YOurS3QQCnNbLxGOa0k9DS7+D4rT/d8IE1TCw1yktKSHhioYCsL5dOWBhVqUbiOYRyokgjKYeQc4mySnCoKy4j7QoOj+bJM6HYi7kjMQxkuBe6IfrmM0otAD68Q==',key_name='tempest-keypair-1555089865',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07250ce4ef1b429f8a5c3c7763866763',ramdisk_id='',reservation_id='r-ls92k48z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-374688010',owner_user_name='tempest-AttachVolumeShelveTestJSON-374688010-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:10:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c82a5e63234e40f6a8e63b3cb4dc97b3',uuid=5a715806-ff8b-4502-8435-c5de3e3c688a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "address": "fa:16:3e:e1:45:18", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69de9b4-53", "ovs_interfaceid": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Converting VIF {"id": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "address": "fa:16:3e:e1:45:18", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69de9b4-53", "ovs_interfaceid": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:45:18,bridge_name='br-int',has_traffic_filtering=True,id=d69de9b4-5366-4d42-b01d-e4ec468a5aa2,network=Network(5318228c-491a-4ea1-a2b2-49ea8e15dccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69de9b4-53') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG os_vif [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:45:18,bridge_name='br-int',has_traffic_filtering=True,id=d69de9b4-5366-4d42-b01d-e4ec468a5aa2,network=Network(5318228c-491a-4ea1-a2b2-49ea8e15dccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69de9b4-53') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0eb3ecc5-d781-5180-81e5-9dba5aca32ab', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd69de9b4-53, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd69de9b4-53, col_values=(('qos', UUID('1f93284d-4114-4fb1-b842-8c1d1540f56d')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd69de9b4-53, col_values=(('external_ids', {'iface-id': 'd69de9b4-5366-4d42-b01d-e4ec468a5aa2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:45:18', 'vm-uuid': '5a715806-ff8b-4502-8435-c5de3e3c688a'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:41 user nova-compute[74821]: INFO os_vif [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:45:18,bridge_name='br-int',has_traffic_filtering=True,id=d69de9b4-5366-4d42-b01d-e4ec468a5aa2,network=Network(5318228c-491a-4ea1-a2b2-49ea8e15dccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69de9b4-53')
Nov 06 13:10:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] No VIF found with MAC fa:16:3e:e1:45:18, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG nova.network.neutron [req-d1a198a5-8dd5-44cb-b2fa-da1d117bd26d req-02408802-a358-4d05-abb6-d7f596fed760 service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Updated VIF entry in instance network info cache for port d69de9b4-5366-4d42-b01d-e4ec468a5aa2. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:10:41 user nova-compute[74821]: DEBUG nova.network.neutron [req-d1a198a5-8dd5-44cb-b2fa-da1d117bd26d req-02408802-a358-4d05-abb6-d7f596fed760 service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Updating instance_info_cache with network_info: [{"id": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "address": "fa:16:3e:e1:45:18", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69de9b4-53", "ovs_interfaceid": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:10:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d1a198a5-8dd5-44cb-b2fa-da1d117bd26d req-02408802-a358-4d05-abb6-d7f596fed760 service nova] Releasing lock "refresh_cache-5a715806-ff8b-4502-8435-c5de3e3c688a" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:10:43 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:43 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:43 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:44 user nova-compute[74821]: DEBUG nova.compute.manager [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:10:44 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:10:44 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 3e21d005-f190-478a-a911-e483e1235057] Instance spawned successfully.
Nov 06 13:10:44 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:10:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:44 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:10:44 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:10:44 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:10:44 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:10:44 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:10:44 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:10:44 user nova-compute[74821]: INFO nova.compute.manager [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Took 18.35 seconds to spawn the instance on the hypervisor.
Nov 06 13:10:44 user nova-compute[74821]: DEBUG nova.compute.manager [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:10:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:45 user nova-compute[74821]: INFO nova.compute.manager [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Took 19.78 seconds to build instance.
Nov 06 13:10:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e073ba9-2128-4d90-8f9e-ad8d735ee42c tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "3e21d005-f190-478a-a911-e483e1235057" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.207s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:45 user nova-compute[74821]: DEBUG nova.compute.manager [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:10:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:10:45 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Instance spawned successfully.
Nov 06 13:10:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:10:45 user nova-compute[74821]: DEBUG nova.compute.manager [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:10:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:10:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:10:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:10:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:10:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:10:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:10:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:10:45 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Instance spawned successfully.
Nov 06 13:10:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:10:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:10:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:10:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:10:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:10:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:10:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:10:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:45 user nova-compute[74821]: INFO nova.compute.manager [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Took 17.14 seconds to spawn the instance on the hypervisor.
Nov 06 13:10:45 user nova-compute[74821]: DEBUG nova.compute.manager [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:10:45 user nova-compute[74821]: INFO nova.compute.manager [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Took 11.86 seconds to spawn the instance on the hypervisor.
Nov 06 13:10:45 user nova-compute[74821]: DEBUG nova.compute.manager [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:10:45 user nova-compute[74821]: INFO nova.compute.manager [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Took 18.38 seconds to build instance.
Nov 06 13:10:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-71942d55-6e9b-4fef-9571-9b1458e4358d tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Lock "f8c537c6-fa3e-4842-9471-7258a22c01f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.584s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:45 user nova-compute[74821]: INFO nova.compute.manager [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Took 12.82 seconds to build instance.
Nov 06 13:10:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6585996f-9e83-4467-a6e9-713d7ace48b5 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Lock "a2b373e1-f872-4263-808c-ce5fbddf907c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.120s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:46 user nova-compute[74821]: DEBUG nova.compute.manager [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:10:46 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:10:46 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:46 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Instance spawned successfully.
Nov 06 13:10:46 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:10:46 user nova-compute[74821]: DEBUG nova.compute.manager [req-5b87b5ee-fc9c-4560-a154-5624f1072aac req-6aa92b4f-ec88-45e1-9509-0c458dea3d42 service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] Received event network-vif-plugged-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:10:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5b87b5ee-fc9c-4560-a154-5624f1072aac req-6aa92b4f-ec88-45e1-9509-0c458dea3d42 service nova] Acquiring lock "3e21d005-f190-478a-a911-e483e1235057-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5b87b5ee-fc9c-4560-a154-5624f1072aac req-6aa92b4f-ec88-45e1-9509-0c458dea3d42 service nova] Lock "3e21d005-f190-478a-a911-e483e1235057-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5b87b5ee-fc9c-4560-a154-5624f1072aac req-6aa92b4f-ec88-45e1-9509-0c458dea3d42 service nova] Lock "3e21d005-f190-478a-a911-e483e1235057-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:46 user nova-compute[74821]: DEBUG nova.compute.manager [req-5b87b5ee-fc9c-4560-a154-5624f1072aac req-6aa92b4f-ec88-45e1-9509-0c458dea3d42 service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] No waiting events found dispatching network-vif-plugged-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:10:46 user nova-compute[74821]: WARNING nova.compute.manager [req-5b87b5ee-fc9c-4560-a154-5624f1072aac req-6aa92b4f-ec88-45e1-9509-0c458dea3d42 service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] Received unexpected event network-vif-plugged-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 for instance with vm_state active and task_state None.
Nov 06 13:10:46 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:10:46 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:10:46 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:10:46 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:10:46 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:10:46 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:10:46 user nova-compute[74821]: INFO nova.compute.manager [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Took 18.70 seconds to spawn the instance on the hypervisor.
Nov 06 13:10:46 user nova-compute[74821]: DEBUG nova.compute.manager [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:10:47 user nova-compute[74821]: INFO nova.compute.manager [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Took 19.78 seconds to build instance.
Nov 06 13:10:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-615cc98c-f33b-478c-a51a-91fc9431341d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "311817c5-7b08-4da9-98eb-c685f37e6fd3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.328s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:47 user nova-compute[74821]: DEBUG nova.compute.manager [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:10:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:10:47 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Instance spawned successfully.
Nov 06 13:10:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:10:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:10:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:10:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:10:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:10:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:10:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:10:47 user nova-compute[74821]: INFO nova.compute.manager [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Took 9.28 seconds to spawn the instance on the hypervisor.
Nov 06 13:10:47 user nova-compute[74821]: DEBUG nova.compute.manager [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:10:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:47 user nova-compute[74821]: INFO nova.compute.manager [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Took 10.32 seconds to build instance.
Nov 06 13:10:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-586e7151-5d1f-41cc-ba7e-fcb11f26c434 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "5a715806-ff8b-4502-8435-c5de3e3c688a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.580s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:48 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:48 user nova-compute[74821]: DEBUG nova.compute.manager [req-3bccd5f7-00b5-416b-bdff-e5448accd5ca req-c8d498ab-d603-4479-a493-d6d92bc9adaa service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] Received event network-vif-plugged-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:10:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3bccd5f7-00b5-416b-bdff-e5448accd5ca req-c8d498ab-d603-4479-a493-d6d92bc9adaa service nova] Acquiring lock "3e21d005-f190-478a-a911-e483e1235057-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3bccd5f7-00b5-416b-bdff-e5448accd5ca req-c8d498ab-d603-4479-a493-d6d92bc9adaa service nova] Lock "3e21d005-f190-478a-a911-e483e1235057-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3bccd5f7-00b5-416b-bdff-e5448accd5ca req-c8d498ab-d603-4479-a493-d6d92bc9adaa service nova] Lock "3e21d005-f190-478a-a911-e483e1235057-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:48 user nova-compute[74821]: DEBUG nova.compute.manager [req-3bccd5f7-00b5-416b-bdff-e5448accd5ca req-c8d498ab-d603-4479-a493-d6d92bc9adaa service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] No waiting events found dispatching network-vif-plugged-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:10:48 user nova-compute[74821]: WARNING nova.compute.manager [req-3bccd5f7-00b5-416b-bdff-e5448accd5ca req-c8d498ab-d603-4479-a493-d6d92bc9adaa service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] Received unexpected event network-vif-plugged-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 for instance with vm_state active and task_state None.
Nov 06 13:10:48 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:49 user nova-compute[74821]: DEBUG nova.compute.manager [req-b32d1e78-60f8-41ee-8e9f-9cc20fd26900 req-9c0e3c2f-726e-46ee-992e-fd53bb50f179 service nova] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Received event network-vif-plugged-1f3e50b9-2015-4c0b-adbd-fb91bf9d7753 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:10:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b32d1e78-60f8-41ee-8e9f-9cc20fd26900 req-9c0e3c2f-726e-46ee-992e-fd53bb50f179 service nova] Acquiring lock "a2b373e1-f872-4263-808c-ce5fbddf907c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b32d1e78-60f8-41ee-8e9f-9cc20fd26900 req-9c0e3c2f-726e-46ee-992e-fd53bb50f179 service nova] Lock "a2b373e1-f872-4263-808c-ce5fbddf907c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b32d1e78-60f8-41ee-8e9f-9cc20fd26900 req-9c0e3c2f-726e-46ee-992e-fd53bb50f179 service nova] Lock "a2b373e1-f872-4263-808c-ce5fbddf907c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:49 user nova-compute[74821]: DEBUG nova.compute.manager [req-b32d1e78-60f8-41ee-8e9f-9cc20fd26900 req-9c0e3c2f-726e-46ee-992e-fd53bb50f179 service nova] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] No waiting events found dispatching network-vif-plugged-1f3e50b9-2015-4c0b-adbd-fb91bf9d7753 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:10:49 user nova-compute[74821]: WARNING nova.compute.manager [req-b32d1e78-60f8-41ee-8e9f-9cc20fd26900 req-9c0e3c2f-726e-46ee-992e-fd53bb50f179 service nova] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Received unexpected event network-vif-plugged-1f3e50b9-2015-4c0b-adbd-fb91bf9d7753 for instance with vm_state active and task_state None.
Nov 06 13:10:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:51 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:51 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:51 user nova-compute[74821]: DEBUG nova.compute.manager [req-24548faf-3506-48da-8c2e-249ef117373c req-30f984f9-00d8-4fed-8108-1ec03dbfd57b service nova] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Received event network-vif-plugged-1f3e50b9-2015-4c0b-adbd-fb91bf9d7753 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:10:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-24548faf-3506-48da-8c2e-249ef117373c req-30f984f9-00d8-4fed-8108-1ec03dbfd57b service nova] Acquiring lock "a2b373e1-f872-4263-808c-ce5fbddf907c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-24548faf-3506-48da-8c2e-249ef117373c req-30f984f9-00d8-4fed-8108-1ec03dbfd57b service nova] Lock "a2b373e1-f872-4263-808c-ce5fbddf907c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-24548faf-3506-48da-8c2e-249ef117373c req-30f984f9-00d8-4fed-8108-1ec03dbfd57b service nova] Lock "a2b373e1-f872-4263-808c-ce5fbddf907c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:51 user nova-compute[74821]: DEBUG nova.compute.manager [req-24548faf-3506-48da-8c2e-249ef117373c req-30f984f9-00d8-4fed-8108-1ec03dbfd57b service nova] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] No waiting events found dispatching network-vif-plugged-1f3e50b9-2015-4c0b-adbd-fb91bf9d7753 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:10:51 user nova-compute[74821]: WARNING nova.compute.manager [req-24548faf-3506-48da-8c2e-249ef117373c req-30f984f9-00d8-4fed-8108-1ec03dbfd57b service nova] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Received unexpected event network-vif-plugged-1f3e50b9-2015-4c0b-adbd-fb91bf9d7753 for instance with vm_state active and task_state None.
Nov 06 13:10:51 user nova-compute[74821]: DEBUG nova.compute.manager [req-24548faf-3506-48da-8c2e-249ef117373c req-30f984f9-00d8-4fed-8108-1ec03dbfd57b service nova] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Received event network-vif-plugged-be99c620-c497-4810-8aac-8793f2b2baa7 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:10:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-24548faf-3506-48da-8c2e-249ef117373c req-30f984f9-00d8-4fed-8108-1ec03dbfd57b service nova] Acquiring lock "311817c5-7b08-4da9-98eb-c685f37e6fd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-24548faf-3506-48da-8c2e-249ef117373c req-30f984f9-00d8-4fed-8108-1ec03dbfd57b service nova] Lock "311817c5-7b08-4da9-98eb-c685f37e6fd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-24548faf-3506-48da-8c2e-249ef117373c req-30f984f9-00d8-4fed-8108-1ec03dbfd57b service nova] Lock "311817c5-7b08-4da9-98eb-c685f37e6fd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:51 user nova-compute[74821]: DEBUG nova.compute.manager [req-24548faf-3506-48da-8c2e-249ef117373c req-30f984f9-00d8-4fed-8108-1ec03dbfd57b service nova] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] No waiting events found dispatching network-vif-plugged-be99c620-c497-4810-8aac-8793f2b2baa7 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:10:51 user nova-compute[74821]: WARNING nova.compute.manager [req-24548faf-3506-48da-8c2e-249ef117373c req-30f984f9-00d8-4fed-8108-1ec03dbfd57b service nova] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Received unexpected event network-vif-plugged-be99c620-c497-4810-8aac-8793f2b2baa7 for instance with vm_state active and task_state None.
Nov 06 13:10:51 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:53 user nova-compute[74821]: DEBUG nova.compute.manager [req-fa97fa8c-f7a5-401d-a360-2434276ea9f3 req-f3ddac78-3445-43e3-900f-d133098f9566 service nova] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Received event network-vif-plugged-be99c620-c497-4810-8aac-8793f2b2baa7 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:10:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fa97fa8c-f7a5-401d-a360-2434276ea9f3 req-f3ddac78-3445-43e3-900f-d133098f9566 service nova] Acquiring lock "311817c5-7b08-4da9-98eb-c685f37e6fd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fa97fa8c-f7a5-401d-a360-2434276ea9f3 req-f3ddac78-3445-43e3-900f-d133098f9566 service nova] Lock "311817c5-7b08-4da9-98eb-c685f37e6fd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fa97fa8c-f7a5-401d-a360-2434276ea9f3 req-f3ddac78-3445-43e3-900f-d133098f9566 service nova] Lock "311817c5-7b08-4da9-98eb-c685f37e6fd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:53 user nova-compute[74821]: DEBUG nova.compute.manager [req-fa97fa8c-f7a5-401d-a360-2434276ea9f3 req-f3ddac78-3445-43e3-900f-d133098f9566 service nova] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] No waiting events found dispatching network-vif-plugged-be99c620-c497-4810-8aac-8793f2b2baa7 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:10:53 user nova-compute[74821]: WARNING nova.compute.manager [req-fa97fa8c-f7a5-401d-a360-2434276ea9f3 req-f3ddac78-3445-43e3-900f-d133098f9566 service nova] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Received unexpected event network-vif-plugged-be99c620-c497-4810-8aac-8793f2b2baa7 for instance with vm_state active and task_state None.
Nov 06 13:10:53 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:54 user nova-compute[74821]: DEBUG nova.compute.manager [req-87e7c267-9388-45fb-8219-203c65a2b6ef req-6e829fd0-20d9-4a73-9836-4a44f8c66d71 service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Received event network-vif-plugged-d69de9b4-5366-4d42-b01d-e4ec468a5aa2 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:10:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-87e7c267-9388-45fb-8219-203c65a2b6ef req-6e829fd0-20d9-4a73-9836-4a44f8c66d71 service nova] Acquiring lock "5a715806-ff8b-4502-8435-c5de3e3c688a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-87e7c267-9388-45fb-8219-203c65a2b6ef req-6e829fd0-20d9-4a73-9836-4a44f8c66d71 service nova] Lock "5a715806-ff8b-4502-8435-c5de3e3c688a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-87e7c267-9388-45fb-8219-203c65a2b6ef req-6e829fd0-20d9-4a73-9836-4a44f8c66d71 service nova] Lock "5a715806-ff8b-4502-8435-c5de3e3c688a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:54 user nova-compute[74821]: DEBUG nova.compute.manager [req-87e7c267-9388-45fb-8219-203c65a2b6ef req-6e829fd0-20d9-4a73-9836-4a44f8c66d71 service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] No waiting events found dispatching network-vif-plugged-d69de9b4-5366-4d42-b01d-e4ec468a5aa2 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:10:54 user nova-compute[74821]: WARNING nova.compute.manager [req-87e7c267-9388-45fb-8219-203c65a2b6ef req-6e829fd0-20d9-4a73-9836-4a44f8c66d71 service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Received unexpected event network-vif-plugged-d69de9b4-5366-4d42-b01d-e4ec468a5aa2 for instance with vm_state active and task_state None.
Nov 06 13:10:56 user nova-compute[74821]: DEBUG nova.compute.manager [req-aa0c7c98-bbb3-44c4-946c-94b68e0c3c84 req-0364a835-c6f2-4409-8603-372d9314b2d6 service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Received event network-vif-plugged-d69de9b4-5366-4d42-b01d-e4ec468a5aa2 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:10:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-aa0c7c98-bbb3-44c4-946c-94b68e0c3c84 req-0364a835-c6f2-4409-8603-372d9314b2d6 service nova] Acquiring lock "5a715806-ff8b-4502-8435-c5de3e3c688a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-aa0c7c98-bbb3-44c4-946c-94b68e0c3c84 req-0364a835-c6f2-4409-8603-372d9314b2d6 service nova] Lock "5a715806-ff8b-4502-8435-c5de3e3c688a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-aa0c7c98-bbb3-44c4-946c-94b68e0c3c84 req-0364a835-c6f2-4409-8603-372d9314b2d6 service nova] Lock "5a715806-ff8b-4502-8435-c5de3e3c688a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:56 user nova-compute[74821]: DEBUG nova.compute.manager [req-aa0c7c98-bbb3-44c4-946c-94b68e0c3c84 req-0364a835-c6f2-4409-8603-372d9314b2d6 service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] No waiting events found dispatching network-vif-plugged-d69de9b4-5366-4d42-b01d-e4ec468a5aa2 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:10:56 user nova-compute[74821]: WARNING nova.compute.manager [req-aa0c7c98-bbb3-44c4-946c-94b68e0c3c84 req-0364a835-c6f2-4409-8603-372d9314b2d6 service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Received unexpected event network-vif-plugged-d69de9b4-5366-4d42-b01d-e4ec468a5aa2 for instance with vm_state active and task_state None.
Nov 06 13:10:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Acquiring lock "86ccb546-94c4-482c-8017-852cd42999fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Lock "86ccb546-94c4-482c-8017-852cd42999fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:57 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:10:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:58 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:10:58 user nova-compute[74821]: INFO nova.compute.claims [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Claim successful on node user
Nov 06 13:10:58 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:10:58 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:10:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.676s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:58 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:10:58 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:10:58 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:10:58 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:10:58 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 06 13:10:58 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:10:58 user nova-compute[74821]: DEBUG nova.policy [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6e9946729f1d4cd18d82868dd3c6dab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67451985a44547f1b99750173d9c24bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:10:59 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:10:59 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:10:59 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Creating image(s)
Nov 06 13:10:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Acquiring lock "/opt/stack/data/nova/instances/86ccb546-94c4-482c-8017-852cd42999fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Lock "/opt/stack/data/nova/instances/86ccb546-94c4-482c-8017-852cd42999fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Lock "/opt/stack/data/nova/instances/86ccb546-94c4-482c-8017-852cd42999fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Acquiring lock "3d67c1541c8f804de9e33cc5f1a19a4b12b0179b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Lock "3d67c1541c8f804de9e33cc5f1a19a4b12b0179b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:59 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d67c1541c8f804de9e33cc5f1a19a4b12b0179b.part --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:10:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-f7e38901-2469-45f8-91bd-5033aa0e9b37 req-4812b64f-4deb-49cc-9803-a44960728c80 service nova] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Received event network-vif-plugged-05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:10:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f7e38901-2469-45f8-91bd-5033aa0e9b37 req-4812b64f-4deb-49cc-9803-a44960728c80 service nova] Acquiring lock "f8c537c6-fa3e-4842-9471-7258a22c01f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:10:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f7e38901-2469-45f8-91bd-5033aa0e9b37 req-4812b64f-4deb-49cc-9803-a44960728c80 service nova] Lock "f8c537c6-fa3e-4842-9471-7258a22c01f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:10:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f7e38901-2469-45f8-91bd-5033aa0e9b37 req-4812b64f-4deb-49cc-9803-a44960728c80 service nova] Lock "f8c537c6-fa3e-4842-9471-7258a22c01f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:10:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-f7e38901-2469-45f8-91bd-5033aa0e9b37 req-4812b64f-4deb-49cc-9803-a44960728c80 service nova] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] No waiting events found dispatching network-vif-plugged-05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:10:59 user nova-compute[74821]: WARNING nova.compute.manager [req-f7e38901-2469-45f8-91bd-5033aa0e9b37 req-4812b64f-4deb-49cc-9803-a44960728c80 service nova] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Received unexpected event network-vif-plugged-05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b for instance with vm_state active and task_state None.
Nov 06 13:10:59 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d67c1541c8f804de9e33cc5f1a19a4b12b0179b.part --force-share --output=json" returned: 0 in 0.270s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:10:59 user nova-compute[74821]: DEBUG nova.virt.images [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] 5968e265-b173-4361-97e6-4a44ed4f6fc5 was qcow2, converting to raw {{(pid=74821) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 13:10:59 user nova-compute[74821]: DEBUG nova.privsep.utils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74821) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 13:10:59 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3d67c1541c8f804de9e33cc5f1a19a4b12b0179b.part /opt/stack/data/nova/instances/_base/3d67c1541c8f804de9e33cc5f1a19a4b12b0179b.converted {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:00 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Successfully created port: 93600b1e-7a16-42b2-8577-440a7d7f0667 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:11:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3d67c1541c8f804de9e33cc5f1a19a4b12b0179b.part /opt/stack/data/nova/instances/_base/3d67c1541c8f804de9e33cc5f1a19a4b12b0179b.converted" returned: 0 in 0.327s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:11:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d67c1541c8f804de9e33cc5f1a19a4b12b0179b.converted --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d67c1541c8f804de9e33cc5f1a19a4b12b0179b.converted --force-share --output=json" returned: 0 in 0.329s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:11:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Lock "3d67c1541c8f804de9e33cc5f1a19a4b12b0179b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.445s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:11:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d67c1541c8f804de9e33cc5f1a19a4b12b0179b --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d67c1541c8f804de9e33cc5f1a19a4b12b0179b --force-share --output=json" returned: 0 in 0.185s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:11:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Acquiring lock "3d67c1541c8f804de9e33cc5f1a19a4b12b0179b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:11:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Lock "3d67c1541c8f804de9e33cc5f1a19a4b12b0179b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:11:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d67c1541c8f804de9e33cc5f1a19a4b12b0179b --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:00 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Successfully updated port: 93600b1e-7a16-42b2-8577-440a7d7f0667 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:11:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d67c1541c8f804de9e33cc5f1a19a4b12b0179b --force-share --output=json" returned: 0 in 0.203s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:11:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3d67c1541c8f804de9e33cc5f1a19a4b12b0179b,backing_fmt=raw /opt/stack/data/nova/instances/86ccb546-94c4-482c-8017-852cd42999fe/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Acquiring lock "refresh_cache-86ccb546-94c4-482c-8017-852cd42999fe" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Acquired lock "refresh_cache-86ccb546-94c4-482c-8017-852cd42999fe" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.compute.manager [req-458d941f-fe3b-4259-97ec-74609be58f01 req-8acdb490-826a-4e2f-9e01-a679eff33490 service nova] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Received event network-changed-93600b1e-7a16-42b2-8577-440a7d7f0667 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.compute.manager [req-458d941f-fe3b-4259-97ec-74609be58f01 req-8acdb490-826a-4e2f-9e01-a679eff33490 service nova] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Refreshing instance network info cache due to event network-changed-93600b1e-7a16-42b2-8577-440a7d7f0667. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-458d941f-fe3b-4259-97ec-74609be58f01 req-8acdb490-826a-4e2f-9e01-a679eff33490 service nova] Acquiring lock "refresh_cache-86ccb546-94c4-482c-8017-852cd42999fe" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3d67c1541c8f804de9e33cc5f1a19a4b12b0179b,backing_fmt=raw /opt/stack/data/nova/instances/86ccb546-94c4-482c-8017-852cd42999fe/disk 1073741824" returned: 0 in 0.077s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Lock "3d67c1541c8f804de9e33cc5f1a19a4b12b0179b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d67c1541c8f804de9e33cc5f1a19a4b12b0179b --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d67c1541c8f804de9e33cc5f1a19a4b12b0179b --force-share --output=json" returned: 0 in 0.237s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Checking if we can resize image /opt/stack/data/nova/instances/86ccb546-94c4-482c-8017-852cd42999fe/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ccb546-94c4-482c-8017-852cd42999fe/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ccb546-94c4-482c-8017-852cd42999fe/disk --force-share --output=json" returned: 0 in 0.317s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Cannot resize image /opt/stack/data/nova/instances/86ccb546-94c4-482c-8017-852cd42999fe/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Ensure instance console log exists: /opt/stack/data/nova/instances/86ccb546-94c4-482c-8017-852cd42999fe/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Updating instance_info_cache with network_info: [{"id": "93600b1e-7a16-42b2-8577-440a7d7f0667", "address": "fa:16:3e:ba:c2:bf", "network": {"id": "1b5b94d0-ef68-400c-b1f8-5f2892422587", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-185086197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67451985a44547f1b99750173d9c24bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93600b1e-7a", "ovs_interfaceid": "93600b1e-7a16-42b2-8577-440a7d7f0667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Releasing lock "refresh_cache-86ccb546-94c4-482c-8017-852cd42999fe" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Instance network_info: |[{"id": "93600b1e-7a16-42b2-8577-440a7d7f0667", "address": "fa:16:3e:ba:c2:bf", "network": {"id": "1b5b94d0-ef68-400c-b1f8-5f2892422587", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-185086197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67451985a44547f1b99750173d9c24bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93600b1e-7a", "ovs_interfaceid": "93600b1e-7a16-42b2-8577-440a7d7f0667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-458d941f-fe3b-4259-97ec-74609be58f01 req-8acdb490-826a-4e2f-9e01-a679eff33490 service nova] Acquired lock "refresh_cache-86ccb546-94c4-482c-8017-852cd42999fe" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.network.neutron [req-458d941f-fe3b-4259-97ec-74609be58f01 req-8acdb490-826a-4e2f-9e01-a679eff33490 service nova] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Refreshing network info cache for port 93600b1e-7a16-42b2-8577-440a7d7f0667 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Start _get_guest_xml network_info=[{"id": "93600b1e-7a16-42b2-8577-440a7d7f0667", "address": "fa:16:3e:ba:c2:bf", "network": {"id": "1b5b94d0-ef68-400c-b1f8-5f2892422587", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-185086197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67451985a44547f1b99750173d9c24bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93600b1e-7a", "ovs_interfaceid": "93600b1e-7a16-42b2-8577-440a7d7f0667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:10:49Z,direct_url=<?>,disk_format='qcow2',id=5968e265-b173-4361-97e6-4a44ed4f6fc5,min_disk=0,min_ram=0,name='',owner='e0ea621f8a074b68aef6a11deb1031a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:10:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/sda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'scsi', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '5968e265-b173-4361-97e6-4a44ed4f6fc5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.compute.manager [req-33804275-0048-4c20-b6ea-d33a847daed5 req-b3d6c19e-7f34-4662-82ea-fd66c217a6cd service nova] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Received event network-vif-plugged-05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-33804275-0048-4c20-b6ea-d33a847daed5 req-b3d6c19e-7f34-4662-82ea-fd66c217a6cd service nova] Acquiring lock "f8c537c6-fa3e-4842-9471-7258a22c01f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-33804275-0048-4c20-b6ea-d33a847daed5 req-b3d6c19e-7f34-4662-82ea-fd66c217a6cd service nova] Lock "f8c537c6-fa3e-4842-9471-7258a22c01f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-33804275-0048-4c20-b6ea-d33a847daed5 req-b3d6c19e-7f34-4662-82ea-fd66c217a6cd service nova] Lock "f8c537c6-fa3e-4842-9471-7258a22c01f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.compute.manager [req-33804275-0048-4c20-b6ea-d33a847daed5 req-b3d6c19e-7f34-4662-82ea-fd66c217a6cd service nova] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] No waiting events found dispatching network-vif-plugged-05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:11:01 user nova-compute[74821]: WARNING nova.compute.manager [req-33804275-0048-4c20-b6ea-d33a847daed5 req-b3d6c19e-7f34-4662-82ea-fd66c217a6cd service nova] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Received unexpected event network-vif-plugged-05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b for instance with vm_state active and task_state None.
Nov 06 13:11:01 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:11:01 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:10:49Z,direct_url=<?>,disk_format='qcow2',id=5968e265-b173-4361-97e6-4a44ed4f6fc5,min_disk=0,min_ram=0,name='',owner='e0ea621f8a074b68aef6a11deb1031a0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:10:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2027393985',display_name='tempest-AttachSCSIVolumeTestJSON-server-2027393985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2027393985',id=6,image_ref='5968e265-b173-4361-97e6-4a44ed4f6fc5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKtApV1r3heOGi31OqfSZUB2u/MSmailsMr88Q4lHjB16ry8TiN61Otk343Nj+oZVa907e7/j0TqLwSbk49PoKoSc26FsCKglBSCCmxbAWHfyskD1zfAxHUt1zW1x9Letw==',key_name='tempest-keypair-1839561808',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67451985a44547f1b99750173d9c24bc',ramdisk_id='',reservation_id='r-k6gsijq3',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5968e265-b173-4361-97e6-4a44ed4f6fc5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1743036243',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1743036243-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e9946729f1d4cd18d82868dd3c6dab6',uuid=86ccb546-94c4-482c-8017-852cd42999fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93600b1e-7a16-42b2-8577-440a7d7f0667", "address": "fa:16:3e:ba:c2:bf", "network": {"id": "1b5b94d0-ef68-400c-b1f8-5f2892422587", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-185086197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67451985a44547f1b99750173d9c24bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93600b1e-7a", "ovs_interfaceid": "93600b1e-7a16-42b2-8577-440a7d7f0667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Converting VIF {"id": "93600b1e-7a16-42b2-8577-440a7d7f0667", "address": "fa:16:3e:ba:c2:bf", "network": {"id": "1b5b94d0-ef68-400c-b1f8-5f2892422587", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-185086197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67451985a44547f1b99750173d9c24bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93600b1e-7a", "ovs_interfaceid": "93600b1e-7a16-42b2-8577-440a7d7f0667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:c2:bf,bridge_name='br-int',has_traffic_filtering=True,id=93600b1e-7a16-42b2-8577-440a7d7f0667,network=Network(1b5b94d0-ef68-400c-b1f8-5f2892422587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93600b1e-7a') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.objects.instance [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Lazy-loading 'pci_devices' on Instance uuid 86ccb546-94c4-482c-8017-852cd42999fe {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:11:01 user nova-compute[74821]:   <uuid>86ccb546-94c4-482c-8017-852cd42999fe</uuid>
Nov 06 13:11:01 user nova-compute[74821]:   <name>instance-00000006</name>
Nov 06 13:11:01 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:11:01 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:11:01 user nova-compute[74821]:   <metadata>
Nov 06 13:11:01 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:11:01 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:11:01 user nova-compute[74821]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-2027393985</nova:name>
Nov 06 13:11:01 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:11:01</nova:creationTime>
Nov 06 13:11:01 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:11:01 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:11:01 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:11:01 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:11:01 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:11:01 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:11:01 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:11:01 user nova-compute[74821]:       <nova:owner>
Nov 06 13:11:01 user nova-compute[74821]:         <nova:user uuid="6e9946729f1d4cd18d82868dd3c6dab6">tempest-AttachSCSIVolumeTestJSON-1743036243-project-member</nova:user>
Nov 06 13:11:01 user nova-compute[74821]:         <nova:project uuid="67451985a44547f1b99750173d9c24bc">tempest-AttachSCSIVolumeTestJSON-1743036243</nova:project>
Nov 06 13:11:01 user nova-compute[74821]:       </nova:owner>
Nov 06 13:11:01 user nova-compute[74821]:       <nova:root type="image" uuid="5968e265-b173-4361-97e6-4a44ed4f6fc5"/>
Nov 06 13:11:01 user nova-compute[74821]:       <nova:ports>
Nov 06 13:11:01 user nova-compute[74821]:         <nova:port uuid="93600b1e-7a16-42b2-8577-440a7d7f0667">
Nov 06 13:11:01 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 13:11:01 user nova-compute[74821]:         </nova:port>
Nov 06 13:11:01 user nova-compute[74821]:       </nova:ports>
Nov 06 13:11:01 user nova-compute[74821]:     </nova:instance>
Nov 06 13:11:01 user nova-compute[74821]:   </metadata>
Nov 06 13:11:01 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:11:01 user nova-compute[74821]:     <system>
Nov 06 13:11:01 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:11:01 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:11:01 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:11:01 user nova-compute[74821]:       <entry name="serial">86ccb546-94c4-482c-8017-852cd42999fe</entry>
Nov 06 13:11:01 user nova-compute[74821]:       <entry name="uuid">86ccb546-94c4-482c-8017-852cd42999fe</entry>
Nov 06 13:11:01 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:11:01 user nova-compute[74821]:     </system>
Nov 06 13:11:01 user nova-compute[74821]:   </sysinfo>
Nov 06 13:11:01 user nova-compute[74821]:   <os>
Nov 06 13:11:01 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:11:01 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:11:01 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:11:01 user nova-compute[74821]:   </os>
Nov 06 13:11:01 user nova-compute[74821]:   <features>
Nov 06 13:11:01 user nova-compute[74821]:     <acpi/>
Nov 06 13:11:01 user nova-compute[74821]:     <apic/>
Nov 06 13:11:01 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:11:01 user nova-compute[74821]:   </features>
Nov 06 13:11:01 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:11:01 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:11:01 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:11:01 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:11:01 user nova-compute[74821]:   </clock>
Nov 06 13:11:01 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:11:01 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:11:01 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:11:01 user nova-compute[74821]:   </cpu>
Nov 06 13:11:01 user nova-compute[74821]:   <devices>
Nov 06 13:11:01 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:11:01 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:11:01 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/86ccb546-94c4-482c-8017-852cd42999fe/disk"/>
Nov 06 13:11:01 user nova-compute[74821]:       <target dev="sda" bus="scsi"/>
Nov 06 13:11:01 user nova-compute[74821]:       <address type="drive" controller="0" unit="0"/>
Nov 06 13:11:01 user nova-compute[74821]:     </disk>
Nov 06 13:11:01 user nova-compute[74821]:     <disk type="file" device="cdrom">
Nov 06 13:11:01 user nova-compute[74821]:       <driver name="qemu" type="raw" cache="none"/>
Nov 06 13:11:01 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/86ccb546-94c4-482c-8017-852cd42999fe/disk.config"/>
Nov 06 13:11:01 user nova-compute[74821]:       <target dev="sdb" bus="scsi"/>
Nov 06 13:11:01 user nova-compute[74821]:       <address type="drive" controller="0" unit="1"/>
Nov 06 13:11:01 user nova-compute[74821]:     </disk>
Nov 06 13:11:01 user nova-compute[74821]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 06 13:11:01 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:11:01 user nova-compute[74821]:       <mac address="fa:16:3e:ba:c2:bf"/>
Nov 06 13:11:01 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:11:01 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:11:01 user nova-compute[74821]:       <target dev="tap93600b1e-7a"/>
Nov 06 13:11:01 user nova-compute[74821]:     </interface>
Nov 06 13:11:01 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:11:01 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/86ccb546-94c4-482c-8017-852cd42999fe/console.log" append="off"/>
Nov 06 13:11:01 user nova-compute[74821]:     </serial>
Nov 06 13:11:01 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:11:01 user nova-compute[74821]:     <video>
Nov 06 13:11:01 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:11:01 user nova-compute[74821]:     </video>
Nov 06 13:11:01 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:11:01 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:11:01 user nova-compute[74821]:     </rng>
Nov 06 13:11:01 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:11:01 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:11:01 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:11:01 user nova-compute[74821]:     </memballoon>
Nov 06 13:11:01 user nova-compute[74821]:   </devices>
Nov 06 13:11:01 user nova-compute[74821]: </domain>
Nov 06 13:11:01 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2027393985',display_name='tempest-AttachSCSIVolumeTestJSON-server-2027393985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2027393985',id=6,image_ref='5968e265-b173-4361-97e6-4a44ed4f6fc5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKtApV1r3heOGi31OqfSZUB2u/MSmailsMr88Q4lHjB16ry8TiN61Otk343Nj+oZVa907e7/j0TqLwSbk49PoKoSc26FsCKglBSCCmxbAWHfyskD1zfAxHUt1zW1x9Letw==',key_name='tempest-keypair-1839561808',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67451985a44547f1b99750173d9c24bc',ramdisk_id='',reservation_id='r-k6gsijq3',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5968e265-b173-4361-97e6-4a44ed4f6fc5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1743036243',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1743036243-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e9946729f1d4cd18d82868dd3c6dab6',uuid=86ccb546-94c4-482c-8017-852cd42999fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93600b1e-7a16-42b2-8577-440a7d7f0667", "address": "fa:16:3e:ba:c2:bf", "network": {"id": "1b5b94d0-ef68-400c-b1f8-5f2892422587", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-185086197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67451985a44547f1b99750173d9c24bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93600b1e-7a", "ovs_interfaceid": "93600b1e-7a16-42b2-8577-440a7d7f0667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Converting VIF {"id": "93600b1e-7a16-42b2-8577-440a7d7f0667", "address": "fa:16:3e:ba:c2:bf", "network": {"id": "1b5b94d0-ef68-400c-b1f8-5f2892422587", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-185086197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67451985a44547f1b99750173d9c24bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93600b1e-7a", "ovs_interfaceid": "93600b1e-7a16-42b2-8577-440a7d7f0667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:c2:bf,bridge_name='br-int',has_traffic_filtering=True,id=93600b1e-7a16-42b2-8577-440a7d7f0667,network=Network(1b5b94d0-ef68-400c-b1f8-5f2892422587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93600b1e-7a') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG os_vif [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:c2:bf,bridge_name='br-int',has_traffic_filtering=True,id=93600b1e-7a16-42b2-8577-440a7d7f0667,network=Network(1b5b94d0-ef68-400c-b1f8-5f2892422587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93600b1e-7a') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b779156e-e530-5120-9dbd-25dbd771d46b', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93600b1e-7a, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap93600b1e-7a, col_values=(('qos', UUID('0ce657f6-2b9d-41a2-a652-c380cb7e0728')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap93600b1e-7a, col_values=(('external_ids', {'iface-id': '93600b1e-7a16-42b2-8577-440a7d7f0667', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:c2:bf', 'vm-uuid': '86ccb546-94c4-482c-8017-852cd42999fe'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:01 user nova-compute[74821]: INFO os_vif [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:c2:bf,bridge_name='br-int',has_traffic_filtering=True,id=93600b1e-7a16-42b2-8577-440a7d7f0667,network=Network(1b5b94d0-ef68-400c-b1f8-5f2892422587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93600b1e-7a')
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] No BDM found with device name sda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:11:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] No VIF found with MAC fa:16:3e:ba:c2:bf, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:11:01 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Using config drive
Nov 06 13:11:02 user nova-compute[74821]: DEBUG nova.network.neutron [req-458d941f-fe3b-4259-97ec-74609be58f01 req-8acdb490-826a-4e2f-9e01-a679eff33490 service nova] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Updated VIF entry in instance network info cache for port 93600b1e-7a16-42b2-8577-440a7d7f0667. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:11:02 user nova-compute[74821]: DEBUG nova.network.neutron [req-458d941f-fe3b-4259-97ec-74609be58f01 req-8acdb490-826a-4e2f-9e01-a679eff33490 service nova] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Updating instance_info_cache with network_info: [{"id": "93600b1e-7a16-42b2-8577-440a7d7f0667", "address": "fa:16:3e:ba:c2:bf", "network": {"id": "1b5b94d0-ef68-400c-b1f8-5f2892422587", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-185086197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67451985a44547f1b99750173d9c24bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93600b1e-7a", "ovs_interfaceid": "93600b1e-7a16-42b2-8577-440a7d7f0667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:11:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-458d941f-fe3b-4259-97ec-74609be58f01 req-8acdb490-826a-4e2f-9e01-a679eff33490 service nova] Releasing lock "refresh_cache-86ccb546-94c4-482c-8017-852cd42999fe" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:11:02 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Creating config drive at /opt/stack/data/nova/instances/86ccb546-94c4-482c-8017-852cd42999fe/disk.config
Nov 06 13:11:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/86ccb546-94c4-482c-8017-852cd42999fe/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpl2ceulzf {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/86ccb546-94c4-482c-8017-852cd42999fe/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpl2ceulzf" returned: 0 in 0.069s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:11:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:04 user nova-compute[74821]: DEBUG nova.compute.manager [req-182d6daf-cd9a-4bd8-a7f7-1408610e9a3e req-376a1b85-6af8-4ead-9a96-2b20ff634fab service nova] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Received event network-vif-plugged-93600b1e-7a16-42b2-8577-440a7d7f0667 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:11:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-182d6daf-cd9a-4bd8-a7f7-1408610e9a3e req-376a1b85-6af8-4ead-9a96-2b20ff634fab service nova] Acquiring lock "86ccb546-94c4-482c-8017-852cd42999fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:11:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-182d6daf-cd9a-4bd8-a7f7-1408610e9a3e req-376a1b85-6af8-4ead-9a96-2b20ff634fab service nova] Lock "86ccb546-94c4-482c-8017-852cd42999fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:11:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-182d6daf-cd9a-4bd8-a7f7-1408610e9a3e req-376a1b85-6af8-4ead-9a96-2b20ff634fab service nova] Lock "86ccb546-94c4-482c-8017-852cd42999fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:11:04 user nova-compute[74821]: DEBUG nova.compute.manager [req-182d6daf-cd9a-4bd8-a7f7-1408610e9a3e req-376a1b85-6af8-4ead-9a96-2b20ff634fab service nova] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] No waiting events found dispatching network-vif-plugged-93600b1e-7a16-42b2-8577-440a7d7f0667 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:11:04 user nova-compute[74821]: WARNING nova.compute.manager [req-182d6daf-cd9a-4bd8-a7f7-1408610e9a3e req-376a1b85-6af8-4ead-9a96-2b20ff634fab service nova] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Received unexpected event network-vif-plugged-93600b1e-7a16-42b2-8577-440a7d7f0667 for instance with vm_state building and task_state spawning.
Nov 06 13:11:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:06 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:07 user nova-compute[74821]: DEBUG nova.compute.manager [req-ace73262-a756-4cce-8d51-1031640a81c0 req-04bda9af-efa3-496b-9292-c623e0c2f17f service nova] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Received event network-vif-plugged-93600b1e-7a16-42b2-8577-440a7d7f0667 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:11:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ace73262-a756-4cce-8d51-1031640a81c0 req-04bda9af-efa3-496b-9292-c623e0c2f17f service nova] Acquiring lock "86ccb546-94c4-482c-8017-852cd42999fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:11:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ace73262-a756-4cce-8d51-1031640a81c0 req-04bda9af-efa3-496b-9292-c623e0c2f17f service nova] Lock "86ccb546-94c4-482c-8017-852cd42999fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:11:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ace73262-a756-4cce-8d51-1031640a81c0 req-04bda9af-efa3-496b-9292-c623e0c2f17f service nova] Lock "86ccb546-94c4-482c-8017-852cd42999fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:11:07 user nova-compute[74821]: DEBUG nova.compute.manager [req-ace73262-a756-4cce-8d51-1031640a81c0 req-04bda9af-efa3-496b-9292-c623e0c2f17f service nova] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] No waiting events found dispatching network-vif-plugged-93600b1e-7a16-42b2-8577-440a7d7f0667 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:11:07 user nova-compute[74821]: WARNING nova.compute.manager [req-ace73262-a756-4cce-8d51-1031640a81c0 req-04bda9af-efa3-496b-9292-c623e0c2f17f service nova] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Received unexpected event network-vif-plugged-93600b1e-7a16-42b2-8577-440a7d7f0667 for instance with vm_state building and task_state spawning.
Nov 06 13:11:07 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:11:07 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:11:07 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Instance spawned successfully.
Nov 06 13:11:07 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:11:07 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:11:07 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:11:07 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:11:07 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:11:07 user nova-compute[74821]: INFO nova.compute.manager [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Took 8.30 seconds to spawn the instance on the hypervisor.
Nov 06 13:11:07 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:11:07 user nova-compute[74821]: INFO nova.compute.manager [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Took 9.43 seconds to build instance.
Nov 06 13:11:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5c332624-4078-460f-b7ca-c55e73b3adda tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Lock "86ccb546-94c4-482c-8017-852cd42999fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.552s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:11:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:11 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Acquiring lock "49d05da1-3222-4f9f-b792-8f3d1f0f2890" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:11:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Lock "49d05da1-3222-4f9f-b792-8f3d1f0f2890" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:11:14 user nova-compute[74821]: DEBUG nova.compute.manager [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:11:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:11:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:11:14 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:11:14 user nova-compute[74821]: INFO nova.compute.claims [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Claim successful on node user
Nov 06 13:11:15 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:11:15 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:11:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.559s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:11:15 user nova-compute[74821]: DEBUG nova.compute.manager [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:11:15 user nova-compute[74821]: DEBUG nova.compute.manager [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:11:15 user nova-compute[74821]: DEBUG nova.network.neutron [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:11:15 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:11:15 user nova-compute[74821]: DEBUG nova.compute.manager [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:11:15 user nova-compute[74821]: DEBUG nova.policy [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '45a26f79e64944a196c66276feeb30e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afa9994148b4f9698f0a9cc7c8d1a5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:11:15 user nova-compute[74821]: DEBUG nova.compute.manager [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:11:15 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:11:15 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Creating image(s)
Nov 06 13:11:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Acquiring lock "/opt/stack/data/nova/instances/49d05da1-3222-4f9f-b792-8f3d1f0f2890/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:11:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Lock "/opt/stack/data/nova/instances/49d05da1-3222-4f9f-b792-8f3d1f0f2890/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:11:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Lock "/opt/stack/data/nova/instances/49d05da1-3222-4f9f-b792-8f3d1f0f2890/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:11:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.231s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:11:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:11:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:11:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.213s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:11:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/49d05da1-3222-4f9f-b792-8f3d1f0f2890/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/49d05da1-3222-4f9f-b792-8f3d1f0f2890/disk 1073741824" returned: 0 in 0.195s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:11:16 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.416s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:11:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:16 user nova-compute[74821]: DEBUG nova.network.neutron [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Successfully created port: 95f3755e-a074-4956-ba1d-5c05945bcff5 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:11:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.245s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:11:16 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Checking if we can resize image /opt/stack/data/nova/instances/49d05da1-3222-4f9f-b792-8f3d1f0f2890/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:11:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49d05da1-3222-4f9f-b792-8f3d1f0f2890/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49d05da1-3222-4f9f-b792-8f3d1f0f2890/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:11:16 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Cannot resize image /opt/stack/data/nova/instances/49d05da1-3222-4f9f-b792-8f3d1f0f2890/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:11:16 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:11:16 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Ensure instance console log exists: /opt/stack/data/nova/instances/49d05da1-3222-4f9f-b792-8f3d1f0f2890/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:11:16 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:11:16 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:11:16 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:11:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG nova.network.neutron [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Successfully updated port: 95f3755e-a074-4956-ba1d-5c05945bcff5 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Acquiring lock "refresh_cache-49d05da1-3222-4f9f-b792-8f3d1f0f2890" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Acquired lock "refresh_cache-49d05da1-3222-4f9f-b792-8f3d1f0f2890" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG nova.network.neutron [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG nova.compute.manager [req-c3d43107-093f-4f4f-9d68-92e8fe69a3fb req-f379d92c-a1c7-49f3-862c-2ea640a0f0ec service nova] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Received event network-changed-95f3755e-a074-4956-ba1d-5c05945bcff5 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG nova.compute.manager [req-c3d43107-093f-4f4f-9d68-92e8fe69a3fb req-f379d92c-a1c7-49f3-862c-2ea640a0f0ec service nova] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Refreshing instance network info cache due to event network-changed-95f3755e-a074-4956-ba1d-5c05945bcff5. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c3d43107-093f-4f4f-9d68-92e8fe69a3fb req-f379d92c-a1c7-49f3-862c-2ea640a0f0ec service nova] Acquiring lock "refresh_cache-49d05da1-3222-4f9f-b792-8f3d1f0f2890" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG nova.network.neutron [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG nova.network.neutron [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Updating instance_info_cache with network_info: [{"id": "95f3755e-a074-4956-ba1d-5c05945bcff5", "address": "fa:16:3e:17:16:45", "network": {"id": "feb774a4-8d45-4814-bc23-169b2b378e48", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-639136774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0afa9994148b4f9698f0a9cc7c8d1a5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f3755e-a0", "ovs_interfaceid": "95f3755e-a074-4956-ba1d-5c05945bcff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Releasing lock "refresh_cache-49d05da1-3222-4f9f-b792-8f3d1f0f2890" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG nova.compute.manager [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Instance network_info: |[{"id": "95f3755e-a074-4956-ba1d-5c05945bcff5", "address": "fa:16:3e:17:16:45", "network": {"id": "feb774a4-8d45-4814-bc23-169b2b378e48", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-639136774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0afa9994148b4f9698f0a9cc7c8d1a5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f3755e-a0", "ovs_interfaceid": "95f3755e-a074-4956-ba1d-5c05945bcff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c3d43107-093f-4f4f-9d68-92e8fe69a3fb req-f379d92c-a1c7-49f3-862c-2ea640a0f0ec service nova] Acquired lock "refresh_cache-49d05da1-3222-4f9f-b792-8f3d1f0f2890" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG nova.network.neutron [req-c3d43107-093f-4f4f-9d68-92e8fe69a3fb req-f379d92c-a1c7-49f3-862c-2ea640a0f0ec service nova] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Refreshing network info cache for port 95f3755e-a074-4956-ba1d-5c05945bcff5 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Start _get_guest_xml network_info=[{"id": "95f3755e-a074-4956-ba1d-5c05945bcff5", "address": "fa:16:3e:17:16:45", "network": {"id": "feb774a4-8d45-4814-bc23-169b2b378e48", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-639136774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0afa9994148b4f9698f0a9cc7c8d1a5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f3755e-a0", "ovs_interfaceid": "95f3755e-a074-4956-ba1d-5c05945bcff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:11:17 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:11:17 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:11:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:11:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-44820582',display_name='tempest-VolumesAssistedSnapshotsTest-server-44820582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-44820582',id=7,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGykxPk1R3HA6WWcirlGAsfFCUETlNBorgDQQCdmarhiY0uUTSQJgGZlpf64teD+FzlPPj+DxqUwuEY3C1tl7Ne9Uap3YNtrlV9iGgYZkoqiH+HjyONcmDq5eU5busLMBA==',key_name='tempest-keypair-1466119120',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0afa9994148b4f9698f0a9cc7c8d1a5a',ramdisk_id='',reservation_id='r-kg2nfmfx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1134855026',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1134855026-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:11:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45a26f79e64944a196c66276feeb30e8',uuid=49d05da1-3222-4f9f-b792-8f3d1f0f2890,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95f3755e-a074-4956-ba1d-5c05945bcff5", "address": "fa:16:3e:17:16:45", "network": {"id": "feb774a4-8d45-4814-bc23-169b2b378e48", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-639136774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0afa9994148b4f9698f0a9cc7c8d1a5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f3755e-a0", "ovs_interfaceid": "95f3755e-a074-4956-ba1d-5c05945bcff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Converting VIF {"id": "95f3755e-a074-4956-ba1d-5c05945bcff5", "address": "fa:16:3e:17:16:45", "network": {"id": "feb774a4-8d45-4814-bc23-169b2b378e48", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-639136774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0afa9994148b4f9698f0a9cc7c8d1a5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f3755e-a0", "ovs_interfaceid": "95f3755e-a074-4956-ba1d-5c05945bcff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:16:45,bridge_name='br-int',has_traffic_filtering=True,id=95f3755e-a074-4956-ba1d-5c05945bcff5,network=Network(feb774a4-8d45-4814-bc23-169b2b378e48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f3755e-a0') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG nova.objects.instance [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Lazy-loading 'pci_devices' on Instance uuid 49d05da1-3222-4f9f-b792-8f3d1f0f2890 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:11:17 user nova-compute[74821]:   <uuid>49d05da1-3222-4f9f-b792-8f3d1f0f2890</uuid>
Nov 06 13:11:17 user nova-compute[74821]:   <name>instance-00000007</name>
Nov 06 13:11:17 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:11:17 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:11:17 user nova-compute[74821]:   <metadata>
Nov 06 13:11:17 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:11:17 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:11:17 user nova-compute[74821]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-44820582</nova:name>
Nov 06 13:11:17 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:11:17</nova:creationTime>
Nov 06 13:11:17 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:11:17 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:11:17 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:11:17 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:11:17 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:11:17 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:11:17 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:11:17 user nova-compute[74821]:       <nova:owner>
Nov 06 13:11:17 user nova-compute[74821]:         <nova:user uuid="45a26f79e64944a196c66276feeb30e8">tempest-VolumesAssistedSnapshotsTest-1134855026-project-member</nova:user>
Nov 06 13:11:17 user nova-compute[74821]:         <nova:project uuid="0afa9994148b4f9698f0a9cc7c8d1a5a">tempest-VolumesAssistedSnapshotsTest-1134855026</nova:project>
Nov 06 13:11:17 user nova-compute[74821]:       </nova:owner>
Nov 06 13:11:17 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:11:17 user nova-compute[74821]:       <nova:ports>
Nov 06 13:11:17 user nova-compute[74821]:         <nova:port uuid="95f3755e-a074-4956-ba1d-5c05945bcff5">
Nov 06 13:11:17 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 06 13:11:17 user nova-compute[74821]:         </nova:port>
Nov 06 13:11:17 user nova-compute[74821]:       </nova:ports>
Nov 06 13:11:17 user nova-compute[74821]:     </nova:instance>
Nov 06 13:11:17 user nova-compute[74821]:   </metadata>
Nov 06 13:11:17 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:11:17 user nova-compute[74821]:     <system>
Nov 06 13:11:17 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:11:17 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:11:17 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:11:17 user nova-compute[74821]:       <entry name="serial">49d05da1-3222-4f9f-b792-8f3d1f0f2890</entry>
Nov 06 13:11:17 user nova-compute[74821]:       <entry name="uuid">49d05da1-3222-4f9f-b792-8f3d1f0f2890</entry>
Nov 06 13:11:17 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:11:17 user nova-compute[74821]:     </system>
Nov 06 13:11:17 user nova-compute[74821]:   </sysinfo>
Nov 06 13:11:17 user nova-compute[74821]:   <os>
Nov 06 13:11:17 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:11:17 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:11:17 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:11:17 user nova-compute[74821]:   </os>
Nov 06 13:11:17 user nova-compute[74821]:   <features>
Nov 06 13:11:17 user nova-compute[74821]:     <acpi/>
Nov 06 13:11:17 user nova-compute[74821]:     <apic/>
Nov 06 13:11:17 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:11:17 user nova-compute[74821]:   </features>
Nov 06 13:11:17 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:11:17 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:11:17 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:11:17 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:11:17 user nova-compute[74821]:   </clock>
Nov 06 13:11:17 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:11:17 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:11:17 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:11:17 user nova-compute[74821]:   </cpu>
Nov 06 13:11:17 user nova-compute[74821]:   <devices>
Nov 06 13:11:17 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:11:17 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:11:17 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/49d05da1-3222-4f9f-b792-8f3d1f0f2890/disk"/>
Nov 06 13:11:17 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:11:17 user nova-compute[74821]:     </disk>
Nov 06 13:11:17 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:11:17 user nova-compute[74821]:       <mac address="fa:16:3e:17:16:45"/>
Nov 06 13:11:17 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:11:17 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:11:17 user nova-compute[74821]:       <target dev="tap95f3755e-a0"/>
Nov 06 13:11:17 user nova-compute[74821]:     </interface>
Nov 06 13:11:17 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:11:17 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/49d05da1-3222-4f9f-b792-8f3d1f0f2890/console.log" append="off"/>
Nov 06 13:11:17 user nova-compute[74821]:     </serial>
Nov 06 13:11:17 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:11:17 user nova-compute[74821]:     <video>
Nov 06 13:11:17 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:11:17 user nova-compute[74821]:     </video>
Nov 06 13:11:17 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:11:17 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:11:17 user nova-compute[74821]:     </rng>
Nov 06 13:11:17 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:11:17 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:11:17 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:11:17 user nova-compute[74821]:     </memballoon>
Nov 06 13:11:17 user nova-compute[74821]:   </devices>
Nov 06 13:11:17 user nova-compute[74821]: </domain>
Nov 06 13:11:17 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:11:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-44820582',display_name='tempest-VolumesAssistedSnapshotsTest-server-44820582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-44820582',id=7,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGykxPk1R3HA6WWcirlGAsfFCUETlNBorgDQQCdmarhiY0uUTSQJgGZlpf64teD+FzlPPj+DxqUwuEY3C1tl7Ne9Uap3YNtrlV9iGgYZkoqiH+HjyONcmDq5eU5busLMBA==',key_name='tempest-keypair-1466119120',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0afa9994148b4f9698f0a9cc7c8d1a5a',ramdisk_id='',reservation_id='r-kg2nfmfx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1134855026',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1134855026-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:11:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45a26f79e64944a196c66276feeb30e8',uuid=49d05da1-3222-4f9f-b792-8f3d1f0f2890,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95f3755e-a074-4956-ba1d-5c05945bcff5", "address": "fa:16:3e:17:16:45", "network": {"id": "feb774a4-8d45-4814-bc23-169b2b378e48", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-639136774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0afa9994148b4f9698f0a9cc7c8d1a5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f3755e-a0", "ovs_interfaceid": "95f3755e-a074-4956-ba1d-5c05945bcff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Converting VIF {"id": "95f3755e-a074-4956-ba1d-5c05945bcff5", "address": "fa:16:3e:17:16:45", "network": {"id": "feb774a4-8d45-4814-bc23-169b2b378e48", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-639136774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0afa9994148b4f9698f0a9cc7c8d1a5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f3755e-a0", "ovs_interfaceid": "95f3755e-a074-4956-ba1d-5c05945bcff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:16:45,bridge_name='br-int',has_traffic_filtering=True,id=95f3755e-a074-4956-ba1d-5c05945bcff5,network=Network(feb774a4-8d45-4814-bc23-169b2b378e48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f3755e-a0') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG os_vif [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:16:45,bridge_name='br-int',has_traffic_filtering=True,id=95f3755e-a074-4956-ba1d-5c05945bcff5,network=Network(feb774a4-8d45-4814-bc23-169b2b378e48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f3755e-a0') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5524fe2c-233f-5fda-a9c4-97e9546909af', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95f3755e-a0, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap95f3755e-a0, col_values=(('qos', UUID('636a3bb6-bc00-4d37-a857-0825efcf6bf5')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap95f3755e-a0, col_values=(('external_ids', {'iface-id': '95f3755e-a074-4956-ba1d-5c05945bcff5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:16:45', 'vm-uuid': '49d05da1-3222-4f9f-b792-8f3d1f0f2890'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:17 user nova-compute[74821]: INFO os_vif [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:16:45,bridge_name='br-int',has_traffic_filtering=True,id=95f3755e-a074-4956-ba1d-5c05945bcff5,network=Network(feb774a4-8d45-4814-bc23-169b2b378e48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f3755e-a0')
Nov 06 13:11:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:11:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] No VIF found with MAC fa:16:3e:17:16:45, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:11:18 user nova-compute[74821]: DEBUG nova.network.neutron [req-c3d43107-093f-4f4f-9d68-92e8fe69a3fb req-f379d92c-a1c7-49f3-862c-2ea640a0f0ec service nova] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Updated VIF entry in instance network info cache for port 95f3755e-a074-4956-ba1d-5c05945bcff5. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:11:18 user nova-compute[74821]: DEBUG nova.network.neutron [req-c3d43107-093f-4f4f-9d68-92e8fe69a3fb req-f379d92c-a1c7-49f3-862c-2ea640a0f0ec service nova] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Updating instance_info_cache with network_info: [{"id": "95f3755e-a074-4956-ba1d-5c05945bcff5", "address": "fa:16:3e:17:16:45", "network": {"id": "feb774a4-8d45-4814-bc23-169b2b378e48", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-639136774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0afa9994148b4f9698f0a9cc7c8d1a5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f3755e-a0", "ovs_interfaceid": "95f3755e-a074-4956-ba1d-5c05945bcff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:11:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c3d43107-093f-4f4f-9d68-92e8fe69a3fb req-f379d92c-a1c7-49f3-862c-2ea640a0f0ec service nova] Releasing lock "refresh_cache-49d05da1-3222-4f9f-b792-8f3d1f0f2890" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:11:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:19 user nova-compute[74821]: DEBUG nova.compute.manager [req-42d16ec1-194d-424a-94f0-c90987261810 req-eefc39f8-c5b7-47ab-b8d6-1faf06d4edb8 service nova] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Received event network-vif-plugged-95f3755e-a074-4956-ba1d-5c05945bcff5 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:11:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-42d16ec1-194d-424a-94f0-c90987261810 req-eefc39f8-c5b7-47ab-b8d6-1faf06d4edb8 service nova] Acquiring lock "49d05da1-3222-4f9f-b792-8f3d1f0f2890-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:11:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-42d16ec1-194d-424a-94f0-c90987261810 req-eefc39f8-c5b7-47ab-b8d6-1faf06d4edb8 service nova] Lock "49d05da1-3222-4f9f-b792-8f3d1f0f2890-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:11:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-42d16ec1-194d-424a-94f0-c90987261810 req-eefc39f8-c5b7-47ab-b8d6-1faf06d4edb8 service nova] Lock "49d05da1-3222-4f9f-b792-8f3d1f0f2890-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:11:19 user nova-compute[74821]: DEBUG nova.compute.manager [req-42d16ec1-194d-424a-94f0-c90987261810 req-eefc39f8-c5b7-47ab-b8d6-1faf06d4edb8 service nova] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] No waiting events found dispatching network-vif-plugged-95f3755e-a074-4956-ba1d-5c05945bcff5 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:11:19 user nova-compute[74821]: WARNING nova.compute.manager [req-42d16ec1-194d-424a-94f0-c90987261810 req-eefc39f8-c5b7-47ab-b8d6-1faf06d4edb8 service nova] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Received unexpected event network-vif-plugged-95f3755e-a074-4956-ba1d-5c05945bcff5 for instance with vm_state building and task_state spawning.
Nov 06 13:11:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:20 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:20 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:20 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:11:20 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Cleaning up deleted instances {{(pid=74821) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 13:11:20 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] There are 0 instances to clean {{(pid=74821) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 13:11:20 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:11:20 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Cleaning up deleted instances with incomplete migration  {{(pid=74821) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 13:11:21 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:11:21 user nova-compute[74821]: DEBUG nova.compute.manager [req-1a8894b3-ae9c-4bb0-ba5c-c91bb4b9a9d6 req-2e872468-dce9-4f30-b483-fe36e542e299 service nova] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Received event network-vif-plugged-95f3755e-a074-4956-ba1d-5c05945bcff5 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:11:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1a8894b3-ae9c-4bb0-ba5c-c91bb4b9a9d6 req-2e872468-dce9-4f30-b483-fe36e542e299 service nova] Acquiring lock "49d05da1-3222-4f9f-b792-8f3d1f0f2890-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:11:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1a8894b3-ae9c-4bb0-ba5c-c91bb4b9a9d6 req-2e872468-dce9-4f30-b483-fe36e542e299 service nova] Lock "49d05da1-3222-4f9f-b792-8f3d1f0f2890-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:11:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1a8894b3-ae9c-4bb0-ba5c-c91bb4b9a9d6 req-2e872468-dce9-4f30-b483-fe36e542e299 service nova] Lock "49d05da1-3222-4f9f-b792-8f3d1f0f2890-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:11:21 user nova-compute[74821]: DEBUG nova.compute.manager [req-1a8894b3-ae9c-4bb0-ba5c-c91bb4b9a9d6 req-2e872468-dce9-4f30-b483-fe36e542e299 service nova] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] No waiting events found dispatching network-vif-plugged-95f3755e-a074-4956-ba1d-5c05945bcff5 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:11:21 user nova-compute[74821]: WARNING nova.compute.manager [req-1a8894b3-ae9c-4bb0-ba5c-c91bb4b9a9d6 req-2e872468-dce9-4f30-b483-fe36e542e299 service nova] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Received unexpected event network-vif-plugged-95f3755e-a074-4956-ba1d-5c05945bcff5 for instance with vm_state building and task_state spawning.
Nov 06 13:11:21 user nova-compute[74821]: DEBUG nova.compute.manager [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:11:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:11:21 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Instance spawned successfully.
Nov 06 13:11:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:11:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:11:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:11:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:11:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:11:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:11:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:11:22 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:11:22 user nova-compute[74821]: INFO nova.compute.manager [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Took 6.70 seconds to spawn the instance on the hypervisor.
Nov 06 13:11:22 user nova-compute[74821]: DEBUG nova.compute.manager [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:11:22 user nova-compute[74821]: INFO nova.compute.manager [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Took 7.70 seconds to build instance.
Nov 06 13:11:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b2d255ec-2d7a-4784-a20b-8809ad579e57 tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Lock "49d05da1-3222-4f9f-b792-8f3d1f0f2890" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.977s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:11:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Acquiring lock "c47906a7-93b9-4527-9318-ed4df54afff6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:11:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Lock "c47906a7-93b9-4527-9318-ed4df54afff6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:11:23 user nova-compute[74821]: DEBUG nova.compute.manager [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:11:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:11:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:11:23 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:11:23 user nova-compute[74821]: INFO nova.compute.claims [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Claim successful on node user
Nov 06 13:11:23 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:11:23 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:11:23 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:11:23 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Rebuilding the list of instances to heal {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 13:11:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-3e21d005-f190-478a-a911-e483e1235057" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:11:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-3e21d005-f190-478a-a911-e483e1235057" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:11:24 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 3e21d005-f190-478a-a911-e483e1235057] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:11:24 user nova-compute[74821]: DEBUG nova.objects.instance [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lazy-loading 'info_cache' on Instance uuid 3e21d005-f190-478a-a911-e483e1235057 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:11:24 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:11:24 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:11:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:11:24 user nova-compute[74821]: DEBUG nova.compute.manager [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:11:24 user nova-compute[74821]: DEBUG nova.compute.manager [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:11:24 user nova-compute[74821]: DEBUG nova.network.neutron [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:11:24 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:11:24 user nova-compute[74821]: DEBUG nova.compute.manager [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:11:24 user nova-compute[74821]: DEBUG nova.compute.manager [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:11:24 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:11:24 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Creating image(s)
Nov 06 13:11:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Acquiring lock "/opt/stack/data/nova/instances/c47906a7-93b9-4527-9318-ed4df54afff6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:11:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Lock "/opt/stack/data/nova/instances/c47906a7-93b9-4527-9318-ed4df54afff6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:11:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Lock "/opt/stack/data/nova/instances/c47906a7-93b9-4527-9318-ed4df54afff6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:11:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:24 user nova-compute[74821]: DEBUG nova.policy [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f087e77432243e09a35d81a7842450e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1004b6aba94b461cb1a149c3c8f6fa4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:11:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.218s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:11:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:11:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:11:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:25 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.186s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:11:25 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/c47906a7-93b9-4527-9318-ed4df54afff6/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:25 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/c47906a7-93b9-4527-9318-ed4df54afff6/disk 1073741824" returned: 0 in 0.155s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:11:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.348s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:11:25 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:25 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 3e21d005-f190-478a-a911-e483e1235057] Updating instance_info_cache with network_info: [{"id": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "address": "fa:16:3e:e0:fc:40", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6fb684-24", "ovs_interfaceid": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:11:25 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.243s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:11:25 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c47906a7-93b9-4527-9318-ed4df54afff6/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:11:25 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47906a7-93b9-4527-9318-ed4df54afff6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-3e21d005-f190-478a-a911-e483e1235057" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:11:25 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 3e21d005-f190-478a-a911-e483e1235057] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:11:25 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:11:25 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:11:25 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:11:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:11:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:11:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:11:25 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:11:25 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47906a7-93b9-4527-9318-ed4df54afff6/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:11:25 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Cannot resize image /opt/stack/data/nova/instances/c47906a7-93b9-4527-9318-ed4df54afff6/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:11:25 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:11:25 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Ensure instance console log exists: /opt/stack/data/nova/instances/c47906a7-93b9-4527-9318-ed4df54afff6/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:11:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:11:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:11:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:11:25 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49d05da1-3222-4f9f-b792-8f3d1f0f2890/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49d05da1-3222-4f9f-b792-8f3d1f0f2890/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:11:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49d05da1-3222-4f9f-b792-8f3d1f0f2890/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:26 user nova-compute[74821]: DEBUG nova.network.neutron [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Successfully created port: e1111ad3-3eff-4594-bbf4-37026e6059c9 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:11:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49d05da1-3222-4f9f-b792-8f3d1f0f2890/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:11:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ccb546-94c4-482c-8017-852cd42999fe/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ccb546-94c4-482c-8017-852cd42999fe/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:11:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ccb546-94c4-482c-8017-852cd42999fe/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ccb546-94c4-482c-8017-852cd42999fe/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:11:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b373e1-f872-4263-808c-ce5fbddf907c/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:26 user nova-compute[74821]: DEBUG nova.network.neutron [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Successfully updated port: e1111ad3-3eff-4594-bbf4-37026e6059c9 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:11:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Acquiring lock "refresh_cache-c47906a7-93b9-4527-9318-ed4df54afff6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:11:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Acquired lock "refresh_cache-c47906a7-93b9-4527-9318-ed4df54afff6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:11:26 user nova-compute[74821]: DEBUG nova.network.neutron [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:11:26 user nova-compute[74821]: DEBUG nova.compute.manager [req-486f4cbf-c343-41f3-bb45-a4f88d0055cf req-bb6e2843-65f1-480b-a774-df080ac6e834 service nova] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Received event network-changed-e1111ad3-3eff-4594-bbf4-37026e6059c9 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:11:26 user nova-compute[74821]: DEBUG nova.compute.manager [req-486f4cbf-c343-41f3-bb45-a4f88d0055cf req-bb6e2843-65f1-480b-a774-df080ac6e834 service nova] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Refreshing instance network info cache due to event network-changed-e1111ad3-3eff-4594-bbf4-37026e6059c9. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:11:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-486f4cbf-c343-41f3-bb45-a4f88d0055cf req-bb6e2843-65f1-480b-a774-df080ac6e834 service nova] Acquiring lock "refresh_cache-c47906a7-93b9-4527-9318-ed4df54afff6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:11:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b373e1-f872-4263-808c-ce5fbddf907c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:11:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b373e1-f872-4263-808c-ce5fbddf907c/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b373e1-f872-4263-808c-ce5fbddf907c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG nova.network.neutron [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG nova.network.neutron [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Updating instance_info_cache with network_info: [{"id": "e1111ad3-3eff-4594-bbf4-37026e6059c9", "address": "fa:16:3e:16:c8:6f", "network": {"id": "26d82cf9-953f-492e-94b7-ecb500ddaaff", "bridge": "br-int", "label": "tempest-TestVolumeSwap-378439802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1004b6aba94b461cb1a149c3c8f6fa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1111ad3-3e", "ovs_interfaceid": "e1111ad3-3eff-4594-bbf4-37026e6059c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Releasing lock "refresh_cache-c47906a7-93b9-4527-9318-ed4df54afff6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG nova.compute.manager [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Instance network_info: |[{"id": "e1111ad3-3eff-4594-bbf4-37026e6059c9", "address": "fa:16:3e:16:c8:6f", "network": {"id": "26d82cf9-953f-492e-94b7-ecb500ddaaff", "bridge": "br-int", "label": "tempest-TestVolumeSwap-378439802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1004b6aba94b461cb1a149c3c8f6fa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1111ad3-3e", "ovs_interfaceid": "e1111ad3-3eff-4594-bbf4-37026e6059c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-486f4cbf-c343-41f3-bb45-a4f88d0055cf req-bb6e2843-65f1-480b-a774-df080ac6e834 service nova] Acquired lock "refresh_cache-c47906a7-93b9-4527-9318-ed4df54afff6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG nova.network.neutron [req-486f4cbf-c343-41f3-bb45-a4f88d0055cf req-bb6e2843-65f1-480b-a774-df080ac6e834 service nova] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Refreshing network info cache for port e1111ad3-3eff-4594-bbf4-37026e6059c9 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Start _get_guest_xml network_info=[{"id": "e1111ad3-3eff-4594-bbf4-37026e6059c9", "address": "fa:16:3e:16:c8:6f", "network": {"id": "26d82cf9-953f-492e-94b7-ecb500ddaaff", "bridge": "br-int", "label": "tempest-TestVolumeSwap-378439802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1004b6aba94b461cb1a149c3c8f6fa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1111ad3-3e", "ovs_interfaceid": "e1111ad3-3eff-4594-bbf4-37026e6059c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:11:27 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:11:27 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:11:27 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:11:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1705737860',display_name='tempest-TestVolumeSwap-server-1705737860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1705737860',id=8,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwzIGQkiaBcOabZ1GuF11VSMTDR75I4d2JH8P9U+CgjRKP9VtCotLgyifGIp6KTUCcmnIZXx3CUh8O3hgxsEsuBACwGyp9yUiVCl5ib2Mz5WaxyP/GfEY3jbYyzLOr5dQ==',key_name='tempest-keypair-1160391700',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1004b6aba94b461cb1a149c3c8f6fa4f',ramdisk_id='',reservation_id='r-6243a8ve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-529794034',owner_user_name='tempest-TestVolumeSwap-529794034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:11:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f087e77432243e09a35d81a7842450e',uuid=c47906a7-93b9-4527-9318-ed4df54afff6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1111ad3-3eff-4594-bbf4-37026e6059c9", "address": "fa:16:3e:16:c8:6f", "network": {"id": "26d82cf9-953f-492e-94b7-ecb500ddaaff", "bridge": "br-int", "label": "tempest-TestVolumeSwap-378439802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1004b6aba94b461cb1a149c3c8f6fa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1111ad3-3e", "ovs_interfaceid": "e1111ad3-3eff-4594-bbf4-37026e6059c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Converting VIF {"id": "e1111ad3-3eff-4594-bbf4-37026e6059c9", "address": "fa:16:3e:16:c8:6f", "network": {"id": "26d82cf9-953f-492e-94b7-ecb500ddaaff", "bridge": "br-int", "label": "tempest-TestVolumeSwap-378439802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1004b6aba94b461cb1a149c3c8f6fa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1111ad3-3e", "ovs_interfaceid": "e1111ad3-3eff-4594-bbf4-37026e6059c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:c8:6f,bridge_name='br-int',has_traffic_filtering=True,id=e1111ad3-3eff-4594-bbf4-37026e6059c9,network=Network(26d82cf9-953f-492e-94b7-ecb500ddaaff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1111ad3-3e') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG nova.objects.instance [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Lazy-loading 'pci_devices' on Instance uuid c47906a7-93b9-4527-9318-ed4df54afff6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:11:27 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:11:27 user nova-compute[74821]:   <uuid>c47906a7-93b9-4527-9318-ed4df54afff6</uuid>
Nov 06 13:11:27 user nova-compute[74821]:   <name>instance-00000008</name>
Nov 06 13:11:27 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:11:27 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:11:27 user nova-compute[74821]:   <metadata>
Nov 06 13:11:27 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:11:27 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:11:27 user nova-compute[74821]:       <nova:name>tempest-TestVolumeSwap-server-1705737860</nova:name>
Nov 06 13:11:27 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:11:27</nova:creationTime>
Nov 06 13:11:27 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:11:27 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:11:27 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:11:27 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:11:27 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:11:27 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:11:27 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:11:27 user nova-compute[74821]:       <nova:owner>
Nov 06 13:11:27 user nova-compute[74821]:         <nova:user uuid="9f087e77432243e09a35d81a7842450e">tempest-TestVolumeSwap-529794034-project-member</nova:user>
Nov 06 13:11:27 user nova-compute[74821]:         <nova:project uuid="1004b6aba94b461cb1a149c3c8f6fa4f">tempest-TestVolumeSwap-529794034</nova:project>
Nov 06 13:11:27 user nova-compute[74821]:       </nova:owner>
Nov 06 13:11:27 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:11:27 user nova-compute[74821]:       <nova:ports>
Nov 06 13:11:27 user nova-compute[74821]:         <nova:port uuid="e1111ad3-3eff-4594-bbf4-37026e6059c9">
Nov 06 13:11:27 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 13:11:27 user nova-compute[74821]:         </nova:port>
Nov 06 13:11:27 user nova-compute[74821]:       </nova:ports>
Nov 06 13:11:27 user nova-compute[74821]:     </nova:instance>
Nov 06 13:11:27 user nova-compute[74821]:   </metadata>
Nov 06 13:11:27 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:11:27 user nova-compute[74821]:     <system>
Nov 06 13:11:27 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:11:27 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:11:27 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:11:27 user nova-compute[74821]:       <entry name="serial">c47906a7-93b9-4527-9318-ed4df54afff6</entry>
Nov 06 13:11:27 user nova-compute[74821]:       <entry name="uuid">c47906a7-93b9-4527-9318-ed4df54afff6</entry>
Nov 06 13:11:27 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:11:27 user nova-compute[74821]:     </system>
Nov 06 13:11:27 user nova-compute[74821]:   </sysinfo>
Nov 06 13:11:27 user nova-compute[74821]:   <os>
Nov 06 13:11:27 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:11:27 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:11:27 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:11:27 user nova-compute[74821]:   </os>
Nov 06 13:11:27 user nova-compute[74821]:   <features>
Nov 06 13:11:27 user nova-compute[74821]:     <acpi/>
Nov 06 13:11:27 user nova-compute[74821]:     <apic/>
Nov 06 13:11:27 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:11:27 user nova-compute[74821]:   </features>
Nov 06 13:11:27 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:11:27 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:11:27 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:11:27 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:11:27 user nova-compute[74821]:   </clock>
Nov 06 13:11:27 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:11:27 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:11:27 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:11:27 user nova-compute[74821]:   </cpu>
Nov 06 13:11:27 user nova-compute[74821]:   <devices>
Nov 06 13:11:27 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:11:27 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:11:27 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/c47906a7-93b9-4527-9318-ed4df54afff6/disk"/>
Nov 06 13:11:27 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:11:27 user nova-compute[74821]:     </disk>
Nov 06 13:11:27 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:11:27 user nova-compute[74821]:       <mac address="fa:16:3e:16:c8:6f"/>
Nov 06 13:11:27 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:11:27 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:11:27 user nova-compute[74821]:       <target dev="tape1111ad3-3e"/>
Nov 06 13:11:27 user nova-compute[74821]:     </interface>
Nov 06 13:11:27 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:11:27 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/c47906a7-93b9-4527-9318-ed4df54afff6/console.log" append="off"/>
Nov 06 13:11:27 user nova-compute[74821]:     </serial>
Nov 06 13:11:27 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:11:27 user nova-compute[74821]:     <video>
Nov 06 13:11:27 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:11:27 user nova-compute[74821]:     </video>
Nov 06 13:11:27 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:11:27 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:11:27 user nova-compute[74821]:     </rng>
Nov 06 13:11:27 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:11:27 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:11:27 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:11:27 user nova-compute[74821]:     </memballoon>
Nov 06 13:11:27 user nova-compute[74821]:   </devices>
Nov 06 13:11:27 user nova-compute[74821]: </domain>
Nov 06 13:11:27 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:11:28 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:11:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1705737860',display_name='tempest-TestVolumeSwap-server-1705737860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1705737860',id=8,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwzIGQkiaBcOabZ1GuF11VSMTDR75I4d2JH8P9U+CgjRKP9VtCotLgyifGIp6KTUCcmnIZXx3CUh8O3hgxsEsuBACwGyp9yUiVCl5ib2Mz5WaxyP/GfEY3jbYyzLOr5dQ==',key_name='tempest-keypair-1160391700',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1004b6aba94b461cb1a149c3c8f6fa4f',ramdisk_id='',reservation_id='r-6243a8ve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-529794034',owner_user_name='tempest-TestVolumeSwap-529794034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:11:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f087e77432243e09a35d81a7842450e',uuid=c47906a7-93b9-4527-9318-ed4df54afff6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1111ad3-3eff-4594-bbf4-37026e6059c9", "address": "fa:16:3e:16:c8:6f", "network": {"id": "26d82cf9-953f-492e-94b7-ecb500ddaaff", "bridge": "br-int", "label": "tempest-TestVolumeSwap-378439802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1004b6aba94b461cb1a149c3c8f6fa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1111ad3-3e", "ovs_interfaceid": "e1111ad3-3eff-4594-bbf4-37026e6059c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:11:28 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Converting VIF {"id": "e1111ad3-3eff-4594-bbf4-37026e6059c9", "address": "fa:16:3e:16:c8:6f", "network": {"id": "26d82cf9-953f-492e-94b7-ecb500ddaaff", "bridge": "br-int", "label": "tempest-TestVolumeSwap-378439802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1004b6aba94b461cb1a149c3c8f6fa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1111ad3-3e", "ovs_interfaceid": "e1111ad3-3eff-4594-bbf4-37026e6059c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:11:28 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:c8:6f,bridge_name='br-int',has_traffic_filtering=True,id=e1111ad3-3eff-4594-bbf4-37026e6059c9,network=Network(26d82cf9-953f-492e-94b7-ecb500ddaaff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1111ad3-3e') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:11:28 user nova-compute[74821]: DEBUG os_vif [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:c8:6f,bridge_name='br-int',has_traffic_filtering=True,id=e1111ad3-3eff-4594-bbf4-37026e6059c9,network=Network(26d82cf9-953f-492e-94b7-ecb500ddaaff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1111ad3-3e') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:11:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:11:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:11:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '821a1af0-9e89-55aa-9d3f-ada32a3dfdda', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:11:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:11:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1111ad3-3e, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:11:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape1111ad3-3e, col_values=(('qos', UUID('84b35ea7-35f0-4956-8bbb-f9ec98d083cd')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:11:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape1111ad3-3e, col_values=(('external_ids', {'iface-id': 'e1111ad3-3eff-4594-bbf4-37026e6059c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:c8:6f', 'vm-uuid': 'c47906a7-93b9-4527-9318-ed4df54afff6'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:11:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:11:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:28 user nova-compute[74821]: INFO os_vif [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:c8:6f,bridge_name='br-int',has_traffic_filtering=True,id=e1111ad3-3eff-4594-bbf4-37026e6059c9,network=Network(26d82cf9-953f-492e-94b7-ecb500ddaaff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1111ad3-3e')
Nov 06 13:11:28 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:11:28 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] No VIF found with MAC fa:16:3e:16:c8:6f, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:11:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:11:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:28 user nova-compute[74821]: DEBUG nova.network.neutron [req-486f4cbf-c343-41f3-bb45-a4f88d0055cf req-bb6e2843-65f1-480b-a774-df080ac6e834 service nova] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Updated VIF entry in instance network info cache for port e1111ad3-3eff-4594-bbf4-37026e6059c9. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:11:28 user nova-compute[74821]: DEBUG nova.network.neutron [req-486f4cbf-c343-41f3-bb45-a4f88d0055cf req-bb6e2843-65f1-480b-a774-df080ac6e834 service nova] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Updating instance_info_cache with network_info: [{"id": "e1111ad3-3eff-4594-bbf4-37026e6059c9", "address": "fa:16:3e:16:c8:6f", "network": {"id": "26d82cf9-953f-492e-94b7-ecb500ddaaff", "bridge": "br-int", "label": "tempest-TestVolumeSwap-378439802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1004b6aba94b461cb1a149c3c8f6fa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1111ad3-3e", "ovs_interfaceid": "e1111ad3-3eff-4594-bbf4-37026e6059c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:11:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:11:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-486f4cbf-c343-41f3-bb45-a4f88d0055cf req-bb6e2843-65f1-480b-a774-df080ac6e834 service nova] Releasing lock "refresh_cache-c47906a7-93b9-4527-9318-ed4df54afff6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:11:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:11:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:11:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:32 user nova-compute[74821]: DEBUG nova.compute.manager [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:11:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:11:32 user nova-compute[74821]: DEBUG nova.compute.manager [req-1e7ac5cb-2539-4c33-abf6-825409d2c40c req-927b7267-6389-49c0-822f-de9ecbab1dd3 service nova] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Received event network-vif-plugged-e1111ad3-3eff-4594-bbf4-37026e6059c9 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:11:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1e7ac5cb-2539-4c33-abf6-825409d2c40c req-927b7267-6389-49c0-822f-de9ecbab1dd3 service nova] Acquiring lock "c47906a7-93b9-4527-9318-ed4df54afff6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:11:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1e7ac5cb-2539-4c33-abf6-825409d2c40c req-927b7267-6389-49c0-822f-de9ecbab1dd3 service nova] Lock "c47906a7-93b9-4527-9318-ed4df54afff6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:11:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1e7ac5cb-2539-4c33-abf6-825409d2c40c req-927b7267-6389-49c0-822f-de9ecbab1dd3 service nova] Lock "c47906a7-93b9-4527-9318-ed4df54afff6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:11:32 user nova-compute[74821]: DEBUG nova.compute.manager [req-1e7ac5cb-2539-4c33-abf6-825409d2c40c req-927b7267-6389-49c0-822f-de9ecbab1dd3 service nova] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] No waiting events found dispatching network-vif-plugged-e1111ad3-3eff-4594-bbf4-37026e6059c9 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:11:32 user nova-compute[74821]: WARNING nova.compute.manager [req-1e7ac5cb-2539-4c33-abf6-825409d2c40c req-927b7267-6389-49c0-822f-de9ecbab1dd3 service nova] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Received unexpected event network-vif-plugged-e1111ad3-3eff-4594-bbf4-37026e6059c9 for instance with vm_state building and task_state spawning.
Nov 06 13:11:32 user nova-compute[74821]: DEBUG nova.compute.manager [req-5e4fedbe-a34c-4d30-a403-4d4a87025550 req-b91ddb37-ea51-4cdd-8aa6-c3bba789b35e service nova] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Received event network-vif-plugged-e1111ad3-3eff-4594-bbf4-37026e6059c9 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:11:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5e4fedbe-a34c-4d30-a403-4d4a87025550 req-b91ddb37-ea51-4cdd-8aa6-c3bba789b35e service nova] Acquiring lock "c47906a7-93b9-4527-9318-ed4df54afff6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:11:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5e4fedbe-a34c-4d30-a403-4d4a87025550 req-b91ddb37-ea51-4cdd-8aa6-c3bba789b35e service nova] Lock "c47906a7-93b9-4527-9318-ed4df54afff6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:11:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5e4fedbe-a34c-4d30-a403-4d4a87025550 req-b91ddb37-ea51-4cdd-8aa6-c3bba789b35e service nova] Lock "c47906a7-93b9-4527-9318-ed4df54afff6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:11:32 user nova-compute[74821]: DEBUG nova.compute.manager [req-5e4fedbe-a34c-4d30-a403-4d4a87025550 req-b91ddb37-ea51-4cdd-8aa6-c3bba789b35e service nova] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] No waiting events found dispatching network-vif-plugged-e1111ad3-3eff-4594-bbf4-37026e6059c9 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:11:32 user nova-compute[74821]: WARNING nova.compute.manager [req-5e4fedbe-a34c-4d30-a403-4d4a87025550 req-b91ddb37-ea51-4cdd-8aa6-c3bba789b35e service nova] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Received unexpected event network-vif-plugged-e1111ad3-3eff-4594-bbf4-37026e6059c9 for instance with vm_state building and task_state spawning.
Nov 06 13:11:32 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:11:32 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:11:32 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=7857MB free_disk=25.700695037841797GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:11:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:11:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:11:32 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Instance spawned successfully.
Nov 06 13:11:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:11:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:11:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:11:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:11:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:11:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:11:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:11:32 user nova-compute[74821]: INFO nova.compute.manager [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Took 7.85 seconds to spawn the instance on the hypervisor.
Nov 06 13:11:32 user nova-compute[74821]: DEBUG nova.compute.manager [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:11:32 user nova-compute[74821]: INFO nova.compute.manager [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Took 8.77 seconds to build instance.
Nov 06 13:11:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3258d036-2cba-423f-9d4d-2fc8ffa9fea6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Lock "c47906a7-93b9-4527-9318-ed4df54afff6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.939s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:11:32 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 3e21d005-f190-478a-a911-e483e1235057 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:11:32 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 311817c5-7b08-4da9-98eb-c685f37e6fd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:11:32 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance f8c537c6-fa3e-4842-9471-7258a22c01f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:11:32 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance a2b373e1-f872-4263-808c-ce5fbddf907c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:11:32 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 5a715806-ff8b-4502-8435-c5de3e3c688a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:11:32 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 86ccb546-94c4-482c-8017-852cd42999fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:11:32 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 49d05da1-3222-4f9f-b792-8f3d1f0f2890 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:11:32 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance c47906a7-93b9-4527-9318-ed4df54afff6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:11:32 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:11:32 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:11:32 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Refreshing inventories for resource provider a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 13:11:32 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Updating ProviderTree inventory for provider a45ec519-15f5-48fe-877b-466db09f8afe from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 13:11:32 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Updating inventory in ProviderTree for provider a45ec519-15f5-48fe-877b-466db09f8afe with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 13:11:32 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Refreshing aggregate associations for resource provider a45ec519-15f5-48fe-877b-466db09f8afe, aggregates: None {{(pid=74821) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 13:11:32 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Refreshing trait associations for resource provider a45ec519-15f5-48fe-877b-466db09f8afe, traits: COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42 {{(pid=74821) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 13:11:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:33 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:11:33 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:11:33 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:11:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.883s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:11:33 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:11:33 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:11:33 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:11:33 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:11:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:43 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:43 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:48 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:48 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Acquiring lock "ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:11:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Lock "ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:11:52 user nova-compute[74821]: DEBUG nova.compute.manager [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:11:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:11:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:11:52 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:11:52 user nova-compute[74821]: INFO nova.compute.claims [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Claim successful on node user
Nov 06 13:11:53 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:53 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:11:53 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:11:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.501s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:11:53 user nova-compute[74821]: DEBUG nova.compute.manager [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:11:53 user nova-compute[74821]: DEBUG nova.compute.manager [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:11:53 user nova-compute[74821]: DEBUG nova.network.neutron [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:11:53 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:11:53 user nova-compute[74821]: DEBUG nova.compute.manager [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:11:53 user nova-compute[74821]: INFO nova.virt.block_device [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Booting with volume e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f at /dev/vda
Nov 06 13:11:53 user nova-compute[74821]: DEBUG nova.policy [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be36fa52c6ef4c5bab9841e42eb16a16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1448bac90e444d38a97183dba44c98de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:11:53 user nova-compute[74821]: DEBUG os_brick.utils [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:11:53 user nova-compute[74821]: INFO oslo.privsep.daemon [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpqy4db1jj/privsep.sock']
Nov 06 13:11:53 user sudo[85813]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpqy4db1jj/privsep.sock
Nov 06 13:11:53 user sudo[85813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 06 13:11:53 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:54 user nova-compute[74821]: DEBUG nova.network.neutron [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Successfully created port: bbfa9945-6317-4b90-880f-23ee3eefafc1 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:11:54 user nova-compute[74821]: DEBUG nova.network.neutron [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Successfully updated port: bbfa9945-6317-4b90-880f-23ee3eefafc1 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:11:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Acquiring lock "refresh_cache-ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:11:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Acquired lock "refresh_cache-ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:11:54 user nova-compute[74821]: DEBUG nova.network.neutron [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:11:54 user nova-compute[74821]: DEBUG nova.compute.manager [req-4a123383-d655-447f-bce5-d556f63faa20 req-d3f5e141-712a-4211-81c9-8aaf0385457b service nova] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Received event network-changed-bbfa9945-6317-4b90-880f-23ee3eefafc1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:11:54 user nova-compute[74821]: DEBUG nova.compute.manager [req-4a123383-d655-447f-bce5-d556f63faa20 req-d3f5e141-712a-4211-81c9-8aaf0385457b service nova] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Refreshing instance network info cache due to event network-changed-bbfa9945-6317-4b90-880f-23ee3eefafc1. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:11:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4a123383-d655-447f-bce5-d556f63faa20 req-d3f5e141-712a-4211-81c9-8aaf0385457b service nova] Acquiring lock "refresh_cache-ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:11:54 user nova-compute[74821]: DEBUG nova.network.neutron [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:11:55 user sudo[85813]: pam_unix(sudo:session): session closed for user root
Nov 06 13:11:55 user nova-compute[74821]: INFO oslo.privsep.daemon [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Spawned new privsep daemon via rootwrap
Nov 06 13:11:55 user nova-compute[74821]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 06 13:11:55 user nova-compute[74821]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 06 13:11:55 user nova-compute[74821]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 06 13:11:55 user nova-compute[74821]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85818
Nov 06 13:11:55 user nova-compute[74821]: DEBUG nova.network.neutron [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Updating instance_info_cache with network_info: [{"id": "bbfa9945-6317-4b90-880f-23ee3eefafc1", "address": "fa:16:3e:1b:dd:99", "network": {"id": "028f273f-8e31-4b8e-9662-d0a94d5ea802", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1047617218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1448bac90e444d38a97183dba44c98de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbfa9945-63", "ovs_interfaceid": "bbfa9945-6317-4b90-880f-23ee3eefafc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:11:55 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a428aac9-0bcd-4b90-a737-e6c6776fb2ca]: (2,) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:11:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Releasing lock "refresh_cache-ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:11:55 user nova-compute[74821]: DEBUG nova.compute.manager [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Instance network_info: |[{"id": "bbfa9945-6317-4b90-880f-23ee3eefafc1", "address": "fa:16:3e:1b:dd:99", "network": {"id": "028f273f-8e31-4b8e-9662-d0a94d5ea802", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1047617218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1448bac90e444d38a97183dba44c98de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbfa9945-63", "ovs_interfaceid": "bbfa9945-6317-4b90-880f-23ee3eefafc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:11:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4a123383-d655-447f-bce5-d556f63faa20 req-d3f5e141-712a-4211-81c9-8aaf0385457b service nova] Acquired lock "refresh_cache-ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:11:55 user nova-compute[74821]: DEBUG nova.network.neutron [req-4a123383-d655-447f-bce5-d556f63faa20 req-d3f5e141-712a-4211-81c9-8aaf0385457b service nova] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Refreshing network info cache for port bbfa9945-6317-4b90-880f-23ee3eefafc1 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:11:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:11:55 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdc4432-1e58-463f-8775-f10c13bfa92f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:11:55 user nova-compute[74821]: WARNING os_brick.initiator.connectors.nvmeof [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 06 13:11:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:11:55 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f345ebe-abe8-447f-923e-f65c2548c26a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:11:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:11:55 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[630bfb81-0719-4099-8201-149791eacdb9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:11:55 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[69af2677-6802-4117-b20c-c66dae0e801c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:11:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:11:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:11:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:11:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:11:55 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:11:55 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfb9857-4f77-43aa-b56e-9ce2871d3546]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:11:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:11:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:11:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:11:55 user nova-compute[74821]: DEBUG os_brick.utils [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] <== get_connector_properties: return (1950ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:11:55 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Updating existing volume attachment record: 6bbe482f-7f48-4f17-b83f-9a79db0673bc {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:11:55 user nova-compute[74821]: DEBUG nova.network.neutron [req-4a123383-d655-447f-bce5-d556f63faa20 req-d3f5e141-712a-4211-81c9-8aaf0385457b service nova] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Updated VIF entry in instance network info cache for port bbfa9945-6317-4b90-880f-23ee3eefafc1. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:11:55 user nova-compute[74821]: DEBUG nova.network.neutron [req-4a123383-d655-447f-bce5-d556f63faa20 req-d3f5e141-712a-4211-81c9-8aaf0385457b service nova] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Updating instance_info_cache with network_info: [{"id": "bbfa9945-6317-4b90-880f-23ee3eefafc1", "address": "fa:16:3e:1b:dd:99", "network": {"id": "028f273f-8e31-4b8e-9662-d0a94d5ea802", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1047617218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1448bac90e444d38a97183dba44c98de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbfa9945-63", "ovs_interfaceid": "bbfa9945-6317-4b90-880f-23ee3eefafc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:11:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4a123383-d655-447f-bce5-d556f63faa20 req-d3f5e141-712a-4211-81c9-8aaf0385457b service nova] Releasing lock "refresh_cache-ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:11:58 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:11:58 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:17 user nova-compute[74821]: INFO nova.compute.manager [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Rescuing
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "refresh_cache-311817c5-7b08-4da9-98eb-c685f37e6fd3" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquired lock "refresh_cache-311817c5-7b08-4da9-98eb-c685f37e6fd3" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG nova.network.neutron [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG nova.compute.manager [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:12:17 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Creating image(s)
Nov 06 13:12:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Did not create local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Ensure instance console log exists: /opt/stack/data/nova/instances/ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Start _get_guest_xml network_info=[{"id": "bbfa9945-6317-4b90-880f-23ee3eefafc1", "address": "fa:16:3e:1b:dd:99", "network": {"id": "028f273f-8e31-4b8e-9662-d0a94d5ea802", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1047617218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1448bac90e444d38a97183dba44c98de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbfa9945-63", "ovs_interfaceid": "bbfa9945-6317-4b90-880f-23ee3eefafc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DLjnzvpG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5', 'attached_at': '', 'detached_at': '', 'volume_id': 'e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f', 'serial': 'e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '6bbe482f-7f48-4f17-b83f-9a79db0673bc', 'volume_type': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:12:17 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:12:17 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:12:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG os_brick.initiator.connector [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Factory for ISCSI on None {{(pid=74821) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DLjnzvpG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:12:17 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:12:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:12:17 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:12:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:12:17 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3a0628-b603-4859-ac75-322c697d0182]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:12:17 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76c2cce-3079-40ad-933d-bd321e6c3ade]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f] added
Nov 06 13:12:17 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3764381-82e1-45bb-9e5e-959198350dbb]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7805f1-de20-4a5f-bad7-811466d4faa8]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DLjnzvpG {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DLjnzvpG" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6c48c0-b6ad-40ab-b3ad-d09129b37650]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DLjnzvpG'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b16fa6b-11f4-4ea9-b2b4-bec884c973de]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e5dae9-727e-41f4-baa6-ef65e78ca42a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 06 13:12:17 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 06 13:12:17 user nova-compute[74821]:  {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:12:17 user nova-compute[74821]: WARNING os_brick.initiator.connectors.iscsi [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 06 13:12:17 user nova-compute[74821]: 
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e051aa5c-b12c-4107-9492-22cc81aa9b40]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f, portal: 172.16.0.220,3260]
Nov 06 13:12:17 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f, portal: 172.16.0.220,3260] successful.
Nov 06 13:12:17 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a47e3f-eefc-45ab-8c6e-ee4bd9faafee]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9434b36d-521f-4edb-bc10-dd6d4dde4c22]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f (non-flash)
Nov 06 13:12:17 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f (non-flash)
Nov 06 13:12:17 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf777f5d-90f0-46a6-ad97-dc08f2c1da1d]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DLjnzvpG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG nova.network.neutron [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Updating instance_info_cache with network_info: [{"id": "be99c620-c497-4810-8aac-8793f2b2baa7", "address": "fa:16:3e:2e:e6:6b", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe99c620-c4", "ovs_interfaceid": "be99c620-c497-4810-8aac-8793f2b2baa7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Releasing lock "refresh_cache-311817c5-7b08-4da9-98eb-c685f37e6fd3" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:12:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Acquiring lock "c62c177c-bd96-44f6-bc8d-44131914747b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Lock "c62c177c-bd96-44f6-bc8d-44131914747b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG nova.compute.manager [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG nova.compute.manager [req-87530c57-ef6b-413d-a3b5-5a9c9a45917c req-4b2c6eda-538f-4cd6-abfe-824e8849499d service nova] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Received event network-vif-unplugged-be99c620-c497-4810-8aac-8793f2b2baa7 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-87530c57-ef6b-413d-a3b5-5a9c9a45917c req-4b2c6eda-538f-4cd6-abfe-824e8849499d service nova] Acquiring lock "311817c5-7b08-4da9-98eb-c685f37e6fd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-87530c57-ef6b-413d-a3b5-5a9c9a45917c req-4b2c6eda-538f-4cd6-abfe-824e8849499d service nova] Lock "311817c5-7b08-4da9-98eb-c685f37e6fd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-87530c57-ef6b-413d-a3b5-5a9c9a45917c req-4b2c6eda-538f-4cd6-abfe-824e8849499d service nova] Lock "311817c5-7b08-4da9-98eb-c685f37e6fd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG nova.compute.manager [req-87530c57-ef6b-413d-a3b5-5a9c9a45917c req-4b2c6eda-538f-4cd6-abfe-824e8849499d service nova] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] No waiting events found dispatching network-vif-unplugged-be99c620-c497-4810-8aac-8793f2b2baa7 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:12:18 user nova-compute[74821]: WARNING nova.compute.manager [req-87530c57-ef6b-413d-a3b5-5a9c9a45917c req-4b2c6eda-538f-4cd6-abfe-824e8849499d service nova] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Received unexpected event network-vif-unplugged-be99c620-c497-4810-8aac-8793f2b2baa7 for instance with vm_state active and task_state rescuing.
Nov 06 13:12:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:12:18 user nova-compute[74821]: INFO nova.compute.claims [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Claim successful on node user
Nov 06 13:12:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:18 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Instance destroyed successfully.
Nov 06 13:12:18 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Attempting rescue
Nov 06 13:12:18 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74821) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Instance directory exists: not creating {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 06 13:12:18 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Creating image(s)
Nov 06 13:12:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "/opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "/opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "/opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG nova.objects.instance [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lazy-loading 'trusted_certs' on Instance uuid 311817c5-7b08-4da9-98eb-c685f37e6fd3 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23331396361376432', 'path': '/dev/sdb'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331396361376432', 'path': '/dev/sdb'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:11:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-272403543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-272403543',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYJm0cyElUjil24imeyuGUtyD8RFmEZ21wSS4yaGDzXXrR9VKn5Z9Rvk9M2W47duumtOI552lIs37Yh7wbD5f0dboHXCGJQYXqGlPPG0wo8M+okGKaG9RpC65rRd95e9A==',key_name='tempest-keypair-1379795935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1448bac90e444d38a97183dba44c98de',ramdisk_id='',reservation_id='r-balxag8t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-662359766',owner_user_name='tempest-ServerActionsV293TestJSON-662359766-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:11:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be36fa52c6ef4c5bab9841e42eb16a16',uuid=ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bbfa9945-6317-4b90-880f-23ee3eefafc1", "address": "fa:16:3e:1b:dd:99", "network": {"id": "028f273f-8e31-4b8e-9662-d0a94d5ea802", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1047617218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1448bac90e444d38a97183dba44c98de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbfa9945-63", "ovs_interfaceid": "bbfa9945-6317-4b90-880f-23ee3eefafc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Converting VIF {"id": "bbfa9945-6317-4b90-880f-23ee3eefafc1", "address": "fa:16:3e:1b:dd:99", "network": {"id": "028f273f-8e31-4b8e-9662-d0a94d5ea802", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1047617218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1448bac90e444d38a97183dba44c98de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbfa9945-63", "ovs_interfaceid": "bbfa9945-6317-4b90-880f-23ee3eefafc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:dd:99,bridge_name='br-int',has_traffic_filtering=True,id=bbfa9945-6317-4b90-880f-23ee3eefafc1,network=Network(028f273f-8e31-4b8e-9662-d0a94d5ea802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbfa9945-63') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG nova.objects.instance [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Lazy-loading 'pci_devices' on Instance uuid ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:12:18 user nova-compute[74821]:   <uuid>ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5</uuid>
Nov 06 13:12:18 user nova-compute[74821]:   <name>instance-00000009</name>
Nov 06 13:12:18 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:12:18 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:12:18 user nova-compute[74821]:   <metadata>
Nov 06 13:12:18 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:12:18 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:12:18 user nova-compute[74821]:       <nova:name>tempest-ServerActionsV293TestJSON-server-272403543</nova:name>
Nov 06 13:12:18 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:12:17</nova:creationTime>
Nov 06 13:12:18 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:12:18 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:12:18 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:12:18 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:12:18 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:12:18 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:12:18 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:12:18 user nova-compute[74821]:       <nova:owner>
Nov 06 13:12:18 user nova-compute[74821]:         <nova:user uuid="be36fa52c6ef4c5bab9841e42eb16a16">tempest-ServerActionsV293TestJSON-662359766-project-member</nova:user>
Nov 06 13:12:18 user nova-compute[74821]:         <nova:project uuid="1448bac90e444d38a97183dba44c98de">tempest-ServerActionsV293TestJSON-662359766</nova:project>
Nov 06 13:12:18 user nova-compute[74821]:       </nova:owner>
Nov 06 13:12:18 user nova-compute[74821]:       <nova:ports>
Nov 06 13:12:18 user nova-compute[74821]:         <nova:port uuid="bbfa9945-6317-4b90-880f-23ee3eefafc1">
Nov 06 13:12:18 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 06 13:12:18 user nova-compute[74821]:         </nova:port>
Nov 06 13:12:18 user nova-compute[74821]:       </nova:ports>
Nov 06 13:12:18 user nova-compute[74821]:     </nova:instance>
Nov 06 13:12:18 user nova-compute[74821]:   </metadata>
Nov 06 13:12:18 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:12:18 user nova-compute[74821]:     <system>
Nov 06 13:12:18 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:12:18 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:12:18 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:12:18 user nova-compute[74821]:       <entry name="serial">ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5</entry>
Nov 06 13:12:18 user nova-compute[74821]:       <entry name="uuid">ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5</entry>
Nov 06 13:12:18 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:12:18 user nova-compute[74821]:     </system>
Nov 06 13:12:18 user nova-compute[74821]:   </sysinfo>
Nov 06 13:12:18 user nova-compute[74821]:   <os>
Nov 06 13:12:18 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:12:18 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:12:18 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:12:18 user nova-compute[74821]:   </os>
Nov 06 13:12:18 user nova-compute[74821]:   <features>
Nov 06 13:12:18 user nova-compute[74821]:     <acpi/>
Nov 06 13:12:18 user nova-compute[74821]:     <apic/>
Nov 06 13:12:18 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:12:18 user nova-compute[74821]:   </features>
Nov 06 13:12:18 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:12:18 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:12:18 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:12:18 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:12:18 user nova-compute[74821]:   </clock>
Nov 06 13:12:18 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:12:18 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:12:18 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:12:18 user nova-compute[74821]:   </cpu>
Nov 06 13:12:18 user nova-compute[74821]:   <devices>
Nov 06 13:12:18 user nova-compute[74821]:     <disk type="block" device="disk">
Nov 06 13:12:18 user nova-compute[74821]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:12:18 user nova-compute[74821]:       <source dev="/dev/sdb"/>
Nov 06 13:12:18 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:12:18 user nova-compute[74821]:       <serial>e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f</serial>
Nov 06 13:12:18 user nova-compute[74821]:     </disk>
Nov 06 13:12:18 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:12:18 user nova-compute[74821]:       <mac address="fa:16:3e:1b:dd:99"/>
Nov 06 13:12:18 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:12:18 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:12:18 user nova-compute[74821]:       <target dev="tapbbfa9945-63"/>
Nov 06 13:12:18 user nova-compute[74821]:     </interface>
Nov 06 13:12:18 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:12:18 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5/console.log" append="off"/>
Nov 06 13:12:18 user nova-compute[74821]:     </serial>
Nov 06 13:12:18 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:12:18 user nova-compute[74821]:     <video>
Nov 06 13:12:18 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:12:18 user nova-compute[74821]:     </video>
Nov 06 13:12:18 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:12:18 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:12:18 user nova-compute[74821]:     </rng>
Nov 06 13:12:18 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:12:18 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:12:18 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:12:18 user nova-compute[74821]:     </memballoon>
Nov 06 13:12:18 user nova-compute[74821]:   </devices>
Nov 06 13:12:18 user nova-compute[74821]: </domain>
Nov 06 13:12:18 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:11:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-272403543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-272403543',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYJm0cyElUjil24imeyuGUtyD8RFmEZ21wSS4yaGDzXXrR9VKn5Z9Rvk9M2W47duumtOI552lIs37Yh7wbD5f0dboHXCGJQYXqGlPPG0wo8M+okGKaG9RpC65rRd95e9A==',key_name='tempest-keypair-1379795935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1448bac90e444d38a97183dba44c98de',ramdisk_id='',reservation_id='r-balxag8t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-662359766',owner_user_name='tempest-ServerActionsV293TestJSON-662359766-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:11:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be36fa52c6ef4c5bab9841e42eb16a16',uuid=ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bbfa9945-6317-4b90-880f-23ee3eefafc1", "address": "fa:16:3e:1b:dd:99", "network": {"id": "028f273f-8e31-4b8e-9662-d0a94d5ea802", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1047617218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1448bac90e444d38a97183dba44c98de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbfa9945-63", "ovs_interfaceid": "bbfa9945-6317-4b90-880f-23ee3eefafc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Converting VIF {"id": "bbfa9945-6317-4b90-880f-23ee3eefafc1", "address": "fa:16:3e:1b:dd:99", "network": {"id": "028f273f-8e31-4b8e-9662-d0a94d5ea802", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1047617218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1448bac90e444d38a97183dba44c98de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbfa9945-63", "ovs_interfaceid": "bbfa9945-6317-4b90-880f-23ee3eefafc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:dd:99,bridge_name='br-int',has_traffic_filtering=True,id=bbfa9945-6317-4b90-880f-23ee3eefafc1,network=Network(028f273f-8e31-4b8e-9662-d0a94d5ea802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbfa9945-63') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG os_vif [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:dd:99,bridge_name='br-int',has_traffic_filtering=True,id=bbfa9945-6317-4b90-880f-23ee3eefafc1,network=Network(028f273f-8e31-4b8e-9662-d0a94d5ea802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbfa9945-63') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '83b38e47-6cd2-55f0-98d3-97d5ee0cad28', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbbfa9945-63, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbbfa9945-63, col_values=(('qos', UUID('e312f3cd-cbd8-42c4-abdd-9b8069865473')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbbfa9945-63, col_values=(('external_ids', {'iface-id': 'bbfa9945-6317-4b90-880f-23ee3eefafc1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:dd:99', 'vm-uuid': 'ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:18 user nova-compute[74821]: INFO os_vif [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:dd:99,bridge_name='br-int',has_traffic_filtering=True,id=bbfa9945-6317-4b90-880f-23ee3eefafc1,network=Network(028f273f-8e31-4b8e-9662-d0a94d5ea802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbfa9945-63')
Nov 06 13:12:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.238s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue" returned: 0 in 0.085s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.327s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG nova.objects.instance [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lazy-loading 'migration_context' on Instance uuid 311817c5-7b08-4da9-98eb-c685f37e6fd3 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] No VIF found with MAC fa:16:3e:1b:dd:99, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG nova.objects.base [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Object Instance<311817c5-7b08-4da9-98eb-c685f37e6fd3> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Start _get_guest_xml network_info=[{"id": "be99c620-c497-4810-8aac-8793f2b2baa7", "address": "fa:16:3e:2e:e6:6b", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "vif_mac": "fa:16:3e:2e:e6:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe99c620-c4", "ovs_interfaceid": "be99c620-c497-4810-8aac-8793f2b2baa7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG nova.objects.instance [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lazy-loading 'resources' on Instance uuid 311817c5-7b08-4da9-98eb-c685f37e6fd3 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG nova.objects.base [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Object Instance<311817c5-7b08-4da9-98eb-c685f37e6fd3> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG nova.objects.instance [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lazy-loading 'numa_topology' on Instance uuid 311817c5-7b08-4da9-98eb-c685f37e6fd3 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG nova.objects.base [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Object Instance<311817c5-7b08-4da9-98eb-c685f37e6fd3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.750s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:12:18 user nova-compute[74821]: DEBUG nova.compute.manager [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:12:18 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:12:18 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:12:19 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG nova.objects.instance [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lazy-loading 'vcpu_model' on Instance uuid 311817c5-7b08-4da9-98eb-c685f37e6fd3 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG nova.objects.base [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Object Instance<311817c5-7b08-4da9-98eb-c685f37e6fd3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:10:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1158306045',display_name='tempest-ServerRescueNegativeTestJSON-server-1158306045',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1158306045',id=2,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:10:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e246e1fd12054401988f9d49f6ad9373',ramdisk_id='',reservation_id='r-xaq5aeap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1107947568',owner_user_name='tempest-ServerRescueNegativeTestJSON-1107947568-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:10:47Z,user_data=None,user_id='4a0f35998b664c32990f079ca1cd5e6d',uuid=311817c5-7b08-4da9-98eb-c685f37e6fd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be99c620-c497-4810-8aac-8793f2b2baa7", "address": "fa:16:3e:2e:e6:6b", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "vif_mac": "fa:16:3e:2e:e6:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe99c620-c4", "ovs_interfaceid": "be99c620-c497-4810-8aac-8793f2b2baa7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Converting VIF {"id": "be99c620-c497-4810-8aac-8793f2b2baa7", "address": "fa:16:3e:2e:e6:6b", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "vif_mac": "fa:16:3e:2e:e6:6b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe99c620-c4", "ovs_interfaceid": "be99c620-c497-4810-8aac-8793f2b2baa7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:e6:6b,bridge_name='br-int',has_traffic_filtering=True,id=be99c620-c497-4810-8aac-8793f2b2baa7,network=Network(45ec1f7e-dbfa-4746-8d35-e32f7c938a0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe99c620-c4') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG nova.objects.instance [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lazy-loading 'pci_devices' on Instance uuid 311817c5-7b08-4da9-98eb-c685f37e6fd3 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG nova.compute.manager [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG nova.network.neutron [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG nova.objects.base [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Object Instance<311817c5-7b08-4da9-98eb-c685f37e6fd3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:12:19 user nova-compute[74821]:   <uuid>311817c5-7b08-4da9-98eb-c685f37e6fd3</uuid>
Nov 06 13:12:19 user nova-compute[74821]:   <name>instance-00000002</name>
Nov 06 13:12:19 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:12:19 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:12:19 user nova-compute[74821]:   <metadata>
Nov 06 13:12:19 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:12:19 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:12:19 user nova-compute[74821]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1158306045</nova:name>
Nov 06 13:12:19 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:12:18</nova:creationTime>
Nov 06 13:12:19 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:12:19 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:12:19 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:12:19 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:12:19 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:12:19 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:12:19 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:12:19 user nova-compute[74821]:       <nova:owner>
Nov 06 13:12:19 user nova-compute[74821]:         <nova:user uuid="4a0f35998b664c32990f079ca1cd5e6d">tempest-ServerRescueNegativeTestJSON-1107947568-project-member</nova:user>
Nov 06 13:12:19 user nova-compute[74821]:         <nova:project uuid="e246e1fd12054401988f9d49f6ad9373">tempest-ServerRescueNegativeTestJSON-1107947568</nova:project>
Nov 06 13:12:19 user nova-compute[74821]:       </nova:owner>
Nov 06 13:12:19 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:12:19 user nova-compute[74821]:       <nova:ports>
Nov 06 13:12:19 user nova-compute[74821]:         <nova:port uuid="be99c620-c497-4810-8aac-8793f2b2baa7">
Nov 06 13:12:19 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 06 13:12:19 user nova-compute[74821]:         </nova:port>
Nov 06 13:12:19 user nova-compute[74821]:       </nova:ports>
Nov 06 13:12:19 user nova-compute[74821]:     </nova:instance>
Nov 06 13:12:19 user nova-compute[74821]:   </metadata>
Nov 06 13:12:19 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:12:19 user nova-compute[74821]:     <system>
Nov 06 13:12:19 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:12:19 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:12:19 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:12:19 user nova-compute[74821]:       <entry name="serial">311817c5-7b08-4da9-98eb-c685f37e6fd3</entry>
Nov 06 13:12:19 user nova-compute[74821]:       <entry name="uuid">311817c5-7b08-4da9-98eb-c685f37e6fd3</entry>
Nov 06 13:12:19 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:12:19 user nova-compute[74821]:     </system>
Nov 06 13:12:19 user nova-compute[74821]:   </sysinfo>
Nov 06 13:12:19 user nova-compute[74821]:   <os>
Nov 06 13:12:19 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:12:19 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:12:19 user nova-compute[74821]:   </os>
Nov 06 13:12:19 user nova-compute[74821]:   <features>
Nov 06 13:12:19 user nova-compute[74821]:     <acpi/>
Nov 06 13:12:19 user nova-compute[74821]:     <apic/>
Nov 06 13:12:19 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:12:19 user nova-compute[74821]:   </features>
Nov 06 13:12:19 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:12:19 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:12:19 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:12:19 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:12:19 user nova-compute[74821]:   </clock>
Nov 06 13:12:19 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:12:19 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:12:19 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:12:19 user nova-compute[74821]:   </cpu>
Nov 06 13:12:19 user nova-compute[74821]:   <devices>
Nov 06 13:12:19 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:12:19 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:12:19 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue"/>
Nov 06 13:12:19 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:12:19 user nova-compute[74821]:     </disk>
Nov 06 13:12:19 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:12:19 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:12:19 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk"/>
Nov 06 13:12:19 user nova-compute[74821]:       <target dev="vdb" bus="virtio"/>
Nov 06 13:12:19 user nova-compute[74821]:     </disk>
Nov 06 13:12:19 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:12:19 user nova-compute[74821]:       <mac address="fa:16:3e:2e:e6:6b"/>
Nov 06 13:12:19 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:12:19 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:12:19 user nova-compute[74821]:       <target dev="tapbe99c620-c4"/>
Nov 06 13:12:19 user nova-compute[74821]:     </interface>
Nov 06 13:12:19 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:12:19 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/console.log" append="off"/>
Nov 06 13:12:19 user nova-compute[74821]:     </serial>
Nov 06 13:12:19 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:12:19 user nova-compute[74821]:     <video>
Nov 06 13:12:19 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:12:19 user nova-compute[74821]:     </video>
Nov 06 13:12:19 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:12:19 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:12:19 user nova-compute[74821]:     </rng>
Nov 06 13:12:19 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:12:19 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:12:19 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:12:19 user nova-compute[74821]:     </memballoon>
Nov 06 13:12:19 user nova-compute[74821]:   </devices>
Nov 06 13:12:19 user nova-compute[74821]: </domain>
Nov 06 13:12:19 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:12:19 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:12:19 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Instance destroyed successfully.
Nov 06 13:12:19 user nova-compute[74821]: DEBUG nova.compute.manager [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] No VIF found with MAC fa:16:3e:2e:e6:6b, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG nova.policy [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '166c2e871760499ab517261aa874f8da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86724840a9ba4cc486fd1d0d0477c778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG nova.compute.manager [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:12:19 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Creating image(s)
Nov 06 13:12:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Acquiring lock "/opt/stack/data/nova/instances/c62c177c-bd96-44f6-bc8d-44131914747b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Lock "/opt/stack/data/nova/instances/c62c177c-bd96-44f6-bc8d-44131914747b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Lock "/opt/stack/data/nova/instances/c62c177c-bd96-44f6-bc8d-44131914747b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.212s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.219s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/c62c177c-bd96-44f6-bc8d-44131914747b/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/c62c177c-bd96-44f6-bc8d-44131914747b/disk 1073741824" returned: 0 in 0.049s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:12:19 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:20 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.218s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:20 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c62c177c-bd96-44f6-bc8d-44131914747b/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:12:20 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62c177c-bd96-44f6-bc8d-44131914747b/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:20 user nova-compute[74821]: DEBUG nova.network.neutron [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Successfully created port: 0ebc9cf7-d8f9-4a5e-9142-c515e05e7571 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:12:20 user nova-compute[74821]: DEBUG nova.compute.manager [req-d78e6fa1-3f33-496f-8d9e-01f67be48e3f req-17cfbd4d-15f9-47d1-8519-20ca89f8bf6f service nova] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Received event network-vif-plugged-be99c620-c497-4810-8aac-8793f2b2baa7 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:12:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d78e6fa1-3f33-496f-8d9e-01f67be48e3f req-17cfbd4d-15f9-47d1-8519-20ca89f8bf6f service nova] Acquiring lock "311817c5-7b08-4da9-98eb-c685f37e6fd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:12:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d78e6fa1-3f33-496f-8d9e-01f67be48e3f req-17cfbd4d-15f9-47d1-8519-20ca89f8bf6f service nova] Lock "311817c5-7b08-4da9-98eb-c685f37e6fd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:12:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d78e6fa1-3f33-496f-8d9e-01f67be48e3f req-17cfbd4d-15f9-47d1-8519-20ca89f8bf6f service nova] Lock "311817c5-7b08-4da9-98eb-c685f37e6fd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:12:20 user nova-compute[74821]: DEBUG nova.compute.manager [req-d78e6fa1-3f33-496f-8d9e-01f67be48e3f req-17cfbd4d-15f9-47d1-8519-20ca89f8bf6f service nova] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] No waiting events found dispatching network-vif-plugged-be99c620-c497-4810-8aac-8793f2b2baa7 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:12:20 user nova-compute[74821]: WARNING nova.compute.manager [req-d78e6fa1-3f33-496f-8d9e-01f67be48e3f req-17cfbd4d-15f9-47d1-8519-20ca89f8bf6f service nova] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Received unexpected event network-vif-plugged-be99c620-c497-4810-8aac-8793f2b2baa7 for instance with vm_state active and task_state rescuing.
Nov 06 13:12:20 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:20 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62c177c-bd96-44f6-bc8d-44131914747b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:20 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Cannot resize image /opt/stack/data/nova/instances/c62c177c-bd96-44f6-bc8d-44131914747b/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:12:20 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:12:20 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Ensure instance console log exists: /opt/stack/data/nova/instances/c62c177c-bd96-44f6-bc8d-44131914747b/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:12:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:12:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:12:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:12:21 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:21 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:21 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:21 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:21 user nova-compute[74821]: DEBUG nova.network.neutron [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Successfully updated port: 0ebc9cf7-d8f9-4a5e-9142-c515e05e7571 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:12:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Acquiring lock "refresh_cache-c62c177c-bd96-44f6-bc8d-44131914747b" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:12:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Acquired lock "refresh_cache-c62c177c-bd96-44f6-bc8d-44131914747b" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:12:21 user nova-compute[74821]: DEBUG nova.network.neutron [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:12:21 user nova-compute[74821]: DEBUG nova.compute.manager [req-6568dce1-228c-4f30-9bd3-e92cc505ce82 req-e5013d3f-e08c-46fe-9a45-740618e50e27 service nova] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Received event network-changed-0ebc9cf7-d8f9-4a5e-9142-c515e05e7571 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:12:21 user nova-compute[74821]: DEBUG nova.compute.manager [req-6568dce1-228c-4f30-9bd3-e92cc505ce82 req-e5013d3f-e08c-46fe-9a45-740618e50e27 service nova] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Refreshing instance network info cache due to event network-changed-0ebc9cf7-d8f9-4a5e-9142-c515e05e7571. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:12:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6568dce1-228c-4f30-9bd3-e92cc505ce82 req-e5013d3f-e08c-46fe-9a45-740618e50e27 service nova] Acquiring lock "refresh_cache-c62c177c-bd96-44f6-bc8d-44131914747b" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:12:21 user nova-compute[74821]: DEBUG nova.network.neutron [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:12:21 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:21 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:21 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:21 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:21 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.network.neutron [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Updating instance_info_cache with network_info: [{"id": "0ebc9cf7-d8f9-4a5e-9142-c515e05e7571", "address": "fa:16:3e:c3:e6:56", "network": {"id": "d5bae261-3db3-492a-a55e-df6c0fd01fe1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-60002553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86724840a9ba4cc486fd1d0d0477c778", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ebc9cf7-d8", "ovs_interfaceid": "0ebc9cf7-d8f9-4a5e-9142-c515e05e7571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Releasing lock "refresh_cache-c62c177c-bd96-44f6-bc8d-44131914747b" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.compute.manager [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Instance network_info: |[{"id": "0ebc9cf7-d8f9-4a5e-9142-c515e05e7571", "address": "fa:16:3e:c3:e6:56", "network": {"id": "d5bae261-3db3-492a-a55e-df6c0fd01fe1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-60002553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86724840a9ba4cc486fd1d0d0477c778", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ebc9cf7-d8", "ovs_interfaceid": "0ebc9cf7-d8f9-4a5e-9142-c515e05e7571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6568dce1-228c-4f30-9bd3-e92cc505ce82 req-e5013d3f-e08c-46fe-9a45-740618e50e27 service nova] Acquired lock "refresh_cache-c62c177c-bd96-44f6-bc8d-44131914747b" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.network.neutron [req-6568dce1-228c-4f30-9bd3-e92cc505ce82 req-e5013d3f-e08c-46fe-9a45-740618e50e27 service nova] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Refreshing network info cache for port 0ebc9cf7-d8f9-4a5e-9142-c515e05e7571 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Start _get_guest_xml network_info=[{"id": "0ebc9cf7-d8f9-4a5e-9142-c515e05e7571", "address": "fa:16:3e:c3:e6:56", "network": {"id": "d5bae261-3db3-492a-a55e-df6c0fd01fe1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-60002553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86724840a9ba4cc486fd1d0d0477c778", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ebc9cf7-d8", "ovs_interfaceid": "0ebc9cf7-d8f9-4a5e-9142-c515e05e7571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:12:22 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:12:22 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:12:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-271307275',display_name='tempest-ServersNegativeTestJSON-server-271307275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-271307275',id=10,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86724840a9ba4cc486fd1d0d0477c778',ramdisk_id='',reservation_id='r-20o4ponj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-835160312',owner_user_name='tempest-ServersNegativeTestJSON-835160312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:12:19Z,user_data=None,user_id='166c2e871760499ab517261aa874f8da',uuid=c62c177c-bd96-44f6-bc8d-44131914747b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ebc9cf7-d8f9-4a5e-9142-c515e05e7571", "address": "fa:16:3e:c3:e6:56", "network": {"id": "d5bae261-3db3-492a-a55e-df6c0fd01fe1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-60002553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86724840a9ba4cc486fd1d0d0477c778", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ebc9cf7-d8", "ovs_interfaceid": "0ebc9cf7-d8f9-4a5e-9142-c515e05e7571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Converting VIF {"id": "0ebc9cf7-d8f9-4a5e-9142-c515e05e7571", "address": "fa:16:3e:c3:e6:56", "network": {"id": "d5bae261-3db3-492a-a55e-df6c0fd01fe1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-60002553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86724840a9ba4cc486fd1d0d0477c778", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ebc9cf7-d8", "ovs_interfaceid": "0ebc9cf7-d8f9-4a5e-9142-c515e05e7571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:e6:56,bridge_name='br-int',has_traffic_filtering=True,id=0ebc9cf7-d8f9-4a5e-9142-c515e05e7571,network=Network(d5bae261-3db3-492a-a55e-df6c0fd01fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ebc9cf7-d8') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.objects.instance [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Lazy-loading 'pci_devices' on Instance uuid c62c177c-bd96-44f6-bc8d-44131914747b {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:12:22 user nova-compute[74821]:   <uuid>c62c177c-bd96-44f6-bc8d-44131914747b</uuid>
Nov 06 13:12:22 user nova-compute[74821]:   <name>instance-0000000a</name>
Nov 06 13:12:22 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:12:22 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:12:22 user nova-compute[74821]:   <metadata>
Nov 06 13:12:22 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:12:22 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:12:22 user nova-compute[74821]:       <nova:name>tempest-ServersNegativeTestJSON-server-271307275</nova:name>
Nov 06 13:12:22 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:12:22</nova:creationTime>
Nov 06 13:12:22 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:12:22 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:12:22 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:12:22 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:12:22 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:12:22 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:12:22 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:12:22 user nova-compute[74821]:       <nova:owner>
Nov 06 13:12:22 user nova-compute[74821]:         <nova:user uuid="166c2e871760499ab517261aa874f8da">tempest-ServersNegativeTestJSON-835160312-project-member</nova:user>
Nov 06 13:12:22 user nova-compute[74821]:         <nova:project uuid="86724840a9ba4cc486fd1d0d0477c778">tempest-ServersNegativeTestJSON-835160312</nova:project>
Nov 06 13:12:22 user nova-compute[74821]:       </nova:owner>
Nov 06 13:12:22 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:12:22 user nova-compute[74821]:       <nova:ports>
Nov 06 13:12:22 user nova-compute[74821]:         <nova:port uuid="0ebc9cf7-d8f9-4a5e-9142-c515e05e7571">
Nov 06 13:12:22 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 06 13:12:22 user nova-compute[74821]:         </nova:port>
Nov 06 13:12:22 user nova-compute[74821]:       </nova:ports>
Nov 06 13:12:22 user nova-compute[74821]:     </nova:instance>
Nov 06 13:12:22 user nova-compute[74821]:   </metadata>
Nov 06 13:12:22 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:12:22 user nova-compute[74821]:     <system>
Nov 06 13:12:22 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:12:22 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:12:22 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:12:22 user nova-compute[74821]:       <entry name="serial">c62c177c-bd96-44f6-bc8d-44131914747b</entry>
Nov 06 13:12:22 user nova-compute[74821]:       <entry name="uuid">c62c177c-bd96-44f6-bc8d-44131914747b</entry>
Nov 06 13:12:22 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:12:22 user nova-compute[74821]:     </system>
Nov 06 13:12:22 user nova-compute[74821]:   </sysinfo>
Nov 06 13:12:22 user nova-compute[74821]:   <os>
Nov 06 13:12:22 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:12:22 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:12:22 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:12:22 user nova-compute[74821]:   </os>
Nov 06 13:12:22 user nova-compute[74821]:   <features>
Nov 06 13:12:22 user nova-compute[74821]:     <acpi/>
Nov 06 13:12:22 user nova-compute[74821]:     <apic/>
Nov 06 13:12:22 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:12:22 user nova-compute[74821]:   </features>
Nov 06 13:12:22 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:12:22 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:12:22 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:12:22 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:12:22 user nova-compute[74821]:   </clock>
Nov 06 13:12:22 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:12:22 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:12:22 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:12:22 user nova-compute[74821]:   </cpu>
Nov 06 13:12:22 user nova-compute[74821]:   <devices>
Nov 06 13:12:22 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:12:22 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:12:22 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/c62c177c-bd96-44f6-bc8d-44131914747b/disk"/>
Nov 06 13:12:22 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:12:22 user nova-compute[74821]:     </disk>
Nov 06 13:12:22 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:12:22 user nova-compute[74821]:       <mac address="fa:16:3e:c3:e6:56"/>
Nov 06 13:12:22 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:12:22 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:12:22 user nova-compute[74821]:       <target dev="tap0ebc9cf7-d8"/>
Nov 06 13:12:22 user nova-compute[74821]:     </interface>
Nov 06 13:12:22 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:12:22 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/c62c177c-bd96-44f6-bc8d-44131914747b/console.log" append="off"/>
Nov 06 13:12:22 user nova-compute[74821]:     </serial>
Nov 06 13:12:22 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:12:22 user nova-compute[74821]:     <video>
Nov 06 13:12:22 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:12:22 user nova-compute[74821]:     </video>
Nov 06 13:12:22 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:12:22 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:12:22 user nova-compute[74821]:     </rng>
Nov 06 13:12:22 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:12:22 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:12:22 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:12:22 user nova-compute[74821]:     </memballoon>
Nov 06 13:12:22 user nova-compute[74821]:   </devices>
Nov 06 13:12:22 user nova-compute[74821]: </domain>
Nov 06 13:12:22 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:12:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-271307275',display_name='tempest-ServersNegativeTestJSON-server-271307275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-271307275',id=10,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86724840a9ba4cc486fd1d0d0477c778',ramdisk_id='',reservation_id='r-20o4ponj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-835160312',owner_user_name='tempest-ServersNegativeTestJSON-835160312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:12:19Z,user_data=None,user_id='166c2e871760499ab517261aa874f8da',uuid=c62c177c-bd96-44f6-bc8d-44131914747b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ebc9cf7-d8f9-4a5e-9142-c515e05e7571", "address": "fa:16:3e:c3:e6:56", "network": {"id": "d5bae261-3db3-492a-a55e-df6c0fd01fe1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-60002553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86724840a9ba4cc486fd1d0d0477c778", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ebc9cf7-d8", "ovs_interfaceid": "0ebc9cf7-d8f9-4a5e-9142-c515e05e7571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Converting VIF {"id": "0ebc9cf7-d8f9-4a5e-9142-c515e05e7571", "address": "fa:16:3e:c3:e6:56", "network": {"id": "d5bae261-3db3-492a-a55e-df6c0fd01fe1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-60002553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86724840a9ba4cc486fd1d0d0477c778", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ebc9cf7-d8", "ovs_interfaceid": "0ebc9cf7-d8f9-4a5e-9142-c515e05e7571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:e6:56,bridge_name='br-int',has_traffic_filtering=True,id=0ebc9cf7-d8f9-4a5e-9142-c515e05e7571,network=Network(d5bae261-3db3-492a-a55e-df6c0fd01fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ebc9cf7-d8') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG os_vif [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:e6:56,bridge_name='br-int',has_traffic_filtering=True,id=0ebc9cf7-d8f9-4a5e-9142-c515e05e7571,network=Network(d5bae261-3db3-492a-a55e-df6c0fd01fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ebc9cf7-d8') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '44d78a10-1241-59c2-b916-c6df77ccbff4', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ebc9cf7-d8, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ebc9cf7-d8, col_values=(('qos', UUID('4a667783-da23-4611-96f5-87136fcbec64')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ebc9cf7-d8, col_values=(('external_ids', {'iface-id': '0ebc9cf7-d8f9-4a5e-9142-c515e05e7571', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:e6:56', 'vm-uuid': 'c62c177c-bd96-44f6-bc8d-44131914747b'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:22 user nova-compute[74821]: INFO os_vif [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:e6:56,bridge_name='br-int',has_traffic_filtering=True,id=0ebc9cf7-d8f9-4a5e-9142-c515e05e7571,network=Network(d5bae261-3db3-492a-a55e-df6c0fd01fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ebc9cf7-d8')
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.compute.manager [req-041d6e6e-a5ca-4c37-91f3-f31b867b6bb4 req-681d80aa-f2cb-4504-b540-dce06a855dd2 service nova] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Received event network-vif-plugged-bbfa9945-6317-4b90-880f-23ee3eefafc1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-041d6e6e-a5ca-4c37-91f3-f31b867b6bb4 req-681d80aa-f2cb-4504-b540-dce06a855dd2 service nova] Acquiring lock "ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-041d6e6e-a5ca-4c37-91f3-f31b867b6bb4 req-681d80aa-f2cb-4504-b540-dce06a855dd2 service nova] Lock "ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-041d6e6e-a5ca-4c37-91f3-f31b867b6bb4 req-681d80aa-f2cb-4504-b540-dce06a855dd2 service nova] Lock "ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.compute.manager [req-041d6e6e-a5ca-4c37-91f3-f31b867b6bb4 req-681d80aa-f2cb-4504-b540-dce06a855dd2 service nova] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] No waiting events found dispatching network-vif-plugged-bbfa9945-6317-4b90-880f-23ee3eefafc1 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:12:22 user nova-compute[74821]: WARNING nova.compute.manager [req-041d6e6e-a5ca-4c37-91f3-f31b867b6bb4 req-681d80aa-f2cb-4504-b540-dce06a855dd2 service nova] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Received unexpected event network-vif-plugged-bbfa9945-6317-4b90-880f-23ee3eefafc1 for instance with vm_state building and task_state spawning.
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.compute.manager [req-041d6e6e-a5ca-4c37-91f3-f31b867b6bb4 req-681d80aa-f2cb-4504-b540-dce06a855dd2 service nova] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Received event network-vif-plugged-bbfa9945-6317-4b90-880f-23ee3eefafc1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-041d6e6e-a5ca-4c37-91f3-f31b867b6bb4 req-681d80aa-f2cb-4504-b540-dce06a855dd2 service nova] Acquiring lock "ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-041d6e6e-a5ca-4c37-91f3-f31b867b6bb4 req-681d80aa-f2cb-4504-b540-dce06a855dd2 service nova] Lock "ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-041d6e6e-a5ca-4c37-91f3-f31b867b6bb4 req-681d80aa-f2cb-4504-b540-dce06a855dd2 service nova] Lock "ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.compute.manager [req-041d6e6e-a5ca-4c37-91f3-f31b867b6bb4 req-681d80aa-f2cb-4504-b540-dce06a855dd2 service nova] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] No waiting events found dispatching network-vif-plugged-bbfa9945-6317-4b90-880f-23ee3eefafc1 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:12:22 user nova-compute[74821]: WARNING nova.compute.manager [req-041d6e6e-a5ca-4c37-91f3-f31b867b6bb4 req-681d80aa-f2cb-4504-b540-dce06a855dd2 service nova] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Received unexpected event network-vif-plugged-bbfa9945-6317-4b90-880f-23ee3eefafc1 for instance with vm_state building and task_state spawning.
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.compute.manager [req-041d6e6e-a5ca-4c37-91f3-f31b867b6bb4 req-681d80aa-f2cb-4504-b540-dce06a855dd2 service nova] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Received event network-vif-plugged-be99c620-c497-4810-8aac-8793f2b2baa7 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-041d6e6e-a5ca-4c37-91f3-f31b867b6bb4 req-681d80aa-f2cb-4504-b540-dce06a855dd2 service nova] Acquiring lock "311817c5-7b08-4da9-98eb-c685f37e6fd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-041d6e6e-a5ca-4c37-91f3-f31b867b6bb4 req-681d80aa-f2cb-4504-b540-dce06a855dd2 service nova] Lock "311817c5-7b08-4da9-98eb-c685f37e6fd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-041d6e6e-a5ca-4c37-91f3-f31b867b6bb4 req-681d80aa-f2cb-4504-b540-dce06a855dd2 service nova] Lock "311817c5-7b08-4da9-98eb-c685f37e6fd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.compute.manager [req-041d6e6e-a5ca-4c37-91f3-f31b867b6bb4 req-681d80aa-f2cb-4504-b540-dce06a855dd2 service nova] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] No waiting events found dispatching network-vif-plugged-be99c620-c497-4810-8aac-8793f2b2baa7 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:12:22 user nova-compute[74821]: WARNING nova.compute.manager [req-041d6e6e-a5ca-4c37-91f3-f31b867b6bb4 req-681d80aa-f2cb-4504-b540-dce06a855dd2 service nova] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Received unexpected event network-vif-plugged-be99c620-c497-4810-8aac-8793f2b2baa7 for instance with vm_state active and task_state rescuing.
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] No VIF found with MAC fa:16:3e:c3:e6:56, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.network.neutron [req-6568dce1-228c-4f30-9bd3-e92cc505ce82 req-e5013d3f-e08c-46fe-9a45-740618e50e27 service nova] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Updated VIF entry in instance network info cache for port 0ebc9cf7-d8f9-4a5e-9142-c515e05e7571. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG nova.network.neutron [req-6568dce1-228c-4f30-9bd3-e92cc505ce82 req-e5013d3f-e08c-46fe-9a45-740618e50e27 service nova] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Updating instance_info_cache with network_info: [{"id": "0ebc9cf7-d8f9-4a5e-9142-c515e05e7571", "address": "fa:16:3e:c3:e6:56", "network": {"id": "d5bae261-3db3-492a-a55e-df6c0fd01fe1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-60002553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86724840a9ba4cc486fd1d0d0477c778", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ebc9cf7-d8", "ovs_interfaceid": "0ebc9cf7-d8f9-4a5e-9142-c515e05e7571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:12:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6568dce1-228c-4f30-9bd3-e92cc505ce82 req-e5013d3f-e08c-46fe-9a45-740618e50e27 service nova] Releasing lock "refresh_cache-c62c177c-bd96-44f6-bc8d-44131914747b" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:12:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:23 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:12:23 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:12:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-311817c5-7b08-4da9-98eb-c685f37e6fd3" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:12:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-311817c5-7b08-4da9-98eb-c685f37e6fd3" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:12:24 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:12:24 user nova-compute[74821]: DEBUG nova.compute.manager [req-ae78dedd-f8c4-48fd-b82d-d5db13eeaa0b req-cfde6244-33bc-42c7-a7e3-43b07acc7a50 service nova] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Received event network-vif-plugged-0ebc9cf7-d8f9-4a5e-9142-c515e05e7571 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:12:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ae78dedd-f8c4-48fd-b82d-d5db13eeaa0b req-cfde6244-33bc-42c7-a7e3-43b07acc7a50 service nova] Acquiring lock "c62c177c-bd96-44f6-bc8d-44131914747b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:12:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ae78dedd-f8c4-48fd-b82d-d5db13eeaa0b req-cfde6244-33bc-42c7-a7e3-43b07acc7a50 service nova] Lock "c62c177c-bd96-44f6-bc8d-44131914747b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:12:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ae78dedd-f8c4-48fd-b82d-d5db13eeaa0b req-cfde6244-33bc-42c7-a7e3-43b07acc7a50 service nova] Lock "c62c177c-bd96-44f6-bc8d-44131914747b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:12:24 user nova-compute[74821]: DEBUG nova.compute.manager [req-ae78dedd-f8c4-48fd-b82d-d5db13eeaa0b req-cfde6244-33bc-42c7-a7e3-43b07acc7a50 service nova] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] No waiting events found dispatching network-vif-plugged-0ebc9cf7-d8f9-4a5e-9142-c515e05e7571 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:12:24 user nova-compute[74821]: WARNING nova.compute.manager [req-ae78dedd-f8c4-48fd-b82d-d5db13eeaa0b req-cfde6244-33bc-42c7-a7e3-43b07acc7a50 service nova] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Received unexpected event network-vif-plugged-0ebc9cf7-d8f9-4a5e-9142-c515e05e7571 for instance with vm_state building and task_state spawning.
Nov 06 13:12:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:24 user nova-compute[74821]: DEBUG nova.compute.manager [req-11515886-2034-468f-a033-89d5d83578ae req-85c3ad4a-2bca-432f-9d6b-3dfab6fb5395 service nova] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Received event network-vif-plugged-be99c620-c497-4810-8aac-8793f2b2baa7 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:12:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-11515886-2034-468f-a033-89d5d83578ae req-85c3ad4a-2bca-432f-9d6b-3dfab6fb5395 service nova] Acquiring lock "311817c5-7b08-4da9-98eb-c685f37e6fd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:12:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-11515886-2034-468f-a033-89d5d83578ae req-85c3ad4a-2bca-432f-9d6b-3dfab6fb5395 service nova] Lock "311817c5-7b08-4da9-98eb-c685f37e6fd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:12:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-11515886-2034-468f-a033-89d5d83578ae req-85c3ad4a-2bca-432f-9d6b-3dfab6fb5395 service nova] Lock "311817c5-7b08-4da9-98eb-c685f37e6fd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:12:24 user nova-compute[74821]: DEBUG nova.compute.manager [req-11515886-2034-468f-a033-89d5d83578ae req-85c3ad4a-2bca-432f-9d6b-3dfab6fb5395 service nova] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] No waiting events found dispatching network-vif-plugged-be99c620-c497-4810-8aac-8793f2b2baa7 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:12:24 user nova-compute[74821]: WARNING nova.compute.manager [req-11515886-2034-468f-a033-89d5d83578ae req-85c3ad4a-2bca-432f-9d6b-3dfab6fb5395 service nova] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Received unexpected event network-vif-plugged-be99c620-c497-4810-8aac-8793f2b2baa7 for instance with vm_state active and task_state rescuing.
Nov 06 13:12:24 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Updating instance_info_cache with network_info: [{"id": "be99c620-c497-4810-8aac-8793f2b2baa7", "address": "fa:16:3e:2e:e6:6b", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe99c620-c4", "ovs_interfaceid": "be99c620-c497-4810-8aac-8793f2b2baa7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:12:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-311817c5-7b08-4da9-98eb-c685f37e6fd3" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:12:24 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:12:24 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:12:24 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:12:24 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:12:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:12:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:12:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:12:25 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:12:25 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:25 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:25 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:25 user nova-compute[74821]: DEBUG nova.compute.manager [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:12:25 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:12:25 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Instance spawned successfully.
Nov 06 13:12:25 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:12:25 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:12:25 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:12:25 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:12:25 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:12:25 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:12:25 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:12:25 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:25 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49d05da1-3222-4f9f-b792-8f3d1f0f2890/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:25 user nova-compute[74821]: INFO nova.compute.manager [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Took 8.58 seconds to spawn the instance on the hypervisor.
Nov 06 13:12:25 user nova-compute[74821]: DEBUG nova.compute.manager [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:12:25 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49d05da1-3222-4f9f-b792-8f3d1f0f2890/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:25 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49d05da1-3222-4f9f-b792-8f3d1f0f2890/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:25 user nova-compute[74821]: DEBUG nova.compute.manager [None req-376c3209-b249-4479-b91f-bc4e47c92c5d tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:12:25 user nova-compute[74821]: INFO nova.compute.manager [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Took 33.19 seconds to build instance.
Nov 06 13:12:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f3b23177-9ec2-4e5f-9c60-88e030c81d35 tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Lock "ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.288s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:12:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49d05da1-3222-4f9f-b792-8f3d1f0f2890/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:26 user nova-compute[74821]: DEBUG nova.compute.manager [req-21f14fed-653c-49cb-b4bf-5909f1f6b61a req-383fb64b-1ed1-41c1-89f7-f716277f0e21 service nova] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Received event network-vif-plugged-0ebc9cf7-d8f9-4a5e-9142-c515e05e7571 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:12:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-21f14fed-653c-49cb-b4bf-5909f1f6b61a req-383fb64b-1ed1-41c1-89f7-f716277f0e21 service nova] Acquiring lock "c62c177c-bd96-44f6-bc8d-44131914747b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:12:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-21f14fed-653c-49cb-b4bf-5909f1f6b61a req-383fb64b-1ed1-41c1-89f7-f716277f0e21 service nova] Lock "c62c177c-bd96-44f6-bc8d-44131914747b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:12:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-21f14fed-653c-49cb-b4bf-5909f1f6b61a req-383fb64b-1ed1-41c1-89f7-f716277f0e21 service nova] Lock "c62c177c-bd96-44f6-bc8d-44131914747b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:12:26 user nova-compute[74821]: DEBUG nova.compute.manager [req-21f14fed-653c-49cb-b4bf-5909f1f6b61a req-383fb64b-1ed1-41c1-89f7-f716277f0e21 service nova] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] No waiting events found dispatching network-vif-plugged-0ebc9cf7-d8f9-4a5e-9142-c515e05e7571 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:12:26 user nova-compute[74821]: WARNING nova.compute.manager [req-21f14fed-653c-49cb-b4bf-5909f1f6b61a req-383fb64b-1ed1-41c1-89f7-f716277f0e21 service nova] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Received unexpected event network-vif-plugged-0ebc9cf7-d8f9-4a5e-9142-c515e05e7571 for instance with vm_state building and task_state spawning.
Nov 06 13:12:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62c177c-bd96-44f6-bc8d-44131914747b/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62c177c-bd96-44f6-bc8d-44131914747b/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62c177c-bd96-44f6-bc8d-44131914747b/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:12:26 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:12:26 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Instance spawned successfully.
Nov 06 13:12:26 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:12:26 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:12:26 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:12:26 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:12:26 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:12:26 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:12:26 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:12:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62c177c-bd96-44f6-bc8d-44131914747b/disk --force-share --output=json" returned: 0 in 0.375s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b373e1-f872-4263-808c-ce5fbddf907c/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:26 user nova-compute[74821]: INFO nova.compute.manager [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Took 7.58 seconds to spawn the instance on the hypervisor.
Nov 06 13:12:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:12:27 user nova-compute[74821]: INFO nova.compute.manager [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Took 8.87 seconds to build instance.
Nov 06 13:12:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-300659cf-fe15-4b09-b4d7-974042003cf2 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Lock "c62c177c-bd96-44f6-bc8d-44131914747b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.017s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:12:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b373e1-f872-4263-808c-ce5fbddf907c/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b373e1-f872-4263-808c-ce5fbddf907c/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b373e1-f872-4263-808c-ce5fbddf907c/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47906a7-93b9-4527-9318-ed4df54afff6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47906a7-93b9-4527-9318-ed4df54afff6/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47906a7-93b9-4527-9318-ed4df54afff6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47906a7-93b9-4527-9318-ed4df54afff6/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ccb546-94c4-482c-8017-852cd42999fe/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ccb546-94c4-482c-8017-852cd42999fe/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ccb546-94c4-482c-8017-852cd42999fe/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ccb546-94c4-482c-8017-852cd42999fe/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:12:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:29 user nova-compute[74821]: DEBUG nova.compute.manager [req-d226cbb9-5914-4e7e-9956-96478645e075 req-26ac6b87-9be1-41fc-9dbf-2317c7890c9c service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Received event network-changed-d69de9b4-5366-4d42-b01d-e4ec468a5aa2 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:12:29 user nova-compute[74821]: DEBUG nova.compute.manager [req-d226cbb9-5914-4e7e-9956-96478645e075 req-26ac6b87-9be1-41fc-9dbf-2317c7890c9c service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Refreshing instance network info cache due to event network-changed-d69de9b4-5366-4d42-b01d-e4ec468a5aa2. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:12:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d226cbb9-5914-4e7e-9956-96478645e075 req-26ac6b87-9be1-41fc-9dbf-2317c7890c9c service nova] Acquiring lock "refresh_cache-5a715806-ff8b-4502-8435-c5de3e3c688a" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:12:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d226cbb9-5914-4e7e-9956-96478645e075 req-26ac6b87-9be1-41fc-9dbf-2317c7890c9c service nova] Acquired lock "refresh_cache-5a715806-ff8b-4502-8435-c5de3e3c688a" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:12:29 user nova-compute[74821]: DEBUG nova.network.neutron [req-d226cbb9-5914-4e7e-9956-96478645e075 req-26ac6b87-9be1-41fc-9dbf-2317c7890c9c service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Refreshing network info cache for port d69de9b4-5366-4d42-b01d-e4ec468a5aa2 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:12:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json" returned: 0 in 0.267s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json" returned: 0 in 0.245s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Acquiring lock "a2b373e1-f872-4263-808c-ce5fbddf907c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:12:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Lock "a2b373e1-f872-4263-808c-ce5fbddf907c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:12:30 user nova-compute[74821]: DEBUG nova.objects.instance [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Lazy-loading 'flavor' on Instance uuid a2b373e1-f872-4263-808c-ce5fbddf907c {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:12:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Lock "a2b373e1-f872-4263-808c-ce5fbddf907c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.131s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:12:31 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:12:31 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:12:31 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=7581MB free_disk=25.650104522705078GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:12:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:12:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:12:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Acquiring lock "a2b373e1-f872-4263-808c-ce5fbddf907c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:12:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Lock "a2b373e1-f872-4263-808c-ce5fbddf907c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:12:31 user nova-compute[74821]: INFO nova.compute.manager [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Attaching volume 349c8dd8-21f9-4ca7-93da-2e05ef56fae0 to /dev/vdb
Nov 06 13:12:31 user nova-compute[74821]: DEBUG os_brick.utils [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:12:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4db0bb-bb2f-4e96-8288-f8b353c4be9b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:12:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd80f496-1c7b-4656-a8c1-077a542dbd74]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:12:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30fb6a3-a851-4192-89f9-bd00dca52982]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:12:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3820ea1-5a81-407b-8f3a-b258fd96e1c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:12:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:12:31 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 3e21d005-f190-478a-a911-e483e1235057 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:12:31 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 311817c5-7b08-4da9-98eb-c685f37e6fd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:12:31 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance f8c537c6-fa3e-4842-9471-7258a22c01f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:12:31 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance a2b373e1-f872-4263-808c-ce5fbddf907c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:12:31 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 5a715806-ff8b-4502-8435-c5de3e3c688a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:12:31 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 86ccb546-94c4-482c-8017-852cd42999fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:12:31 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 49d05da1-3222-4f9f-b792-8f3d1f0f2890 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:12:31 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance c47906a7-93b9-4527-9318-ed4df54afff6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:12:31 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:12:31 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance c62c177c-bd96-44f6-bc8d-44131914747b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:12:31 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:12:31 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:12:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:12:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:12:31 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:12:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b56174-cc25-4a52-bcb9-328b746dc19f]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:12:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:12:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:12:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:12:31 user nova-compute[74821]: DEBUG os_brick.utils [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] <== get_connector_properties: return (195ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:12:31 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Updating existing volume attachment record: daf1dd11-1449-47b7-a3ba-afbaa6241047 {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:12:32 user nova-compute[74821]: DEBUG nova.network.neutron [req-d226cbb9-5914-4e7e-9956-96478645e075 req-26ac6b87-9be1-41fc-9dbf-2317c7890c9c service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Updated VIF entry in instance network info cache for port d69de9b4-5366-4d42-b01d-e4ec468a5aa2. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:12:32 user nova-compute[74821]: DEBUG nova.network.neutron [req-d226cbb9-5914-4e7e-9956-96478645e075 req-26ac6b87-9be1-41fc-9dbf-2317c7890c9c service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Updating instance_info_cache with network_info: [{"id": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "address": "fa:16:3e:e1:45:18", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69de9b4-53", "ovs_interfaceid": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:12:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d226cbb9-5914-4e7e-9956-96478645e075 req-26ac6b87-9be1-41fc-9dbf-2317c7890c9c service nova] Releasing lock "refresh_cache-5a715806-ff8b-4502-8435-c5de3e3c688a" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:12:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:32 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:12:32 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:12:32 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:12:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.997s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:12:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:33 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:12:33 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:12:33 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:12:33 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:12:33 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:12:33 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:12:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Acquiring lock "a33991ce-e911-460d-a6d9-ca738830ef2c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:12:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:12:34 user nova-compute[74821]: DEBUG nova.compute.manager [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:12:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:12:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:12:34 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:12:34 user nova-compute[74821]: INFO nova.compute.claims [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Claim successful on node user
Nov 06 13:12:35 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:12:35 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:12:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.685s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:12:35 user nova-compute[74821]: DEBUG nova.compute.manager [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:12:35 user nova-compute[74821]: DEBUG nova.compute.manager [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:12:35 user nova-compute[74821]: DEBUG nova.network.neutron [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:12:35 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:12:35 user nova-compute[74821]: DEBUG nova.compute.manager [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:12:35 user nova-compute[74821]: DEBUG nova.policy [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '55407d95268147d4a75654afebe43631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5313e0306714b299bd860177c36f07f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:12:35 user nova-compute[74821]: INFO nova.virt.block_device [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Booting with volume 5dff38fc-6556-4029-b400-b624265adb89 at /dev/vda
Nov 06 13:12:35 user nova-compute[74821]: DEBUG os_brick.utils [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:12:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:35 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[52feb191-0d88-497f-bf5b-c5cba373a844]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:12:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:35 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0d7988-585f-4254-8976-740d4d9b9e51]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:12:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:35 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb7bad5-9605-4984-b184-50b42dab32ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:12:35 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0d1924-44dc-4bcd-909b-cc9c2263a3c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:12:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:12:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:12:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:12:35 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:12:35 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebad40d-37f7-45d7-892c-f6047d92a09a]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:12:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:12:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:12:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:12:35 user nova-compute[74821]: DEBUG os_brick.utils [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:12:35 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Updating existing volume attachment record: 97a80344-58b1-4ae7-bbb7-9dd9125a4c5f {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:12:36 user nova-compute[74821]: DEBUG nova.network.neutron [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Successfully created port: 8b30affb-e2f5-4151-8fee-fb7edcaf5ae2 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:12:37 user nova-compute[74821]: DEBUG nova.network.neutron [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Successfully created port: 03c0a994-073b-4b58-8775-0ce28b2f404d {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:12:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:37 user nova-compute[74821]: DEBUG nova.network.neutron [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Successfully created port: d3d9f17a-c9d8-4aaf-8015-dc9825335a25 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:12:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1cbbe531-9f8e-47c9-a90a-6a56b1d94713 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "5a715806-ff8b-4502-8435-c5de3e3c688a" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:12:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1cbbe531-9f8e-47c9-a90a-6a56b1d94713 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "5a715806-ff8b-4502-8435-c5de3e3c688a" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:12:38 user nova-compute[74821]: INFO nova.compute.manager [None req-1cbbe531-9f8e-47c9-a90a-6a56b1d94713 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Shelving
Nov 06 13:12:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:38 user nova-compute[74821]: DEBUG nova.network.neutron [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Successfully created port: f523111f-21f0-49ad-8e55-7515ebcfecff {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:12:38 user nova-compute[74821]: DEBUG nova.compute.manager [req-52af49b3-40cd-4278-b691-4148f7b8d9cb req-5c56e6d9-762a-4e9f-ab7a-1514e572d3cd service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Received event network-vif-unplugged-d69de9b4-5366-4d42-b01d-e4ec468a5aa2 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:12:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-52af49b3-40cd-4278-b691-4148f7b8d9cb req-5c56e6d9-762a-4e9f-ab7a-1514e572d3cd service nova] Acquiring lock "5a715806-ff8b-4502-8435-c5de3e3c688a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:12:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-52af49b3-40cd-4278-b691-4148f7b8d9cb req-5c56e6d9-762a-4e9f-ab7a-1514e572d3cd service nova] Lock "5a715806-ff8b-4502-8435-c5de3e3c688a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:12:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-52af49b3-40cd-4278-b691-4148f7b8d9cb req-5c56e6d9-762a-4e9f-ab7a-1514e572d3cd service nova] Lock "5a715806-ff8b-4502-8435-c5de3e3c688a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:12:38 user nova-compute[74821]: DEBUG nova.compute.manager [req-52af49b3-40cd-4278-b691-4148f7b8d9cb req-5c56e6d9-762a-4e9f-ab7a-1514e572d3cd service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] No waiting events found dispatching network-vif-unplugged-d69de9b4-5366-4d42-b01d-e4ec468a5aa2 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:12:38 user nova-compute[74821]: WARNING nova.compute.manager [req-52af49b3-40cd-4278-b691-4148f7b8d9cb req-5c56e6d9-762a-4e9f-ab7a-1514e572d3cd service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Received unexpected event network-vif-unplugged-d69de9b4-5366-4d42-b01d-e4ec468a5aa2 for instance with vm_state active and task_state shelving.
Nov 06 13:12:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:39 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Instance destroyed successfully.
Nov 06 13:12:39 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-1cbbe531-9f8e-47c9-a90a-6a56b1d94713 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Beginning cold snapshot process
Nov 06 13:12:39 user nova-compute[74821]: DEBUG nova.privsep.utils [None req-1cbbe531-9f8e-47c9-a90a-6a56b1d94713 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74821) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 13:12:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1cbbe531-9f8e-47c9-a90a-6a56b1d94713 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/disk /opt/stack/data/nova/instances/snapshots/tmpfzx58hkc/baebd7a999ba452f82080a26d0a2fa1c {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:39 user nova-compute[74821]: DEBUG nova.network.neutron [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Successfully created port: 027b08d1-100c-4dc6-9e51-a435642f25f9 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:12:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1cbbe531-9f8e-47c9-a90a-6a56b1d94713 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/disk /opt/stack/data/nova/instances/snapshots/tmpfzx58hkc/baebd7a999ba452f82080a26d0a2fa1c" returned: 0 in 1.025s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:40 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-1cbbe531-9f8e-47c9-a90a-6a56b1d94713 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Snapshot extracted, beginning image upload
Nov 06 13:12:40 user nova-compute[74821]: DEBUG nova.network.neutron [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Successfully updated port: 8b30affb-e2f5-4151-8fee-fb7edcaf5ae2 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:12:40 user nova-compute[74821]: DEBUG nova.compute.manager [req-e1a85ba9-17e2-4144-bb12-e3a6c1baba6f req-229eacb5-1cb1-4d42-b641-45faaeead089 service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Received event network-vif-plugged-d69de9b4-5366-4d42-b01d-e4ec468a5aa2 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:12:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e1a85ba9-17e2-4144-bb12-e3a6c1baba6f req-229eacb5-1cb1-4d42-b641-45faaeead089 service nova] Acquiring lock "5a715806-ff8b-4502-8435-c5de3e3c688a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:12:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e1a85ba9-17e2-4144-bb12-e3a6c1baba6f req-229eacb5-1cb1-4d42-b641-45faaeead089 service nova] Lock "5a715806-ff8b-4502-8435-c5de3e3c688a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:12:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e1a85ba9-17e2-4144-bb12-e3a6c1baba6f req-229eacb5-1cb1-4d42-b641-45faaeead089 service nova] Lock "5a715806-ff8b-4502-8435-c5de3e3c688a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:12:40 user nova-compute[74821]: DEBUG nova.compute.manager [req-e1a85ba9-17e2-4144-bb12-e3a6c1baba6f req-229eacb5-1cb1-4d42-b641-45faaeead089 service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] No waiting events found dispatching network-vif-plugged-d69de9b4-5366-4d42-b01d-e4ec468a5aa2 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:12:40 user nova-compute[74821]: WARNING nova.compute.manager [req-e1a85ba9-17e2-4144-bb12-e3a6c1baba6f req-229eacb5-1cb1-4d42-b641-45faaeead089 service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Received unexpected event network-vif-plugged-d69de9b4-5366-4d42-b01d-e4ec468a5aa2 for instance with vm_state active and task_state shelving_image_uploading.
Nov 06 13:12:40 user nova-compute[74821]: DEBUG nova.compute.manager [req-e1a85ba9-17e2-4144-bb12-e3a6c1baba6f req-229eacb5-1cb1-4d42-b641-45faaeead089 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-changed-8b30affb-e2f5-4151-8fee-fb7edcaf5ae2 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:12:40 user nova-compute[74821]: DEBUG nova.compute.manager [req-e1a85ba9-17e2-4144-bb12-e3a6c1baba6f req-229eacb5-1cb1-4d42-b641-45faaeead089 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Refreshing instance network info cache due to event network-changed-8b30affb-e2f5-4151-8fee-fb7edcaf5ae2. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:12:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e1a85ba9-17e2-4144-bb12-e3a6c1baba6f req-229eacb5-1cb1-4d42-b641-45faaeead089 service nova] Acquiring lock "refresh_cache-a33991ce-e911-460d-a6d9-ca738830ef2c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:12:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e1a85ba9-17e2-4144-bb12-e3a6c1baba6f req-229eacb5-1cb1-4d42-b641-45faaeead089 service nova] Acquired lock "refresh_cache-a33991ce-e911-460d-a6d9-ca738830ef2c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:12:40 user nova-compute[74821]: DEBUG nova.network.neutron [req-e1a85ba9-17e2-4144-bb12-e3a6c1baba6f req-229eacb5-1cb1-4d42-b641-45faaeead089 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Refreshing network info cache for port 8b30affb-e2f5-4151-8fee-fb7edcaf5ae2 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:12:41 user nova-compute[74821]: DEBUG nova.network.neutron [req-e1a85ba9-17e2-4144-bb12-e3a6c1baba6f req-229eacb5-1cb1-4d42-b641-45faaeead089 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:12:42 user nova-compute[74821]: DEBUG nova.network.neutron [req-e1a85ba9-17e2-4144-bb12-e3a6c1baba6f req-229eacb5-1cb1-4d42-b641-45faaeead089 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:12:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e1a85ba9-17e2-4144-bb12-e3a6c1baba6f req-229eacb5-1cb1-4d42-b641-45faaeead089 service nova] Releasing lock "refresh_cache-a33991ce-e911-460d-a6d9-ca738830ef2c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:12:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:42 user nova-compute[74821]: DEBUG nova.network.neutron [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Successfully updated port: 66a37a87-3aa3-44cb-977f-eef4c8ab4e59 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:12:43 user nova-compute[74821]: DEBUG nova.compute.manager [req-1fc9069b-931f-457d-b003-7c7068e16c20 req-c2a1c44a-df87-4e23-89d0-e900bb135066 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-changed-66a37a87-3aa3-44cb-977f-eef4c8ab4e59 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:12:43 user nova-compute[74821]: DEBUG nova.compute.manager [req-1fc9069b-931f-457d-b003-7c7068e16c20 req-c2a1c44a-df87-4e23-89d0-e900bb135066 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Refreshing instance network info cache due to event network-changed-66a37a87-3aa3-44cb-977f-eef4c8ab4e59. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:12:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1fc9069b-931f-457d-b003-7c7068e16c20 req-c2a1c44a-df87-4e23-89d0-e900bb135066 service nova] Acquiring lock "refresh_cache-a33991ce-e911-460d-a6d9-ca738830ef2c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:12:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1fc9069b-931f-457d-b003-7c7068e16c20 req-c2a1c44a-df87-4e23-89d0-e900bb135066 service nova] Acquired lock "refresh_cache-a33991ce-e911-460d-a6d9-ca738830ef2c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:12:43 user nova-compute[74821]: DEBUG nova.network.neutron [req-1fc9069b-931f-457d-b003-7c7068e16c20 req-c2a1c44a-df87-4e23-89d0-e900bb135066 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Refreshing network info cache for port 66a37a87-3aa3-44cb-977f-eef4c8ab4e59 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:12:43 user nova-compute[74821]: DEBUG nova.network.neutron [req-1fc9069b-931f-457d-b003-7c7068e16c20 req-c2a1c44a-df87-4e23-89d0-e900bb135066 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:12:43 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:44 user nova-compute[74821]: DEBUG nova.network.neutron [req-1fc9069b-931f-457d-b003-7c7068e16c20 req-c2a1c44a-df87-4e23-89d0-e900bb135066 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:12:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1fc9069b-931f-457d-b003-7c7068e16c20 req-c2a1c44a-df87-4e23-89d0-e900bb135066 service nova] Releasing lock "refresh_cache-a33991ce-e911-460d-a6d9-ca738830ef2c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:12:44 user nova-compute[74821]: DEBUG nova.network.neutron [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Successfully updated port: 6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:12:45 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-1cbbe531-9f8e-47c9-a90a-6a56b1d94713 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Snapshot image upload complete
Nov 06 13:12:45 user nova-compute[74821]: DEBUG nova.compute.manager [None req-1cbbe531-9f8e-47c9-a90a-6a56b1d94713 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:12:45 user nova-compute[74821]: DEBUG nova.compute.manager [req-15fb1ea3-0e45-43e9-8287-81523922aca4 req-517ffc5a-7786-4a2c-a22b-feb6b3c450cc service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-changed-6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:12:45 user nova-compute[74821]: DEBUG nova.compute.manager [req-15fb1ea3-0e45-43e9-8287-81523922aca4 req-517ffc5a-7786-4a2c-a22b-feb6b3c450cc service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Refreshing instance network info cache due to event network-changed-6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:12:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-15fb1ea3-0e45-43e9-8287-81523922aca4 req-517ffc5a-7786-4a2c-a22b-feb6b3c450cc service nova] Acquiring lock "refresh_cache-a33991ce-e911-460d-a6d9-ca738830ef2c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:12:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-15fb1ea3-0e45-43e9-8287-81523922aca4 req-517ffc5a-7786-4a2c-a22b-feb6b3c450cc service nova] Acquired lock "refresh_cache-a33991ce-e911-460d-a6d9-ca738830ef2c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:12:45 user nova-compute[74821]: DEBUG nova.network.neutron [req-15fb1ea3-0e45-43e9-8287-81523922aca4 req-517ffc5a-7786-4a2c-a22b-feb6b3c450cc service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Refreshing network info cache for port 6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:12:45 user nova-compute[74821]: INFO nova.compute.manager [None req-1cbbe531-9f8e-47c9-a90a-6a56b1d94713 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Shelve offloading
Nov 06 13:12:45 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Instance destroyed successfully.
Nov 06 13:12:45 user nova-compute[74821]: DEBUG nova.compute.manager [None req-1cbbe531-9f8e-47c9-a90a-6a56b1d94713 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:12:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1cbbe531-9f8e-47c9-a90a-6a56b1d94713 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "refresh_cache-5a715806-ff8b-4502-8435-c5de3e3c688a" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:12:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1cbbe531-9f8e-47c9-a90a-6a56b1d94713 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquired lock "refresh_cache-5a715806-ff8b-4502-8435-c5de3e3c688a" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:12:45 user nova-compute[74821]: DEBUG nova.network.neutron [None req-1cbbe531-9f8e-47c9-a90a-6a56b1d94713 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:12:45 user nova-compute[74821]: DEBUG nova.network.neutron [req-15fb1ea3-0e45-43e9-8287-81523922aca4 req-517ffc5a-7786-4a2c-a22b-feb6b3c450cc service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:12:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Acquiring lock "a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:12:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Lock "a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:12:45 user nova-compute[74821]: DEBUG nova.compute.manager [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:12:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:12:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:12:45 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:12:45 user nova-compute[74821]: INFO nova.compute.claims [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Claim successful on node user
Nov 06 13:12:45 user nova-compute[74821]: DEBUG nova.network.neutron [req-15fb1ea3-0e45-43e9-8287-81523922aca4 req-517ffc5a-7786-4a2c-a22b-feb6b3c450cc service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:12:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-15fb1ea3-0e45-43e9-8287-81523922aca4 req-517ffc5a-7786-4a2c-a22b-feb6b3c450cc service nova] Releasing lock "refresh_cache-a33991ce-e911-460d-a6d9-ca738830ef2c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:12:46 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:12:46 user nova-compute[74821]: DEBUG nova.network.neutron [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Successfully updated port: 03c0a994-073b-4b58-8775-0ce28b2f404d {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:12:46 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:12:46 user nova-compute[74821]: DEBUG nova.network.neutron [None req-1cbbe531-9f8e-47c9-a90a-6a56b1d94713 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Updating instance_info_cache with network_info: [{"id": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "address": "fa:16:3e:e1:45:18", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69de9b4-53", "ovs_interfaceid": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:12:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.726s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:12:46 user nova-compute[74821]: DEBUG nova.compute.manager [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:12:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1cbbe531-9f8e-47c9-a90a-6a56b1d94713 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Releasing lock "refresh_cache-5a715806-ff8b-4502-8435-c5de3e3c688a" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:12:46 user nova-compute[74821]: DEBUG nova.compute.manager [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:12:46 user nova-compute[74821]: DEBUG nova.network.neutron [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:12:46 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:12:46 user nova-compute[74821]: DEBUG nova.compute.manager [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:12:46 user nova-compute[74821]: DEBUG nova.policy [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ee1d041e07fd4b7d8a5fcb864243058c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d784816c0f14c34afecba6292236040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:12:46 user nova-compute[74821]: DEBUG nova.compute.manager [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:12:46 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:12:46 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Creating image(s)
Nov 06 13:12:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:12:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Lock "/opt/stack/data/nova/instances/a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:12:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Lock "/opt/stack/data/nova/instances/a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:12:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.235s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG nova.compute.manager [req-0f920f90-852d-4510-9b47-acdd8d757486 req-e7c6aad0-7fa5-4afd-b659-1abd107982fd service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-changed-03c0a994-073b-4b58-8775-0ce28b2f404d {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG nova.compute.manager [req-0f920f90-852d-4510-9b47-acdd8d757486 req-e7c6aad0-7fa5-4afd-b659-1abd107982fd service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Refreshing instance network info cache due to event network-changed-03c0a994-073b-4b58-8775-0ce28b2f404d. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0f920f90-852d-4510-9b47-acdd8d757486 req-e7c6aad0-7fa5-4afd-b659-1abd107982fd service nova] Acquiring lock "refresh_cache-a33991ce-e911-460d-a6d9-ca738830ef2c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0f920f90-852d-4510-9b47-acdd8d757486 req-e7c6aad0-7fa5-4afd-b659-1abd107982fd service nova] Acquired lock "refresh_cache-a33991ce-e911-460d-a6d9-ca738830ef2c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG nova.network.neutron [req-0f920f90-852d-4510-9b47-acdd8d757486 req-e7c6aad0-7fa5-4afd-b659-1abd107982fd service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Refreshing network info cache for port 03c0a994-073b-4b58-8775-0ce28b2f404d {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.252s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG nova.compute.manager [req-209ed05d-8829-43b7-97b0-ae4775884e3d req-aad2af55-d6e9-427e-89ad-695d0aa13316 service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Received event network-changed-d69de9b4-5366-4d42-b01d-e4ec468a5aa2 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG nova.compute.manager [req-209ed05d-8829-43b7-97b0-ae4775884e3d req-aad2af55-d6e9-427e-89ad-695d0aa13316 service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Refreshing instance network info cache due to event network-changed-d69de9b4-5366-4d42-b01d-e4ec468a5aa2. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-209ed05d-8829-43b7-97b0-ae4775884e3d req-aad2af55-d6e9-427e-89ad-695d0aa13316 service nova] Acquiring lock "refresh_cache-5a715806-ff8b-4502-8435-c5de3e3c688a" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-209ed05d-8829-43b7-97b0-ae4775884e3d req-aad2af55-d6e9-427e-89ad-695d0aa13316 service nova] Acquired lock "refresh_cache-5a715806-ff8b-4502-8435-c5de3e3c688a" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG nova.network.neutron [req-209ed05d-8829-43b7-97b0-ae4775884e3d req-aad2af55-d6e9-427e-89ad-695d0aa13316 service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Refreshing network info cache for port d69de9b4-5366-4d42-b01d-e4ec468a5aa2 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3/disk 1073741824" returned: 0 in 0.067s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.324s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:47 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Instance destroyed successfully.
Nov 06 13:12:47 user nova-compute[74821]: DEBUG nova.network.neutron [req-0f920f90-852d-4510-9b47-acdd8d757486 req-e7c6aad0-7fa5-4afd-b659-1abd107982fd service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG nova.objects.instance [None req-1cbbe531-9f8e-47c9-a90a-6a56b1d94713 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lazy-loading 'resources' on Instance uuid 5a715806-ff8b-4502-8435-c5de3e3c688a {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-1cbbe531-9f8e-47c9-a90a-6a56b1d94713 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:10:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-618364180',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-618364180',id=5,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWZZ63YOurS3QQCnNbLxGOa0k9DS7+D4rT/d8IE1TCw1yktKSHhioYCsL5dOWBhVqUbiOYRyokgjKYeQc4mySnCoKy4j7QoOj+bJM6HYi7kjMQxkuBe6IfrmM0otAD68Q==',key_name='tempest-keypair-1555089865',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:10:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='07250ce4ef1b429f8a5c3c7763866763',ramdisk_id='',reservation_id='r-ls92k48z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-374688010',owner_user_name='tempest-AttachVolumeShelveTestJSON-374688010-project-member',shelved_at='2023-11-06T13:12:45.205446',shelved_host='user',shelved_image_id='a5275226-a56e-4fd2-bd58-624a723ef01d'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:12:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c82a5e63234e40f6a8e63b3cb4dc97b3',uuid=5a715806-ff8b-4502-8435-c5de3e3c688a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "address": "fa:16:3e:e1:45:18", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69de9b4-53", "ovs_interfaceid": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-1cbbe531-9f8e-47c9-a90a-6a56b1d94713 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Converting VIF {"id": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "address": "fa:16:3e:e1:45:18", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69de9b4-53", "ovs_interfaceid": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-1cbbe531-9f8e-47c9-a90a-6a56b1d94713 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:45:18,bridge_name='br-int',has_traffic_filtering=True,id=d69de9b4-5366-4d42-b01d-e4ec468a5aa2,network=Network(5318228c-491a-4ea1-a2b2-49ea8e15dccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69de9b4-53') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG os_vif [None req-1cbbe531-9f8e-47c9-a90a-6a56b1d94713 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:45:18,bridge_name='br-int',has_traffic_filtering=True,id=d69de9b4-5366-4d42-b01d-e4ec468a5aa2,network=Network(5318228c-491a-4ea1-a2b2-49ea8e15dccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69de9b4-53') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd69de9b4-53, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1f93284d-4114-4fb1-b842-8c1d1540f56d) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:12:47 user nova-compute[74821]: INFO os_vif [None req-1cbbe531-9f8e-47c9-a90a-6a56b1d94713 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:45:18,bridge_name='br-int',has_traffic_filtering=True,id=d69de9b4-5366-4d42-b01d-e4ec468a5aa2,network=Network(5318228c-491a-4ea1-a2b2-49ea8e15dccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69de9b4-53')
Nov 06 13:12:47 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-1cbbe531-9f8e-47c9-a90a-6a56b1d94713 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Deleting instance files /opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a_del
Nov 06 13:12:47 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-1cbbe531-9f8e-47c9-a90a-6a56b1d94713 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Deletion of /opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a_del complete
Nov 06 13:12:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.203s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-1cbbe531-9f8e-47c9-a90a-6a56b1d94713 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74821) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 06 13:12:47 user nova-compute[74821]: INFO nova.virt.libvirt.host [None req-1cbbe531-9f8e-47c9-a90a-6a56b1d94713 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] UEFI support detected
Nov 06 13:12:47 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-1cbbe531-9f8e-47c9-a90a-6a56b1d94713 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Deleted allocations for instance 5a715806-ff8b-4502-8435-c5de3e3c688a
Nov 06 13:12:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1cbbe531-9f8e-47c9-a90a-6a56b1d94713 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1cbbe531-9f8e-47c9-a90a-6a56b1d94713 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG nova.objects.instance [None req-1cbbe531-9f8e-47c9-a90a-6a56b1d94713 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lazy-loading 'numa_topology' on Instance uuid 5a715806-ff8b-4502-8435-c5de3e3c688a {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG nova.objects.base [None req-1cbbe531-9f8e-47c9-a90a-6a56b1d94713 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Object Instance<5a715806-ff8b-4502-8435-c5de3e3c688a> lazy-loaded attributes: resources,numa_topology {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Cannot resize image /opt/stack/data/nova/instances/a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Ensure instance console log exists: /opt/stack/data/nova/instances/a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:12:47 user nova-compute[74821]: DEBUG nova.network.neutron [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Successfully updated port: d3d9f17a-c9d8-4aaf-8015-dc9825335a25 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:12:48 user nova-compute[74821]: DEBUG nova.network.neutron [req-209ed05d-8829-43b7-97b0-ae4775884e3d req-aad2af55-d6e9-427e-89ad-695d0aa13316 service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Updated VIF entry in instance network info cache for port d69de9b4-5366-4d42-b01d-e4ec468a5aa2. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:12:48 user nova-compute[74821]: DEBUG nova.network.neutron [req-209ed05d-8829-43b7-97b0-ae4775884e3d req-aad2af55-d6e9-427e-89ad-695d0aa13316 service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Updating instance_info_cache with network_info: [{"id": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "address": "fa:16:3e:e1:45:18", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapd69de9b4-53", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:12:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-209ed05d-8829-43b7-97b0-ae4775884e3d req-aad2af55-d6e9-427e-89ad-695d0aa13316 service nova] Releasing lock "refresh_cache-5a715806-ff8b-4502-8435-c5de3e3c688a" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:12:48 user nova-compute[74821]: DEBUG nova.network.neutron [req-0f920f90-852d-4510-9b47-acdd8d757486 req-e7c6aad0-7fa5-4afd-b659-1abd107982fd service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:12:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0f920f90-852d-4510-9b47-acdd8d757486 req-e7c6aad0-7fa5-4afd-b659-1abd107982fd service nova] Releasing lock "refresh_cache-a33991ce-e911-460d-a6d9-ca738830ef2c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:12:48 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-1cbbe531-9f8e-47c9-a90a-6a56b1d94713 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:12:48 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-1cbbe531-9f8e-47c9-a90a-6a56b1d94713 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:12:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1cbbe531-9f8e-47c9-a90a-6a56b1d94713 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.515s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:12:48 user nova-compute[74821]: DEBUG nova.network.neutron [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Successfully created port: b9f947ae-c1a0-427e-9ef3-a8adc468e94b {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:12:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1cbbe531-9f8e-47c9-a90a-6a56b1d94713 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "5a715806-ff8b-4502-8435-c5de3e3c688a" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 10.112s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:12:48 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:49 user nova-compute[74821]: DEBUG nova.compute.manager [req-95ac9a3a-0339-44f7-b08c-78cfb2958142 req-318166f3-22af-41d8-92af-d135194f62e4 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-changed-d3d9f17a-c9d8-4aaf-8015-dc9825335a25 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:12:49 user nova-compute[74821]: DEBUG nova.compute.manager [req-95ac9a3a-0339-44f7-b08c-78cfb2958142 req-318166f3-22af-41d8-92af-d135194f62e4 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Refreshing instance network info cache due to event network-changed-d3d9f17a-c9d8-4aaf-8015-dc9825335a25. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:12:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-95ac9a3a-0339-44f7-b08c-78cfb2958142 req-318166f3-22af-41d8-92af-d135194f62e4 service nova] Acquiring lock "refresh_cache-a33991ce-e911-460d-a6d9-ca738830ef2c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:12:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-95ac9a3a-0339-44f7-b08c-78cfb2958142 req-318166f3-22af-41d8-92af-d135194f62e4 service nova] Acquired lock "refresh_cache-a33991ce-e911-460d-a6d9-ca738830ef2c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:12:49 user nova-compute[74821]: DEBUG nova.network.neutron [req-95ac9a3a-0339-44f7-b08c-78cfb2958142 req-318166f3-22af-41d8-92af-d135194f62e4 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Refreshing network info cache for port d3d9f17a-c9d8-4aaf-8015-dc9825335a25 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:12:49 user nova-compute[74821]: DEBUG nova.network.neutron [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Successfully updated port: f523111f-21f0-49ad-8e55-7515ebcfecff {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:12:49 user nova-compute[74821]: DEBUG nova.network.neutron [req-95ac9a3a-0339-44f7-b08c-78cfb2958142 req-318166f3-22af-41d8-92af-d135194f62e4 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:12:49 user nova-compute[74821]: DEBUG nova.network.neutron [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Successfully updated port: b9f947ae-c1a0-427e-9ef3-a8adc468e94b {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:12:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Acquiring lock "refresh_cache-a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:12:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Acquired lock "refresh_cache-a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:12:49 user nova-compute[74821]: DEBUG nova.network.neutron [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:12:49 user nova-compute[74821]: DEBUG nova.network.neutron [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:12:49 user nova-compute[74821]: DEBUG nova.network.neutron [req-95ac9a3a-0339-44f7-b08c-78cfb2958142 req-318166f3-22af-41d8-92af-d135194f62e4 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:12:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-95ac9a3a-0339-44f7-b08c-78cfb2958142 req-318166f3-22af-41d8-92af-d135194f62e4 service nova] Releasing lock "refresh_cache-a33991ce-e911-460d-a6d9-ca738830ef2c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG nova.network.neutron [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Updating instance_info_cache with network_info: [{"id": "b9f947ae-c1a0-427e-9ef3-a8adc468e94b", "address": "fa:16:3e:b3:97:a3", "network": {"id": "e73a1b38-3c27-4b87-a0f0-f746711d4363", "bridge": "br-int", "label": "tempest-VolumesActionsTest-544363737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d784816c0f14c34afecba6292236040", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9f947ae-c1", "ovs_interfaceid": "b9f947ae-c1a0-427e-9ef3-a8adc468e94b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Releasing lock "refresh_cache-a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG nova.compute.manager [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Instance network_info: |[{"id": "b9f947ae-c1a0-427e-9ef3-a8adc468e94b", "address": "fa:16:3e:b3:97:a3", "network": {"id": "e73a1b38-3c27-4b87-a0f0-f746711d4363", "bridge": "br-int", "label": "tempest-VolumesActionsTest-544363737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d784816c0f14c34afecba6292236040", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9f947ae-c1", "ovs_interfaceid": "b9f947ae-c1a0-427e-9ef3-a8adc468e94b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Start _get_guest_xml network_info=[{"id": "b9f947ae-c1a0-427e-9ef3-a8adc468e94b", "address": "fa:16:3e:b3:97:a3", "network": {"id": "e73a1b38-3c27-4b87-a0f0-f746711d4363", "bridge": "br-int", "label": "tempest-VolumesActionsTest-544363737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d784816c0f14c34afecba6292236040", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9f947ae-c1", "ovs_interfaceid": "b9f947ae-c1a0-427e-9ef3-a8adc468e94b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:12:50 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:12:50 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:12:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-625931241',display_name='tempest-VolumesActionsTest-instance-625931241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-625931241',id=12,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d784816c0f14c34afecba6292236040',ramdisk_id='',reservation_id='r-zu3zgz2o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1240738149',owner_user_name='tempest-VolumesActionsTest-1240738149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:12:47Z,user_data=None,user_id='ee1d041e07fd4b7d8a5fcb864243058c',uuid=a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9f947ae-c1a0-427e-9ef3-a8adc468e94b", "address": "fa:16:3e:b3:97:a3", "network": {"id": "e73a1b38-3c27-4b87-a0f0-f746711d4363", "bridge": "br-int", "label": "tempest-VolumesActionsTest-544363737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d784816c0f14c34afecba6292236040", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9f947ae-c1", "ovs_interfaceid": "b9f947ae-c1a0-427e-9ef3-a8adc468e94b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Converting VIF {"id": "b9f947ae-c1a0-427e-9ef3-a8adc468e94b", "address": "fa:16:3e:b3:97:a3", "network": {"id": "e73a1b38-3c27-4b87-a0f0-f746711d4363", "bridge": "br-int", "label": "tempest-VolumesActionsTest-544363737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d784816c0f14c34afecba6292236040", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9f947ae-c1", "ovs_interfaceid": "b9f947ae-c1a0-427e-9ef3-a8adc468e94b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:97:a3,bridge_name='br-int',has_traffic_filtering=True,id=b9f947ae-c1a0-427e-9ef3-a8adc468e94b,network=Network(e73a1b38-3c27-4b87-a0f0-f746711d4363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9f947ae-c1') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG nova.objects.instance [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Lazy-loading 'pci_devices' on Instance uuid a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG nova.compute.manager [req-bbb30ec9-ccbf-448b-8bba-e84fe38c2122 req-8444a6dd-8ece-4cd5-94c9-7cd8e3f3462f service nova] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Received event network-changed-93600b1e-7a16-42b2-8577-440a7d7f0667 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG nova.compute.manager [req-bbb30ec9-ccbf-448b-8bba-e84fe38c2122 req-8444a6dd-8ece-4cd5-94c9-7cd8e3f3462f service nova] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Refreshing instance network info cache due to event network-changed-93600b1e-7a16-42b2-8577-440a7d7f0667. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-bbb30ec9-ccbf-448b-8bba-e84fe38c2122 req-8444a6dd-8ece-4cd5-94c9-7cd8e3f3462f service nova] Acquiring lock "refresh_cache-86ccb546-94c4-482c-8017-852cd42999fe" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-bbb30ec9-ccbf-448b-8bba-e84fe38c2122 req-8444a6dd-8ece-4cd5-94c9-7cd8e3f3462f service nova] Acquired lock "refresh_cache-86ccb546-94c4-482c-8017-852cd42999fe" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG nova.network.neutron [req-bbb30ec9-ccbf-448b-8bba-e84fe38c2122 req-8444a6dd-8ece-4cd5-94c9-7cd8e3f3462f service nova] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Refreshing network info cache for port 93600b1e-7a16-42b2-8577-440a7d7f0667 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:12:50 user nova-compute[74821]:   <uuid>a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3</uuid>
Nov 06 13:12:50 user nova-compute[74821]:   <name>instance-0000000c</name>
Nov 06 13:12:50 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:12:50 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:12:50 user nova-compute[74821]:   <metadata>
Nov 06 13:12:50 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:12:50 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:12:50 user nova-compute[74821]:       <nova:name>tempest-VolumesActionsTest-instance-625931241</nova:name>
Nov 06 13:12:50 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:12:50</nova:creationTime>
Nov 06 13:12:50 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:12:50 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:12:50 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:12:50 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:12:50 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:12:50 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:12:50 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:12:50 user nova-compute[74821]:       <nova:owner>
Nov 06 13:12:50 user nova-compute[74821]:         <nova:user uuid="ee1d041e07fd4b7d8a5fcb864243058c">tempest-VolumesActionsTest-1240738149-project-member</nova:user>
Nov 06 13:12:50 user nova-compute[74821]:         <nova:project uuid="6d784816c0f14c34afecba6292236040">tempest-VolumesActionsTest-1240738149</nova:project>
Nov 06 13:12:50 user nova-compute[74821]:       </nova:owner>
Nov 06 13:12:50 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:12:50 user nova-compute[74821]:       <nova:ports>
Nov 06 13:12:50 user nova-compute[74821]:         <nova:port uuid="b9f947ae-c1a0-427e-9ef3-a8adc468e94b">
Nov 06 13:12:50 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 13:12:50 user nova-compute[74821]:         </nova:port>
Nov 06 13:12:50 user nova-compute[74821]:       </nova:ports>
Nov 06 13:12:50 user nova-compute[74821]:     </nova:instance>
Nov 06 13:12:50 user nova-compute[74821]:   </metadata>
Nov 06 13:12:50 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:12:50 user nova-compute[74821]:     <system>
Nov 06 13:12:50 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:12:50 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:12:50 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:12:50 user nova-compute[74821]:       <entry name="serial">a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3</entry>
Nov 06 13:12:50 user nova-compute[74821]:       <entry name="uuid">a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3</entry>
Nov 06 13:12:50 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:12:50 user nova-compute[74821]:     </system>
Nov 06 13:12:50 user nova-compute[74821]:   </sysinfo>
Nov 06 13:12:50 user nova-compute[74821]:   <os>
Nov 06 13:12:50 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:12:50 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:12:50 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:12:50 user nova-compute[74821]:   </os>
Nov 06 13:12:50 user nova-compute[74821]:   <features>
Nov 06 13:12:50 user nova-compute[74821]:     <acpi/>
Nov 06 13:12:50 user nova-compute[74821]:     <apic/>
Nov 06 13:12:50 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:12:50 user nova-compute[74821]:   </features>
Nov 06 13:12:50 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:12:50 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:12:50 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:12:50 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:12:50 user nova-compute[74821]:   </clock>
Nov 06 13:12:50 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:12:50 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:12:50 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:12:50 user nova-compute[74821]:   </cpu>
Nov 06 13:12:50 user nova-compute[74821]:   <devices>
Nov 06 13:12:50 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:12:50 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:12:50 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3/disk"/>
Nov 06 13:12:50 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:12:50 user nova-compute[74821]:     </disk>
Nov 06 13:12:50 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:12:50 user nova-compute[74821]:       <mac address="fa:16:3e:b3:97:a3"/>
Nov 06 13:12:50 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:12:50 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:12:50 user nova-compute[74821]:       <target dev="tapb9f947ae-c1"/>
Nov 06 13:12:50 user nova-compute[74821]:     </interface>
Nov 06 13:12:50 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:12:50 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3/console.log" append="off"/>
Nov 06 13:12:50 user nova-compute[74821]:     </serial>
Nov 06 13:12:50 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:12:50 user nova-compute[74821]:     <video>
Nov 06 13:12:50 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:12:50 user nova-compute[74821]:     </video>
Nov 06 13:12:50 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:12:50 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:12:50 user nova-compute[74821]:     </rng>
Nov 06 13:12:50 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:12:50 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:12:50 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:12:50 user nova-compute[74821]:     </memballoon>
Nov 06 13:12:50 user nova-compute[74821]:   </devices>
Nov 06 13:12:50 user nova-compute[74821]: </domain>
Nov 06 13:12:50 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-625931241',display_name='tempest-VolumesActionsTest-instance-625931241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-625931241',id=12,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d784816c0f14c34afecba6292236040',ramdisk_id='',reservation_id='r-zu3zgz2o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1240738149',owner_user_name='tempest-VolumesActionsTest-1240738149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:12:47Z,user_data=None,user_id='ee1d041e07fd4b7d8a5fcb864243058c',uuid=a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9f947ae-c1a0-427e-9ef3-a8adc468e94b", "address": "fa:16:3e:b3:97:a3", "network": {"id": "e73a1b38-3c27-4b87-a0f0-f746711d4363", "bridge": "br-int", "label": "tempest-VolumesActionsTest-544363737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d784816c0f14c34afecba6292236040", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9f947ae-c1", "ovs_interfaceid": "b9f947ae-c1a0-427e-9ef3-a8adc468e94b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Converting VIF {"id": "b9f947ae-c1a0-427e-9ef3-a8adc468e94b", "address": "fa:16:3e:b3:97:a3", "network": {"id": "e73a1b38-3c27-4b87-a0f0-f746711d4363", "bridge": "br-int", "label": "tempest-VolumesActionsTest-544363737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d784816c0f14c34afecba6292236040", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9f947ae-c1", "ovs_interfaceid": "b9f947ae-c1a0-427e-9ef3-a8adc468e94b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:97:a3,bridge_name='br-int',has_traffic_filtering=True,id=b9f947ae-c1a0-427e-9ef3-a8adc468e94b,network=Network(e73a1b38-3c27-4b87-a0f0-f746711d4363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9f947ae-c1') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG os_vif [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:97:a3,bridge_name='br-int',has_traffic_filtering=True,id=b9f947ae-c1a0-427e-9ef3-a8adc468e94b,network=Network(e73a1b38-3c27-4b87-a0f0-f746711d4363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9f947ae-c1') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '643e036c-f2df-58be-81e0-34970653f51e', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9f947ae-c1, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb9f947ae-c1, col_values=(('qos', UUID('aff9fd8f-5e65-470a-853e-57881465b797')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb9f947ae-c1, col_values=(('external_ids', {'iface-id': 'b9f947ae-c1a0-427e-9ef3-a8adc468e94b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:97:a3', 'vm-uuid': 'a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:50 user nova-compute[74821]: INFO os_vif [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:97:a3,bridge_name='br-int',has_traffic_filtering=True,id=b9f947ae-c1a0-427e-9ef3-a8adc468e94b,network=Network(e73a1b38-3c27-4b87-a0f0-f746711d4363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9f947ae-c1')
Nov 06 13:12:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] No VIF found with MAC fa:16:3e:b3:97:a3, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG nova.network.neutron [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Successfully updated port: 027b08d1-100c-4dc6-9e51-a435642f25f9 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Acquiring lock "refresh_cache-a33991ce-e911-460d-a6d9-ca738830ef2c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Acquired lock "refresh_cache-a33991ce-e911-460d-a6d9-ca738830ef2c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG nova.network.neutron [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:12:50 user nova-compute[74821]: DEBUG nova.network.neutron [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:12:51 user nova-compute[74821]: DEBUG nova.network.neutron [req-bbb30ec9-ccbf-448b-8bba-e84fe38c2122 req-8444a6dd-8ece-4cd5-94c9-7cd8e3f3462f service nova] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Updated VIF entry in instance network info cache for port 93600b1e-7a16-42b2-8577-440a7d7f0667. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:12:51 user nova-compute[74821]: DEBUG nova.network.neutron [req-bbb30ec9-ccbf-448b-8bba-e84fe38c2122 req-8444a6dd-8ece-4cd5-94c9-7cd8e3f3462f service nova] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Updating instance_info_cache with network_info: [{"id": "93600b1e-7a16-42b2-8577-440a7d7f0667", "address": "fa:16:3e:ba:c2:bf", "network": {"id": "1b5b94d0-ef68-400c-b1f8-5f2892422587", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-185086197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67451985a44547f1b99750173d9c24bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93600b1e-7a", "ovs_interfaceid": "93600b1e-7a16-42b2-8577-440a7d7f0667", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:12:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-bbb30ec9-ccbf-448b-8bba-e84fe38c2122 req-8444a6dd-8ece-4cd5-94c9-7cd8e3f3462f service nova] Releasing lock "refresh_cache-86ccb546-94c4-482c-8017-852cd42999fe" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:12:51 user nova-compute[74821]: DEBUG nova.compute.manager [req-130d1efe-ab8c-4141-a302-fa785d227932 req-350c7978-51b1-433d-a71a-5661ea195efc service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-changed-f523111f-21f0-49ad-8e55-7515ebcfecff {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:12:51 user nova-compute[74821]: DEBUG nova.compute.manager [req-130d1efe-ab8c-4141-a302-fa785d227932 req-350c7978-51b1-433d-a71a-5661ea195efc service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Refreshing instance network info cache due to event network-changed-f523111f-21f0-49ad-8e55-7515ebcfecff. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:12:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-130d1efe-ab8c-4141-a302-fa785d227932 req-350c7978-51b1-433d-a71a-5661ea195efc service nova] Acquiring lock "refresh_cache-a33991ce-e911-460d-a6d9-ca738830ef2c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:12:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-b95ce7c0-f30f-4706-b57b-8e4b764efe54 req-856959dd-6eaf-4021-a820-7eced82f8979 service nova] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Received event network-vif-plugged-b9f947ae-c1a0-427e-9ef3-a8adc468e94b {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:12:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b95ce7c0-f30f-4706-b57b-8e4b764efe54 req-856959dd-6eaf-4021-a820-7eced82f8979 service nova] Acquiring lock "a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:12:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b95ce7c0-f30f-4706-b57b-8e4b764efe54 req-856959dd-6eaf-4021-a820-7eced82f8979 service nova] Lock "a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:12:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b95ce7c0-f30f-4706-b57b-8e4b764efe54 req-856959dd-6eaf-4021-a820-7eced82f8979 service nova] Lock "a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:12:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-b95ce7c0-f30f-4706-b57b-8e4b764efe54 req-856959dd-6eaf-4021-a820-7eced82f8979 service nova] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] No waiting events found dispatching network-vif-plugged-b9f947ae-c1a0-427e-9ef3-a8adc468e94b {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:12:52 user nova-compute[74821]: WARNING nova.compute.manager [req-b95ce7c0-f30f-4706-b57b-8e4b764efe54 req-856959dd-6eaf-4021-a820-7eced82f8979 service nova] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Received unexpected event network-vif-plugged-b9f947ae-c1a0-427e-9ef3-a8adc468e94b for instance with vm_state building and task_state spawning.
Nov 06 13:12:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:53 user nova-compute[74821]: DEBUG nova.network.neutron [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Updating instance_info_cache with network_info: [{"id": "8b30affb-e2f5-4151-8fee-fb7edcaf5ae2", "address": "fa:16:3e:6f:35:3a", "network": {"id": "e3826bc5-7316-4738-b8b1-27551cd142ca", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1941910960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b30affb-e2", "ovs_interfaceid": "8b30affb-e2f5-4151-8fee-fb7edcaf5ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "66a37a87-3aa3-44cb-977f-eef4c8ab4e59", "address": "fa:16:3e:74:5e:90", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a37a87-3a", "ovs_interfaceid": "66a37a87-3aa3-44cb-977f-eef4c8ab4e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd", "address": "fa:16:3e:51:39:be", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa9ef4f-04", "ovs_interfaceid": "6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "03c0a994-073b-4b58-8775-0ce28b2f404d", "address": "fa:16:3e:55:e6:a3", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03c0a994-07", "ovs_interfaceid": "03c0a994-073b-4b58-8775-0ce28b2f404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3d9f17a-c9d8-4aaf-8015-dc9825335a25", "address": "fa:16:3e:e8:a8:6c", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d9f17a-c9", "ovs_interfaceid": "d3d9f17a-c9d8-4aaf-8015-dc9825335a25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f523111f-21f0-49ad-8e55-7515ebcfecff", "address": "fa:16:3e:87:21:4b", "network": {"id": "b92087b6-80a8-444b-8732-c31c6e17d4f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-584352862", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf523111f-21", "ovs_interfaceid": "f523111f-21f0-49ad-8e55-7515ebcfecff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "027b08d1-100c-4dc6-9e51-a435642f25f9", "address": "fa:16:3e:9a:3b:d1", "network": {"id": "b92087b6-80a8-444b-8732-c31c6e17d4f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-584352862", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027b08d1-10", "ovs_interfaceid": "027b08d1-100c-4dc6-9e51-a435642f25f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:12:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Releasing lock "refresh_cache-a33991ce-e911-460d-a6d9-ca738830ef2c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:12:53 user nova-compute[74821]: DEBUG nova.compute.manager [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Instance network_info: |[{"id": "8b30affb-e2f5-4151-8fee-fb7edcaf5ae2", "address": "fa:16:3e:6f:35:3a", "network": {"id": "e3826bc5-7316-4738-b8b1-27551cd142ca", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1941910960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b30affb-e2", "ovs_interfaceid": "8b30affb-e2f5-4151-8fee-fb7edcaf5ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "66a37a87-3aa3-44cb-977f-eef4c8ab4e59", "address": "fa:16:3e:74:5e:90", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a37a87-3a", "ovs_interfaceid": "66a37a87-3aa3-44cb-977f-eef4c8ab4e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd", "address": "fa:16:3e:51:39:be", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa9ef4f-04", "ovs_interfaceid": "6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "03c0a994-073b-4b58-8775-0ce28b2f404d", "address": "fa:16:3e:55:e6:a3", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03c0a994-07", "ovs_interfaceid": "03c0a994-073b-4b58-8775-0ce28b2f404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3d9f17a-c9d8-4aaf-8015-dc9825335a25", "address": "fa:16:3e:e8:a8:6c", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d9f17a-c9", "ovs_interfaceid": "d3d9f17a-c9d8-4aaf-8015-dc9825335a25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f523111f-21f0-49ad-8e55-7515ebcfecff", "address": "fa:16:3e:87:21:4b", "network": {"id": "b92087b6-80a8-444b-8732-c31c6e17d4f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-584352862", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf523111f-21", "ovs_interfaceid": "f523111f-21f0-49ad-8e55-7515ebcfecff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "027b08d1-100c-4dc6-9e51-a435642f25f9", "address": "fa:16:3e:9a:3b:d1", "network": {"id": "b92087b6-80a8-444b-8732-c31c6e17d4f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-584352862", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027b08d1-10", "ovs_interfaceid": "027b08d1-100c-4dc6-9e51-a435642f25f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:12:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-130d1efe-ab8c-4141-a302-fa785d227932 req-350c7978-51b1-433d-a71a-5661ea195efc service nova] Acquired lock "refresh_cache-a33991ce-e911-460d-a6d9-ca738830ef2c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:12:53 user nova-compute[74821]: DEBUG nova.network.neutron [req-130d1efe-ab8c-4141-a302-fa785d227932 req-350c7978-51b1-433d-a71a-5661ea195efc service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Refreshing network info cache for port f523111f-21f0-49ad-8e55-7515ebcfecff {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:12:53 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:53 user nova-compute[74821]: DEBUG nova.network.neutron [req-130d1efe-ab8c-4141-a302-fa785d227932 req-350c7978-51b1-433d-a71a-5661ea195efc service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Updated VIF entry in instance network info cache for port f523111f-21f0-49ad-8e55-7515ebcfecff. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:12:53 user nova-compute[74821]: DEBUG nova.network.neutron [req-130d1efe-ab8c-4141-a302-fa785d227932 req-350c7978-51b1-433d-a71a-5661ea195efc service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Updating instance_info_cache with network_info: [{"id": "8b30affb-e2f5-4151-8fee-fb7edcaf5ae2", "address": "fa:16:3e:6f:35:3a", "network": {"id": "e3826bc5-7316-4738-b8b1-27551cd142ca", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1941910960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b30affb-e2", "ovs_interfaceid": "8b30affb-e2f5-4151-8fee-fb7edcaf5ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "66a37a87-3aa3-44cb-977f-eef4c8ab4e59", "address": "fa:16:3e:74:5e:90", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a37a87-3a", "ovs_interfaceid": "66a37a87-3aa3-44cb-977f-eef4c8ab4e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd", "address": "fa:16:3e:51:39:be", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa9ef4f-04", "ovs_interfaceid": "6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "03c0a994-073b-4b58-8775-0ce28b2f404d", "address": "fa:16:3e:55:e6:a3", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03c0a994-07", "ovs_interfaceid": "03c0a994-073b-4b58-8775-0ce28b2f404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3d9f17a-c9d8-4aaf-8015-dc9825335a25", "address": "fa:16:3e:e8:a8:6c", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d9f17a-c9", "ovs_interfaceid": "d3d9f17a-c9d8-4aaf-8015-dc9825335a25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f523111f-21f0-49ad-8e55-7515ebcfecff", "address": "fa:16:3e:87:21:4b", "network": {"id": "b92087b6-80a8-444b-8732-c31c6e17d4f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-584352862", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf523111f-21", "ovs_interfaceid": "f523111f-21f0-49ad-8e55-7515ebcfecff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "027b08d1-100c-4dc6-9e51-a435642f25f9", "address": "fa:16:3e:9a:3b:d1", "network": {"id": "b92087b6-80a8-444b-8732-c31c6e17d4f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-584352862", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027b08d1-10", "ovs_interfaceid": "027b08d1-100c-4dc6-9e51-a435642f25f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:12:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-130d1efe-ab8c-4141-a302-fa785d227932 req-350c7978-51b1-433d-a71a-5661ea195efc service nova] Releasing lock "refresh_cache-a33991ce-e911-460d-a6d9-ca738830ef2c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:12:53 user nova-compute[74821]: DEBUG nova.compute.manager [req-130d1efe-ab8c-4141-a302-fa785d227932 req-350c7978-51b1-433d-a71a-5661ea195efc service nova] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Received event network-changed-b9f947ae-c1a0-427e-9ef3-a8adc468e94b {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:12:53 user nova-compute[74821]: DEBUG nova.compute.manager [req-130d1efe-ab8c-4141-a302-fa785d227932 req-350c7978-51b1-433d-a71a-5661ea195efc service nova] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Refreshing instance network info cache due to event network-changed-b9f947ae-c1a0-427e-9ef3-a8adc468e94b. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:12:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-130d1efe-ab8c-4141-a302-fa785d227932 req-350c7978-51b1-433d-a71a-5661ea195efc service nova] Acquiring lock "refresh_cache-a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:12:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-130d1efe-ab8c-4141-a302-fa785d227932 req-350c7978-51b1-433d-a71a-5661ea195efc service nova] Acquired lock "refresh_cache-a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:12:54 user nova-compute[74821]: DEBUG nova.network.neutron [req-130d1efe-ab8c-4141-a302-fa785d227932 req-350c7978-51b1-433d-a71a-5661ea195efc service nova] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Refreshing network info cache for port b9f947ae-c1a0-427e-9ef3-a8adc468e94b {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:12:54 user nova-compute[74821]: DEBUG nova.network.neutron [req-130d1efe-ab8c-4141-a302-fa785d227932 req-350c7978-51b1-433d-a71a-5661ea195efc service nova] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Updated VIF entry in instance network info cache for port b9f947ae-c1a0-427e-9ef3-a8adc468e94b. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:12:54 user nova-compute[74821]: DEBUG nova.network.neutron [req-130d1efe-ab8c-4141-a302-fa785d227932 req-350c7978-51b1-433d-a71a-5661ea195efc service nova] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Updating instance_info_cache with network_info: [{"id": "b9f947ae-c1a0-427e-9ef3-a8adc468e94b", "address": "fa:16:3e:b3:97:a3", "network": {"id": "e73a1b38-3c27-4b87-a0f0-f746711d4363", "bridge": "br-int", "label": "tempest-VolumesActionsTest-544363737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d784816c0f14c34afecba6292236040", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9f947ae-c1", "ovs_interfaceid": "b9f947ae-c1a0-427e-9ef3-a8adc468e94b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:12:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-130d1efe-ab8c-4141-a302-fa785d227932 req-350c7978-51b1-433d-a71a-5661ea195efc service nova] Releasing lock "refresh_cache-a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:12:54 user nova-compute[74821]: DEBUG nova.compute.manager [req-130d1efe-ab8c-4141-a302-fa785d227932 req-350c7978-51b1-433d-a71a-5661ea195efc service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-changed-027b08d1-100c-4dc6-9e51-a435642f25f9 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:12:54 user nova-compute[74821]: DEBUG nova.compute.manager [req-130d1efe-ab8c-4141-a302-fa785d227932 req-350c7978-51b1-433d-a71a-5661ea195efc service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Refreshing instance network info cache due to event network-changed-027b08d1-100c-4dc6-9e51-a435642f25f9. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:12:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-130d1efe-ab8c-4141-a302-fa785d227932 req-350c7978-51b1-433d-a71a-5661ea195efc service nova] Acquiring lock "refresh_cache-a33991ce-e911-460d-a6d9-ca738830ef2c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:12:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-130d1efe-ab8c-4141-a302-fa785d227932 req-350c7978-51b1-433d-a71a-5661ea195efc service nova] Acquired lock "refresh_cache-a33991ce-e911-460d-a6d9-ca738830ef2c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:12:54 user nova-compute[74821]: DEBUG nova.network.neutron [req-130d1efe-ab8c-4141-a302-fa785d227932 req-350c7978-51b1-433d-a71a-5661ea195efc service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Refreshing network info cache for port 027b08d1-100c-4dc6-9e51-a435642f25f9 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:12:54 user nova-compute[74821]: DEBUG nova.compute.manager [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:12:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:12:54 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Instance spawned successfully.
Nov 06 13:12:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:12:54 user nova-compute[74821]: DEBUG nova.compute.manager [req-e3a6b7fe-c1f8-4415-a81b-24c85cedab07 req-dc710bad-d5f7-4cd1-83ad-d7296c67a58b service nova] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Received event network-vif-plugged-b9f947ae-c1a0-427e-9ef3-a8adc468e94b {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:12:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e3a6b7fe-c1f8-4415-a81b-24c85cedab07 req-dc710bad-d5f7-4cd1-83ad-d7296c67a58b service nova] Acquiring lock "a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:12:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e3a6b7fe-c1f8-4415-a81b-24c85cedab07 req-dc710bad-d5f7-4cd1-83ad-d7296c67a58b service nova] Lock "a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:12:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e3a6b7fe-c1f8-4415-a81b-24c85cedab07 req-dc710bad-d5f7-4cd1-83ad-d7296c67a58b service nova] Lock "a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:12:54 user nova-compute[74821]: DEBUG nova.compute.manager [req-e3a6b7fe-c1f8-4415-a81b-24c85cedab07 req-dc710bad-d5f7-4cd1-83ad-d7296c67a58b service nova] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] No waiting events found dispatching network-vif-plugged-b9f947ae-c1a0-427e-9ef3-a8adc468e94b {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:12:54 user nova-compute[74821]: WARNING nova.compute.manager [req-e3a6b7fe-c1f8-4415-a81b-24c85cedab07 req-dc710bad-d5f7-4cd1-83ad-d7296c67a58b service nova] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Received unexpected event network-vif-plugged-b9f947ae-c1a0-427e-9ef3-a8adc468e94b for instance with vm_state building and task_state spawning.
Nov 06 13:12:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:12:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:12:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:12:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:12:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:12:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:12:54 user nova-compute[74821]: INFO nova.compute.manager [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Took 7.87 seconds to spawn the instance on the hypervisor.
Nov 06 13:12:54 user nova-compute[74821]: DEBUG nova.compute.manager [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:12:54 user nova-compute[74821]: INFO nova.compute.manager [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Took 9.04 seconds to build instance.
Nov 06 13:12:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4f80ef53-6289-456a-a72f-091a233291e6 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Lock "a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.171s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:12:55 user nova-compute[74821]: DEBUG nova.network.neutron [req-130d1efe-ab8c-4141-a302-fa785d227932 req-350c7978-51b1-433d-a71a-5661ea195efc service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Updated VIF entry in instance network info cache for port 027b08d1-100c-4dc6-9e51-a435642f25f9. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:12:55 user nova-compute[74821]: DEBUG nova.network.neutron [req-130d1efe-ab8c-4141-a302-fa785d227932 req-350c7978-51b1-433d-a71a-5661ea195efc service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Updating instance_info_cache with network_info: [{"id": "8b30affb-e2f5-4151-8fee-fb7edcaf5ae2", "address": "fa:16:3e:6f:35:3a", "network": {"id": "e3826bc5-7316-4738-b8b1-27551cd142ca", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1941910960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b30affb-e2", "ovs_interfaceid": "8b30affb-e2f5-4151-8fee-fb7edcaf5ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "66a37a87-3aa3-44cb-977f-eef4c8ab4e59", "address": "fa:16:3e:74:5e:90", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a37a87-3a", "ovs_interfaceid": "66a37a87-3aa3-44cb-977f-eef4c8ab4e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd", "address": "fa:16:3e:51:39:be", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa9ef4f-04", "ovs_interfaceid": "6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "03c0a994-073b-4b58-8775-0ce28b2f404d", "address": "fa:16:3e:55:e6:a3", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03c0a994-07", "ovs_interfaceid": "03c0a994-073b-4b58-8775-0ce28b2f404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3d9f17a-c9d8-4aaf-8015-dc9825335a25", "address": "fa:16:3e:e8:a8:6c", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d9f17a-c9", "ovs_interfaceid": "d3d9f17a-c9d8-4aaf-8015-dc9825335a25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f523111f-21f0-49ad-8e55-7515ebcfecff", "address": "fa:16:3e:87:21:4b", "network": {"id": "b92087b6-80a8-444b-8732-c31c6e17d4f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-584352862", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf523111f-21", "ovs_interfaceid": "f523111f-21f0-49ad-8e55-7515ebcfecff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "027b08d1-100c-4dc6-9e51-a435642f25f9", "address": "fa:16:3e:9a:3b:d1", "network": {"id": "b92087b6-80a8-444b-8732-c31c6e17d4f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-584352862", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027b08d1-10", "ovs_interfaceid": "027b08d1-100c-4dc6-9e51-a435642f25f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:12:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-130d1efe-ab8c-4141-a302-fa785d227932 req-350c7978-51b1-433d-a71a-5661ea195efc service nova] Releasing lock "refresh_cache-a33991ce-e911-460d-a6d9-ca738830ef2c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:12:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:12:58 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:00 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:04 user nova-compute[74821]: DEBUG nova.compute.manager [req-40035dc4-f87a-4912-824c-3841259f8708 req-01d49f44-9ece-4173-9888-edcab17edfb7 service nova] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Received event network-changed-95f3755e-a074-4956-ba1d-5c05945bcff5 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:13:04 user nova-compute[74821]: DEBUG nova.compute.manager [req-40035dc4-f87a-4912-824c-3841259f8708 req-01d49f44-9ece-4173-9888-edcab17edfb7 service nova] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Refreshing instance network info cache due to event network-changed-95f3755e-a074-4956-ba1d-5c05945bcff5. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:13:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-40035dc4-f87a-4912-824c-3841259f8708 req-01d49f44-9ece-4173-9888-edcab17edfb7 service nova] Acquiring lock "refresh_cache-49d05da1-3222-4f9f-b792-8f3d1f0f2890" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:13:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-40035dc4-f87a-4912-824c-3841259f8708 req-01d49f44-9ece-4173-9888-edcab17edfb7 service nova] Acquired lock "refresh_cache-49d05da1-3222-4f9f-b792-8f3d1f0f2890" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:13:04 user nova-compute[74821]: DEBUG nova.network.neutron [req-40035dc4-f87a-4912-824c-3841259f8708 req-01d49f44-9ece-4173-9888-edcab17edfb7 service nova] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Refreshing network info cache for port 95f3755e-a074-4956-ba1d-5c05945bcff5 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:13:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Acquiring lock "49d05da1-3222-4f9f-b792-8f3d1f0f2890" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:13:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Lock "49d05da1-3222-4f9f-b792-8f3d1f0f2890" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:13:05 user nova-compute[74821]: DEBUG nova.objects.instance [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Lazy-loading 'flavor' on Instance uuid 49d05da1-3222-4f9f-b792-8f3d1f0f2890 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:13:05 user nova-compute[74821]: DEBUG nova.network.neutron [req-40035dc4-f87a-4912-824c-3841259f8708 req-01d49f44-9ece-4173-9888-edcab17edfb7 service nova] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Updated VIF entry in instance network info cache for port 95f3755e-a074-4956-ba1d-5c05945bcff5. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:13:05 user nova-compute[74821]: DEBUG nova.network.neutron [req-40035dc4-f87a-4912-824c-3841259f8708 req-01d49f44-9ece-4173-9888-edcab17edfb7 service nova] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Updating instance_info_cache with network_info: [{"id": "95f3755e-a074-4956-ba1d-5c05945bcff5", "address": "fa:16:3e:17:16:45", "network": {"id": "feb774a4-8d45-4814-bc23-169b2b378e48", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-639136774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0afa9994148b4f9698f0a9cc7c8d1a5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f3755e-a0", "ovs_interfaceid": "95f3755e-a074-4956-ba1d-5c05945bcff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:13:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Lock "49d05da1-3222-4f9f-b792-8f3d1f0f2890" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:13:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-40035dc4-f87a-4912-824c-3841259f8708 req-01d49f44-9ece-4173-9888-edcab17edfb7 service nova] Releasing lock "refresh_cache-49d05da1-3222-4f9f-b792-8f3d1f0f2890" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:13:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Acquiring lock "49d05da1-3222-4f9f-b792-8f3d1f0f2890" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:13:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Lock "49d05da1-3222-4f9f-b792-8f3d1f0f2890" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:13:05 user nova-compute[74821]: INFO nova.compute.manager [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Attaching volume 41948e07-1ed7-473c-b90d-cfea7069fe1c to /dev/vdb
Nov 06 13:13:05 user nova-compute[74821]: DEBUG os_brick.utils [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:13:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdc3de4-6386-4df6-a50b-00f14b887df7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a399ac-0671-4385-acb4-d24d3830e0c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d40c90b-628a-43bc-80f2-a0141d5464e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e16e1c8-8ca8-496c-a81a-049060ad05b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:13:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:13:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:13:05 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:13:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4341ecc6-6db0-4215-b557-2e03e1ade27b]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:13:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:13:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:13:05 user nova-compute[74821]: DEBUG os_brick.utils [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:13:05 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Updating existing volume attachment record: 3f1a0f13-ccec-4e4b-b0e3-38bb1d345f24 {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:13:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:14 user nova-compute[74821]: DEBUG nova.compute.manager [req-40221640-4a08-4459-8efe-dbfff1a9ef85 req-955e198b-8f5f-49ed-b8f1-13ea7e8e8057 service nova] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Received event network-changed-e1111ad3-3eff-4594-bbf4-37026e6059c9 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:13:14 user nova-compute[74821]: DEBUG nova.compute.manager [req-40221640-4a08-4459-8efe-dbfff1a9ef85 req-955e198b-8f5f-49ed-b8f1-13ea7e8e8057 service nova] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Refreshing instance network info cache due to event network-changed-e1111ad3-3eff-4594-bbf4-37026e6059c9. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:13:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-40221640-4a08-4459-8efe-dbfff1a9ef85 req-955e198b-8f5f-49ed-b8f1-13ea7e8e8057 service nova] Acquiring lock "refresh_cache-c47906a7-93b9-4527-9318-ed4df54afff6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:13:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-40221640-4a08-4459-8efe-dbfff1a9ef85 req-955e198b-8f5f-49ed-b8f1-13ea7e8e8057 service nova] Acquired lock "refresh_cache-c47906a7-93b9-4527-9318-ed4df54afff6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:13:14 user nova-compute[74821]: DEBUG nova.network.neutron [req-40221640-4a08-4459-8efe-dbfff1a9ef85 req-955e198b-8f5f-49ed-b8f1-13ea7e8e8057 service nova] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Refreshing network info cache for port e1111ad3-3eff-4594-bbf4-37026e6059c9 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:13:15 user nova-compute[74821]: DEBUG nova.network.neutron [req-40221640-4a08-4459-8efe-dbfff1a9ef85 req-955e198b-8f5f-49ed-b8f1-13ea7e8e8057 service nova] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Updated VIF entry in instance network info cache for port e1111ad3-3eff-4594-bbf4-37026e6059c9. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:13:15 user nova-compute[74821]: DEBUG nova.network.neutron [req-40221640-4a08-4459-8efe-dbfff1a9ef85 req-955e198b-8f5f-49ed-b8f1-13ea7e8e8057 service nova] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Updating instance_info_cache with network_info: [{"id": "e1111ad3-3eff-4594-bbf4-37026e6059c9", "address": "fa:16:3e:16:c8:6f", "network": {"id": "26d82cf9-953f-492e-94b7-ecb500ddaaff", "bridge": "br-int", "label": "tempest-TestVolumeSwap-378439802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1004b6aba94b461cb1a149c3c8f6fa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1111ad3-3e", "ovs_interfaceid": "e1111ad3-3eff-4594-bbf4-37026e6059c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:13:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-40221640-4a08-4459-8efe-dbfff1a9ef85 req-955e198b-8f5f-49ed-b8f1-13ea7e8e8057 service nova] Releasing lock "refresh_cache-c47906a7-93b9-4527-9318-ed4df54afff6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:13:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:20 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:23 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:13:23 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sPdcwrVq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:13:23 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:13:23 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:13:23 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:13:23 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:13:23 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:13:23 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:13:23 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:13:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:23 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21c653f-2ab6-4264-98c4-828475411f26]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:23 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:13:23 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.038s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:23 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[320aefc4-d8fb-40dc-aa08-a49c629528d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:23 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0] added
Nov 06 13:13:23 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:23 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb27b271-b84d-4c7e-a0f4-4ca90a68dbc3]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:23 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.130s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:23 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc25ce7-5be5-4ae1-8b1a-e89b2da6fb2d]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:23 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sPdcwrVq {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sPdcwrVq" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:23 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea9d74f-59d9-4346-9482-ae72f4fe84e9]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:23 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:13:23 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sPdcwrVq'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Acquiring lock "c47906a7-93b9-4527-9318-ed4df54afff6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:13:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Lock "c47906a7-93b9-4527-9318-ed4df54afff6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:13:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:23 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[31133b0b-89ab-4060-960b-e985f83fb4cf]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:23 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG nova.objects.instance [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Lazy-loading 'flavor' on Instance uuid c47906a7-93b9-4527-9318-ed4df54afff6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4d4722-2ab3-4c86-896e-219a9cc76633]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f (non-flash)
Nov 06 13:13:24 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f (non-flash)
Nov 06 13:13:24 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:24 user nova-compute[74821]: INFO nova.virt.block_device [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Booting with volume a22edf35-5a12-4d6f-b128-d22ed98a282b at /dev/vdb
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Lock "c47906a7-93b9-4527-9318-ed4df54afff6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.118s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aed998c-5e78-4a0b-9806-e49c8bc0615f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0, portal: 172.16.0.220,3260]
Nov 06 13:13:24 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0, portal: 172.16.0.220,3260] successful.
Nov 06 13:13:24 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Acquiring lock "86ccb546-94c4-482c-8017-852cd42999fe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Lock "86ccb546-94c4-482c-8017-852cd42999fe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2826c45-5187-4b71-9609-085dc79bb72a]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG nova.objects.instance [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Lazy-loading 'flavor' on Instance uuid 86ccb546-94c4-482c-8017-852cd42999fe {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a944f14-b08a-4ee3-a064-7295ef3906b9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f (non-flash)
Nov 06 13:13:24 user nova-compute[74821]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 (non-flash)
Nov 06 13:13:24 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f (non-flash)
Nov 06 13:13:24 user nova-compute[74821]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 (non-flash)
Nov 06 13:13:24 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.466s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Lock "86ccb546-94c4-482c-8017-852cd42999fe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2feeb8-9e4e-40b5-bf40-27e863728e7f]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sPdcwrVq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG os_brick.utils [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f5d3ea-0300-4c02-beca-a71ce3c3c011]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd41a278-c245-476e-8416-bac14b9c996d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f01c65-eb18-451d-9552-5bb486234016]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0091a8f0-747a-4c69-ab2b-ddf7c4933d39]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:13:24 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a77ebf8-60ab-4323-9311-6eb3430bc8cd]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG os_brick.utils [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Updating existing volume attachment record: 7ecdcf66-53a5-4833-9e99-d123e7c278d9 {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Acquiring lock "c47906a7-93b9-4527-9318-ed4df54afff6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Lock "c47906a7-93b9-4527-9318-ed4df54afff6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:13:24 user nova-compute[74821]: INFO nova.compute.manager [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Attaching volume 0c31aa69-3a6d-4c9c-a628-a698806b57c2 to /dev/vdb
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Acquiring lock "86ccb546-94c4-482c-8017-852cd42999fe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Lock "86ccb546-94c4-482c-8017-852cd42999fe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:13:24 user nova-compute[74821]: INFO nova.compute.manager [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Attaching volume 6450be35-c354-4427-8a2d-13e473caf7f6 to /dev/sdc
Nov 06 13:13:24 user nova-compute[74821]: DEBUG os_brick.utils [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcceb16d-ee32-4f64-af00-de61cdd9d01d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[997d14ea-8687-45c2-918e-f94812c8878b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG os_brick.utils [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea113973-f069-4111-a2fb-480535c57b51]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac23533-04b4-408b-b642-7e9193599e3a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6661b30-6b0d-46d2-84e1-c0b0c64b5a3f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32b68a4-7364-43d6-987c-9c25acb64b08]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:13:24 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eab4e59-0cfe-4bed-8096-4a8f476273db]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG os_brick.utils [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Updating existing volume attachment record: bf8fc9b7-2648-4689-b6e2-536daff61121 {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e53e907-ef81-4b29-9f09-b85131987a24]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4352503-34b6-4a6b-ac3f-a9c53a86689a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:13:24 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab166538-bc77-4504-b8dc-65b4f9843ead]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG os_brick.utils [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Updating existing volume attachment record: db99f567-34d7-4693-b2b6-922989b7ed47 {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:13:24 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:13:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-f8c537c6-fa3e-4842-9471-7258a22c01f9" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:13:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-f8c537c6-fa3e-4842-9471-7258a22c01f9" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:13:25 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:13:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:25 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.503s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:13:25 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] <== connect_volume: return (1505ms) {'type': 'block', 'scsi_wwn': '23231316536633766', 'path': '/dev/sdc'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:13:25 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231316536633766', 'path': '/dev/sdc'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:13:25 user nova-compute[74821]: DEBUG nova.objects.instance [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Lazy-loading 'flavor' on Instance uuid a2b373e1-f872-4263-808c-ce5fbddf907c {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:13:25 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 13:13:25 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:13:25 user nova-compute[74821]:   <source dev="/dev/sdc"/>
Nov 06 13:13:25 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:13:25 user nova-compute[74821]:   <serial>349c8dd8-21f9-4ca7-93da-2e05ef56fae0</serial>
Nov 06 13:13:25 user nova-compute[74821]: </disk>
Nov 06 13:13:25 user nova-compute[74821]:  {{(pid=74821) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 13:13:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:25 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Updating instance_info_cache with network_info: [{"id": "05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b", "address": "fa:16:3e:83:64:35", "network": {"id": "d5bae261-3db3-492a-a55e-df6c0fd01fe1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-60002553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86724840a9ba4cc486fd1d0d0477c778", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05f5a65e-3f", "ovs_interfaceid": "05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:13:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-f8c537c6-fa3e-4842-9471-7258a22c01f9" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:13:25 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:13:25 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:13:25 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:13:25 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:13:25 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] No VIF found with MAC fa:16:3e:fd:26:b6, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:13:25 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:13:25 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:13:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:13:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.005s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:13:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:13:26 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:13:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49d05da1-3222-4f9f-b792-8f3d1f0f2890/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49d05da1-3222-4f9f-b792-8f3d1f0f2890/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49d05da1-3222-4f9f-b792-8f3d1f0f2890/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49d05da1-3222-4f9f-b792-8f3d1f0f2890/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62c177c-bd96-44f6-bc8d-44131914747b/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62c177c-bd96-44f6-bc8d-44131914747b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62c177c-bd96-44f6-bc8d-44131914747b/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c62c177c-bd96-44f6-bc8d-44131914747b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b373e1-f872-4263-808c-ce5fbddf907c/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b373e1-f872-4263-808c-ce5fbddf907c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b373e1-f872-4263-808c-ce5fbddf907c/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b373e1-f872-4263-808c-ce5fbddf907c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47906a7-93b9-4527-9318-ed4df54afff6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47906a7-93b9-4527-9318-ed4df54afff6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47906a7-93b9-4527-9318-ed4df54afff6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oOPZMNkD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:13:28 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:13:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:13:28 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:13:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:13:28 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a86b32-4de8-4816-a689-811fb5f2da14]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:13:28 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf8bca7-515e-4bd6-bd25-967dfb220ae9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c] added
Nov 06 13:13:28 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe40986-7971-4b0e-9dea-5c82b52d825a]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[664d292d-2247-4a72-be90-83a090d7d5d4]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oOPZMNkD {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47906a7-93b9-4527-9318-ed4df54afff6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oOPZMNkD" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfef96a-1a76-442d-ba3e-565370cf19cd]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oOPZMNkD'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1586ce-e6d3-4147-8b81-11d03e331dde]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[64342e34-25f7-4b3f-a7c5-ebe30928e332]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f (non-flash)
Nov 06 13:13:28 user nova-compute[74821]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 (non-flash)
Nov 06 13:13:28 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f (non-flash)
Nov 06 13:13:28 user nova-compute[74821]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 (non-flash)
Nov 06 13:13:28 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc307bc-1909-4387-97ac-312ab2090b11]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c, portal: 172.16.0.220,3260]
Nov 06 13:13:28 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c, portal: 172.16.0.220,3260] successful.
Nov 06 13:13:28 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aad95c3-dd76-472a-bb3f-0e2bec5d1da7]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[75849db1-c0ac-443e-b2c2-7e11dd96c2ae]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f (non-flash)
Nov 06 13:13:28 user nova-compute[74821]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 (non-flash)
Nov 06 13:13:28 user nova-compute[74821]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c (non-flash)
Nov 06 13:13:28 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f (non-flash)
Nov 06 13:13:28 user nova-compute[74821]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 (non-flash)
Nov 06 13:13:28 user nova-compute[74821]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c (non-flash)
Nov 06 13:13:28 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b447baa2-5f8c-4413-886e-eb11cff3b9ed]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oOPZMNkD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ccb546-94c4-482c-8017-852cd42999fe/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ccb546-94c4-482c-8017-852cd42999fe/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ccb546-94c4-482c-8017-852cd42999fe/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86ccb546-94c4-482c-8017-852cd42999fe/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:13:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:13:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '26462323335343731', 'path': '/dev/sdd'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:13:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462323335343731', 'path': '/dev/sdd'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:13:29 user nova-compute[74821]: DEBUG nova.objects.instance [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Lazy-loading 'flavor' on Instance uuid 49d05da1-3222-4f9f-b792-8f3d1f0f2890 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:13:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] attach device xml: <disk type="block" device="disk">
Nov 06 13:13:29 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:13:29 user nova-compute[74821]:   <source dev="/dev/sdd"/>
Nov 06 13:13:29 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:13:29 user nova-compute[74821]:   <serial>41948e07-1ed7-473c-b90d-cfea7069fe1c</serial>
Nov 06 13:13:29 user nova-compute[74821]: </disk>
Nov 06 13:13:29 user nova-compute[74821]:  {{(pid=74821) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 13:13:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:30 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:13:30 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:13:30 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] No VIF found with MAC fa:16:3e:17:16:45, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:13:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:30 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:13:30 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:13:30 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=7337MB free_disk=25.5592041015625GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:13:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:13:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:13:30 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 3e21d005-f190-478a-a911-e483e1235057 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:13:30 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 311817c5-7b08-4da9-98eb-c685f37e6fd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:13:30 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance f8c537c6-fa3e-4842-9471-7258a22c01f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:13:30 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance a2b373e1-f872-4263-808c-ce5fbddf907c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:13:30 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 86ccb546-94c4-482c-8017-852cd42999fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:13:30 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 49d05da1-3222-4f9f-b792-8f3d1f0f2890 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:13:30 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance c47906a7-93b9-4527-9318-ed4df54afff6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:13:30 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:13:30 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance c62c177c-bd96-44f6-bc8d-44131914747b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:13:30 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance a33991ce-e911-460d-a6d9-ca738830ef2c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:13:30 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:13:30 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:13:30 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:13:31 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:13:31 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:13:31 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:13:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.514s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:13:32 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:13:32 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:13:32 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:13:32 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:13:32 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:13:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:44 user nova-compute[74821]: DEBUG nova.compute.manager [req-a61acef6-5242-43c0-b28a-a7b76d625581 req-66c4efac-bc2b-4f9a-9bf7-d986b12c0698 service nova] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Received event network-changed-bbfa9945-6317-4b90-880f-23ee3eefafc1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:13:44 user nova-compute[74821]: DEBUG nova.compute.manager [req-a61acef6-5242-43c0-b28a-a7b76d625581 req-66c4efac-bc2b-4f9a-9bf7-d986b12c0698 service nova] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Refreshing instance network info cache due to event network-changed-bbfa9945-6317-4b90-880f-23ee3eefafc1. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:13:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-a61acef6-5242-43c0-b28a-a7b76d625581 req-66c4efac-bc2b-4f9a-9bf7-d986b12c0698 service nova] Acquiring lock "refresh_cache-ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:13:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-a61acef6-5242-43c0-b28a-a7b76d625581 req-66c4efac-bc2b-4f9a-9bf7-d986b12c0698 service nova] Acquired lock "refresh_cache-ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:13:44 user nova-compute[74821]: DEBUG nova.network.neutron [req-a61acef6-5242-43c0-b28a-a7b76d625581 req-66c4efac-bc2b-4f9a-9bf7-d986b12c0698 service nova] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Refreshing network info cache for port bbfa9945-6317-4b90-880f-23ee3eefafc1 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:13:45 user nova-compute[74821]: DEBUG nova.network.neutron [req-a61acef6-5242-43c0-b28a-a7b76d625581 req-66c4efac-bc2b-4f9a-9bf7-d986b12c0698 service nova] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Updated VIF entry in instance network info cache for port bbfa9945-6317-4b90-880f-23ee3eefafc1. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:13:45 user nova-compute[74821]: DEBUG nova.network.neutron [req-a61acef6-5242-43c0-b28a-a7b76d625581 req-66c4efac-bc2b-4f9a-9bf7-d986b12c0698 service nova] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Updating instance_info_cache with network_info: [{"id": "bbfa9945-6317-4b90-880f-23ee3eefafc1", "address": "fa:16:3e:1b:dd:99", "network": {"id": "028f273f-8e31-4b8e-9662-d0a94d5ea802", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1047617218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1448bac90e444d38a97183dba44c98de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbfa9945-63", "ovs_interfaceid": "bbfa9945-6317-4b90-880f-23ee3eefafc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:13:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-a61acef6-5242-43c0-b28a-a7b76d625581 req-66c4efac-bc2b-4f9a-9bf7-d986b12c0698 service nova] Releasing lock "refresh_cache-ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:13:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaLCBrKp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:13:48 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:13:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:13:48 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:13:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:13:48 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:13:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b951ed4-4614-4fef-bf35-8c7c015ce7b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:13:48 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3273f1c-0df8-4887-b7db-5e6c41824037]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2] added
Nov 06 13:13:48 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14d9220-9960-4048-a5ca-2d0ad6e79a37]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.086s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfff65c7-3720-4444-97de-ac3ba7a830c2]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NaLCBrKp {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NaLCBrKp" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11fa16b-d9e7-4c04-9c08-755126053ef4]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NaLCBrKp'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9490e15-1299-42e4-9be8-c45dda5b1200]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a13dc83-1be2-4f40-89b7-8c1659bad1cc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f (non-flash)
Nov 06 13:13:48 user nova-compute[74821]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 (non-flash)
Nov 06 13:13:48 user nova-compute[74821]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c (non-flash)
Nov 06 13:13:48 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f (non-flash)
Nov 06 13:13:48 user nova-compute[74821]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 (non-flash)
Nov 06 13:13:48 user nova-compute[74821]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c (non-flash)
Nov 06 13:13:48 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-dba08646-d44b-406c-a938-37e880f37307 tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Lock "a2b373e1-f872-4263-808c-ce5fbddf907c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 77.161s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3309088-9db3-4945-b052-0b7920ebbc00]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2, portal: 172.16.0.220,3260]
Nov 06 13:13:48 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2, portal: 172.16.0.220,3260] successful.
Nov 06 13:13:48 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d52b4f-4a95-4f23-915b-6d4089515509]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[21355394-028f-448d-8b50-04dec4c7065d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f (non-flash)
Nov 06 13:13:48 user nova-compute[74821]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 (non-flash)
Nov 06 13:13:48 user nova-compute[74821]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c (non-flash)
Nov 06 13:13:48 user nova-compute[74821]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:13:48 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f (non-flash)
Nov 06 13:13:48 user nova-compute[74821]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 (non-flash)
Nov 06 13:13:48 user nova-compute[74821]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c (non-flash)
Nov 06 13:13:48 user nova-compute[74821]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:13:48 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.386s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4013d8d4-863a-47ae-bf1e-a6bf2cef4de0]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: None {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-64acb68b-52c9-443a-a2f7-afb05c5e0d22 tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Lock "49d05da1-3222-4f9f-b792-8f3d1f0f2890" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 43.213s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:13:48 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:49 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:13:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaLCBrKp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:13:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:13:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '26234333862333464', 'path': '/dev/sde'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:13:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234333862333464', 'path': '/dev/sde'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:13:49 user nova-compute[74821]: DEBUG nova.objects.instance [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Lazy-loading 'flavor' on Instance uuid c47906a7-93b9-4527-9318-ed4df54afff6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:13:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 13:13:49 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:13:49 user nova-compute[74821]:   <source dev="/dev/sde"/>
Nov 06 13:13:49 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:13:49 user nova-compute[74821]:   <serial>0c31aa69-3a6d-4c9c-a628-a698806b57c2</serial>
Nov 06 13:13:49 user nova-compute[74821]: </disk>
Nov 06 13:13:49 user nova-compute[74821]:  {{(pid=74821) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 13:13:49 user nova-compute[74821]: INFO nova.compute.manager [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Rebuilding instance
Nov 06 13:13:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Acquiring lock "a2b373e1-f872-4263-808c-ce5fbddf907c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:13:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Lock "a2b373e1-f872-4263-808c-ce5fbddf907c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:13:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Acquiring lock "a2b373e1-f872-4263-808c-ce5fbddf907c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:13:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Lock "a2b373e1-f872-4263-808c-ce5fbddf907c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:13:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Lock "a2b373e1-f872-4263-808c-ce5fbddf907c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:13:49 user nova-compute[74821]: INFO nova.compute.manager [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Terminating instance
Nov 06 13:13:49 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:13:49 user nova-compute[74821]: DEBUG nova.compute.manager [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:13:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e5c62ce9-4251-4ade-a1e3-9205744a0a43 tempest-VolumesAssistedSnapshotsTest-1317499090 tempest-VolumesAssistedSnapshotsTest-1317499090-project] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] volume_snapshot_create: create_info: {'snapshot_id': '2d32b590-3244-4226-b82b-b30ff974f09a', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74821) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 06 13:13:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e5c62ce9-4251-4ade-a1e3-9205744a0a43 tempest-VolumesAssistedSnapshotsTest-1317499090 tempest-VolumesAssistedSnapshotsTest-1317499090-project] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] snap xml: <domainsnapshot>
Nov 06 13:13:50 user nova-compute[74821]:   <disks>
Nov 06 13:13:50 user nova-compute[74821]:     <disk name="/dev/sdd" snapshot="external" type="file">
Nov 06 13:13:50 user nova-compute[74821]:       <source file="/dev/new_file"/>
Nov 06 13:13:50 user nova-compute[74821]:     </disk>
Nov 06 13:13:50 user nova-compute[74821]:     <disk name="vda" snapshot="no"/>
Nov 06 13:13:50 user nova-compute[74821]:   </disks>
Nov 06 13:13:50 user nova-compute[74821]: </domainsnapshot>
Nov 06 13:13:50 user nova-compute[74821]:  {{(pid=74821) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 06 13:13:50 user nova-compute[74821]: DEBUG nova.objects.instance [None req-e5c62ce9-4251-4ade-a1e3-9205744a0a43 tempest-VolumesAssistedSnapshotsTest-1317499090 tempest-VolumesAssistedSnapshotsTest-1317499090-project] Lazy-loading 'system_metadata' on Instance uuid 49d05da1-3222-4f9f-b792-8f3d1f0f2890 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:13:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-d0af2234-b517-419e-ac65-f7fe81bad75f tempest-VolumesAssistedSnapshotsTest-1317499090 tempest-VolumesAssistedSnapshotsTest-1317499090-project] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] volume_snapshot_delete: delete_info: {'volume_id': '41948e07-1ed7-473c-b90d-cfea7069fe1c'} {{(pid=74821) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [None req-d0af2234-b517-419e-ac65-f7fe81bad75f tempest-VolumesAssistedSnapshotsTest-1317499090 tempest-VolumesAssistedSnapshotsTest-1317499090-project] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Traceback (most recent call last):
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]     if delete_info['type'] != 'qcow2':
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] KeyError: 'type'
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] 
Nov 06 13:13:50 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-e5c62ce9-4251-4ade-a1e3-9205744a0a43 tempest-VolumesAssistedSnapshotsTest-1317499090 tempest-VolumesAssistedSnapshotsTest-1317499090-project] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 06 13:13:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:13:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:13:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] No VIF found with MAC fa:16:3e:16:c8:6f, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [None req-e5c62ce9-4251-4ade-a1e3-9205744a0a43 tempest-VolumesAssistedSnapshotsTest-1317499090 tempest-VolumesAssistedSnapshotsTest-1317499090-project] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Traceback (most recent call last):
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]     rv = execute(f, *args, **kwargs)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]     six.reraise(c, e, tb)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]     raise value
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]     rv = meth(*args, **kwargs)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] 
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [None req-e5c62ce9-4251-4ade-a1e3-9205744a0a43 tempest-VolumesAssistedSnapshotsTest-1317499090 tempest-VolumesAssistedSnapshotsTest-1317499090-project] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Traceback (most recent call last):
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]     self._volume_snapshot_create(context, instance, guest,
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]     rv = execute(f, *args, **kwargs)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]     six.reraise(c, e, tb)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]     raise value
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]     rv = meth(*args, **kwargs)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] 
Nov 06 13:13:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:50 user nova-compute[74821]: DEBUG nova.compute.manager [req-46b395a0-8b3f-470f-9b1c-84b99c6a9b76 req-5b84d608-1b35-457f-8f62-f882c62c2450 service nova] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Received event network-vif-unplugged-1f3e50b9-2015-4c0b-adbd-fb91bf9d7753 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:13:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-46b395a0-8b3f-470f-9b1c-84b99c6a9b76 req-5b84d608-1b35-457f-8f62-f882c62c2450 service nova] Acquiring lock "a2b373e1-f872-4263-808c-ce5fbddf907c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:13:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-46b395a0-8b3f-470f-9b1c-84b99c6a9b76 req-5b84d608-1b35-457f-8f62-f882c62c2450 service nova] Lock "a2b373e1-f872-4263-808c-ce5fbddf907c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:13:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-46b395a0-8b3f-470f-9b1c-84b99c6a9b76 req-5b84d608-1b35-457f-8f62-f882c62c2450 service nova] Lock "a2b373e1-f872-4263-808c-ce5fbddf907c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:13:50 user nova-compute[74821]: DEBUG nova.compute.manager [req-46b395a0-8b3f-470f-9b1c-84b99c6a9b76 req-5b84d608-1b35-457f-8f62-f882c62c2450 service nova] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] No waiting events found dispatching network-vif-unplugged-1f3e50b9-2015-4c0b-adbd-fb91bf9d7753 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:13:50 user nova-compute[74821]: DEBUG nova.compute.manager [req-46b395a0-8b3f-470f-9b1c-84b99c6a9b76 req-5b84d608-1b35-457f-8f62-f882c62c2450 service nova] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Received event network-vif-unplugged-1f3e50b9-2015-4c0b-adbd-fb91bf9d7753 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:13:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [None req-d0af2234-b517-419e-ac65-f7fe81bad75f tempest-VolumesAssistedSnapshotsTest-1317499090 tempest-VolumesAssistedSnapshotsTest-1317499090-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver 
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver 
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-ebccfe53-47aa-4045-a8fd-2f5a025f33fc)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver 
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver 
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver 
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server [None req-d0af2234-b517-419e-ac65-f7fe81bad75f tempest-VolumesAssistedSnapshotsTest-1317499090 tempest-VolumesAssistedSnapshotsTest-1317499090-project] Exception during message handling: KeyError: 'type'
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server 
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver [None req-e5c62ce9-4251-4ade-a1e3-9205744a0a43 tempest-VolumesAssistedSnapshotsTest-1317499090 tempest-VolumesAssistedSnapshotsTest-1317499090-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 2d32b590-3244-4226-b82b-b30ff974f09a could not be found.
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     raise value
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver 
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver 
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 2d32b590-3244-4226-b82b-b30ff974f09a could not be found. (HTTP 404) (Request-ID: req-47a6288c-8152-47b1-bc62-f4de2b3e819a)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver 
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver 
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 2d32b590-3244-4226-b82b-b30ff974f09a could not be found.
Nov 06 13:13:50 user nova-compute[74821]: ERROR nova.virt.libvirt.driver 
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server [None req-e5c62ce9-4251-4ade-a1e3-9205744a0a43 tempest-VolumesAssistedSnapshotsTest-1317499090 tempest-VolumesAssistedSnapshotsTest-1317499090-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     raise value
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 06 13:13:50 user nova-compute[74821]: ERROR oslo_messaging.rpc.server 
Nov 06 13:13:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-176a1107-4aaa-4c6b-aa4b-078b1e91864a tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Lock "c47906a7-93b9-4527-9318-ed4df54afff6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.180s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:13:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Acquiring lock "49d05da1-3222-4f9f-b792-8f3d1f0f2890" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Lock "49d05da1-3222-4f9f-b792-8f3d1f0f2890" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:13:51 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Instance destroyed successfully.
Nov 06 13:13:51 user nova-compute[74821]: INFO nova.compute.manager [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Detaching volume 41948e07-1ed7-473c-b90d-cfea7069fe1c
Nov 06 13:13:51 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Instance destroyed successfully.
Nov 06 13:13:51 user nova-compute[74821]: DEBUG nova.objects.instance [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Lazy-loading 'resources' on Instance uuid a2b373e1-f872-4263-808c-ce5fbddf907c {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:10:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-63912502',display_name='tempest-DeleteServersTestJSON-server-63912502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-63912502',id=4,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:10:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed493ef8770740f4a63b0baa352933a2',ramdisk_id='',reservation_id='r-wb0jszyw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1732675514',owner_user_name='tempest-DeleteServersTestJSON-1732675514-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:10:46Z,user_data=None,user_id='de7b96cf6d1643b18d7619f9f4076ccf',uuid=a2b373e1-f872-4263-808c-ce5fbddf907c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f3e50b9-2015-4c0b-adbd-fb91bf9d7753", "address": "fa:16:3e:fd:26:b6", "network": {"id": "323a6441-34e6-41af-a08c-908482497062", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-438888055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed493ef8770740f4a63b0baa352933a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f3e50b9-20", "ovs_interfaceid": "1f3e50b9-2015-4c0b-adbd-fb91bf9d7753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Converting VIF {"id": "1f3e50b9-2015-4c0b-adbd-fb91bf9d7753", "address": "fa:16:3e:fd:26:b6", "network": {"id": "323a6441-34e6-41af-a08c-908482497062", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-438888055-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed493ef8770740f4a63b0baa352933a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f3e50b9-20", "ovs_interfaceid": "1f3e50b9-2015-4c0b-adbd-fb91bf9d7753", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:26:b6,bridge_name='br-int',has_traffic_filtering=True,id=1f3e50b9-2015-4c0b-adbd-fb91bf9d7753,network=Network(323a6441-34e6-41af-a08c-908482497062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f3e50b9-20') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_vif [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:26:b6,bridge_name='br-int',has_traffic_filtering=True,id=1f3e50b9-2015-4c0b-adbd-fb91bf9d7753,network=Network(323a6441-34e6-41af-a08c-908482497062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f3e50b9-20') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f3e50b9-20, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:13:51 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Instance destroyed successfully.
Nov 06 13:13:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:11:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-55767323',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-272403543',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYJm0cyElUjil24imeyuGUtyD8RFmEZ21wSS4yaGDzXXrR9VKn5Z9Rvk9M2W47duumtOI552lIs37Yh7wbD5f0dboHXCGJQYXqGlPPG0wo8M+okGKaG9RpC65rRd95e9A==',key_name='tempest-keypair-1379795935',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:12:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1448bac90e444d38a97183dba44c98de',ramdisk_id='',reservation_id='r-balxag8t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-662359766',owner_user_name='tempest-ServerActionsV293TestJSON-662359766-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:13:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be36fa52c6ef4c5bab9841e42eb16a16',uuid=ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bbfa9945-6317-4b90-880f-23ee3eefafc1", "address": "fa:16:3e:1b:dd:99", "network": {"id": "028f273f-8e31-4b8e-9662-d0a94d5ea802", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1047617218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1448bac90e444d38a97183dba44c98de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbfa9945-63", "ovs_interfaceid": "bbfa9945-6317-4b90-880f-23ee3eefafc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Converting VIF {"id": "bbfa9945-6317-4b90-880f-23ee3eefafc1", "address": "fa:16:3e:1b:dd:99", "network": {"id": "028f273f-8e31-4b8e-9662-d0a94d5ea802", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1047617218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1448bac90e444d38a97183dba44c98de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbfa9945-63", "ovs_interfaceid": "bbfa9945-6317-4b90-880f-23ee3eefafc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:dd:99,bridge_name='br-int',has_traffic_filtering=True,id=bbfa9945-6317-4b90-880f-23ee3eefafc1,network=Network(028f273f-8e31-4b8e-9662-d0a94d5ea802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbfa9945-63') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_vif [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:dd:99,bridge_name='br-int',has_traffic_filtering=True,id=bbfa9945-6317-4b90-880f-23ee3eefafc1,network=Network(028f273f-8e31-4b8e-9662-d0a94d5ea802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbfa9945-63') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbbfa9945-63, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6ddea128-7e8a-4869-a15a-7e0b35c51d63) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e312f3cd-cbd8-42c4-abdd-9b8069865473) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:51 user nova-compute[74821]: INFO os_vif [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:26:b6,bridge_name='br-int',has_traffic_filtering=True,id=1f3e50b9-2015-4c0b-adbd-fb91bf9d7753,network=Network(323a6441-34e6-41af-a08c-908482497062),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f3e50b9-20')
Nov 06 13:13:51 user nova-compute[74821]: INFO os_vif [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:dd:99,bridge_name='br-int',has_traffic_filtering=True,id=bbfa9945-6317-4b90-880f-23ee3eefafc1,network=Network(028f273f-8e31-4b8e-9662-d0a94d5ea802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbfa9945-63')
Nov 06 13:13:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sPdcwrVq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:13:51 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:51 user nova-compute[74821]: INFO nova.virt.block_device [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Attempting to driver detach volume 41948e07-1ed7-473c-b90d-cfea7069fe1c from mountpoint /dev/vdb
Nov 06 13:13:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DLjnzvpG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:13:51 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cd6723-9964-4d90-9201-4b61e1644dda]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:13:51 user nova-compute[74821]: No targets found.
Nov 06 13:13:51 user nova-compute[74821]: iSNS:
Nov 06 13:13:51 user nova-compute[74821]: No targets found.
Nov 06 13:13:51 user nova-compute[74821]: STATIC:
Nov 06 13:13:51 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c
Nov 06 13:13:51 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:13:51 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:13:51 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f
Nov 06 13:13:51 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:13:51 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:13:51 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2
Nov 06 13:13:51 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:13:51 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:13:51 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0
Nov 06 13:13:51 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:13:51 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:13:51 user nova-compute[74821]: FIRMWARE:
Nov 06 13:13:51 user nova-compute[74821]: No targets found.
Nov 06 13:13:51 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:13:51 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:13:51 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Attempting to detach device vdb from instance 49d05da1-3222-4f9f-b792-8f3d1f0f2890 from the persistent domain config. {{(pid=74821) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] detach device xml: <disk type="block" device="disk">
Nov 06 13:13:51 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:13:51 user nova-compute[74821]:   <source dev="/dev/sdd"/>
Nov 06 13:13:51 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:13:51 user nova-compute[74821]:   <serial>41948e07-1ed7-473c-b90d-cfea7069fe1c</serial>
Nov 06 13:13:51 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:13:51 user nova-compute[74821]: </disk>
Nov 06 13:13:51 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:13:51 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Successfully detached device vdb from instance 49d05da1-3222-4f9f-b792-8f3d1f0f2890 from the persistent domain config.
Nov 06 13:13:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 49d05da1-3222-4f9f-b792-8f3d1f0f2890 from the live domain config. {{(pid=74821) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] detach device xml: <disk type="block" device="disk">
Nov 06 13:13:51 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:13:51 user nova-compute[74821]:   <source dev="/dev/sdd"/>
Nov 06 13:13:51 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:13:51 user nova-compute[74821]:   <serial>41948e07-1ed7-473c-b90d-cfea7069fe1c</serial>
Nov 06 13:13:51 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:13:51 user nova-compute[74821]: </disk>
Nov 06 13:13:51 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[328da51f-4080-4acb-81e4-25485516aa06]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef1d5b8-2d56-4c94-a0e3-89cc75523337]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f (non-flash)
Nov 06 13:13:51 user nova-compute[74821]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 (non-flash)
Nov 06 13:13:51 user nova-compute[74821]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c (non-flash)
Nov 06 13:13:51 user nova-compute[74821]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:13:51 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f (non-flash)
Nov 06 13:13:51 user nova-compute[74821]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 (non-flash)
Nov 06 13:13:51 user nova-compute[74821]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c (non-flash)
Nov 06 13:13:51 user nova-compute[74821]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:13:51 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e40585870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0'): ({'sdc'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Removing single pathed devices sdc {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[967e829a-6d86-49a5-b6b4-129ee4188dca]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2877b4b0-fb62-4a97-9b63-eb3e5711b51a]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Flushing IO for device /dev/sdc {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d688b8-b8ce-44a5-93e6-c3b9407b12b1]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.062s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73effdc-ea0c-43cf-bdfd-32be3345761a]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] SCSI volumes sdc have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe85ed4-348a-45a1-b879-0517cc7087d3]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a53299-0ab1-47b4-9271-18906edc4283]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0, portal: 172.16.0.220,3260]
Nov 06 13:13:51 user nova-compute[74821]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0, portal: 172.16.0.220,3260] successful.
Nov 06 13:13:51 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:349c8dd8-21f9-4ca7-93da-2e05ef56fae0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdd0a9e-02ba-4996-b51b-cf4b501ff643]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] <== disconnect_volume: return (383ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:13:51 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Deleting instance files /opt/stack/data/nova/instances/a2b373e1-f872-4263-808c-ce5fbddf907c_del
Nov 06 13:13:51 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Deletion of /opt/stack/data/nova/instances/a2b373e1-f872-4263-808c-ce5fbddf907c_del complete
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.382s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b170a0ff-c9f7-49a7-9f79-595016880699]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:13:51 user nova-compute[74821]: No targets found.
Nov 06 13:13:51 user nova-compute[74821]: iSNS:
Nov 06 13:13:51 user nova-compute[74821]: No targets found.
Nov 06 13:13:51 user nova-compute[74821]: STATIC:
Nov 06 13:13:51 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c
Nov 06 13:13:51 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:13:51 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:13:51 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f
Nov 06 13:13:51 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:13:51 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:13:51 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2
Nov 06 13:13:51 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:13:51 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:13:51 user nova-compute[74821]: FIRMWARE:
Nov 06 13:13:51 user nova-compute[74821]: No targets found.
Nov 06 13:13:51 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:13:51 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:13:51 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[894cbd85-feb9-466c-b25a-9ada43c31b49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8f0733-cca3-4f07-b64f-bd471bbc29cb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f (non-flash)
Nov 06 13:13:51 user nova-compute[74821]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c (non-flash)
Nov 06 13:13:51 user nova-compute[74821]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:13:51 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f (non-flash)
Nov 06 13:13:51 user nova-compute[74821]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c (non-flash)
Nov 06 13:13:51 user nova-compute[74821]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:13:51 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e406305e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f'): ({'sdb'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Removing single pathed devices sdb {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:13:51 user nova-compute[74821]: INFO nova.compute.manager [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Took 1.89 seconds to destroy the instance on the hypervisor.
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Acquiring lock "c47906a7-93b9-4527-9318-ed4df54afff6" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Lock "c47906a7-93b9-4527-9318-ed4df54afff6" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8376d537-2864-48a5-af07-890ac39085d6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.utils [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 49d05da1-3222-4f9f-b792-8f3d1f0f2890 {{(pid=74821) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c3c518-be14-4f73-923d-690c0fbfdf4b]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Flushing IO for device /dev/sdb {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa8c49b-3a58-4557-a317-5ee84e611a46]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea193827-1235-4fce-b30a-dafbeadc9109]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ff4706-aaaf-41eb-bc42-44be423d8b8f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9557be-db06-4232-bd3b-5634f03a9e1d]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] SCSI volumes sdb have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.031s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b8295e-3606-4e0c-9ac1-2590467dac67]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4204afb1-9bfb-4bcf-b05f-c0d7f0a5af09]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9961e95-2556-4bea-bd70-d9ab2ea7c6ad]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:13:51 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:13:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e12b597-4323-437b-a795-2daa53a5ddce]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:13:51 user nova-compute[74821]: DEBUG os_brick.utils [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] <== get_connector_properties: return (186ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[927aa594-5705-4308-ab86-c23067b2076e]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f, portal: 172.16.0.220,3260]
Nov 06 13:13:52 user nova-compute[74821]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f, portal: 172.16.0.220,3260] successful.
Nov 06 13:13:52 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ffbef6-33be-4bbb-a4e4-8286e39c3b61]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.420s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] <== disconnect_volume: return (802ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:13:52 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Deleting instance files /opt/stack/data/nova/instances/ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5_del
Nov 06 13:13:52 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Deletion of /opt/stack/data/nova/instances/ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5_del complete
Nov 06 13:13:52 user nova-compute[74821]: INFO nova.compute.manager [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Swapping volume 0c31aa69-3a6d-4c9c-a628-a698806b57c2 for 98b405b9-f2d3-4473-83ac-582fbc9f5641
Nov 06 13:13:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IFwVgDHB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:13:52 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:13:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:13:52 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:13:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:13:52 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c671cd8-a21a-40e7-b48f-adec3a6c9e7d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:13:52 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c34ec9c-f31c-4ef5-ac77-b2f0225e7139]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6] added
Nov 06 13:13:52 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ce561e-487d-4d39-97d6-498491572bc1]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:52 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5 could not be found.
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DLjnzvpG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:13:52 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 06 13:13:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4131b581-c851-496e-b878-267c6601eff5]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IFwVgDHB {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IFwVgDHB" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3fa349-6b82-494f-8a78-1cd4d8ccdf47]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IFwVgDHB'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce494af0-964d-4c1e-a4c2-efe6774ace4b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8a3a94-dc5c-4959-a8fc-5295f9d06a56]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c (non-flash)
Nov 06 13:13:52 user nova-compute[74821]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:13:52 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c (non-flash)
Nov 06 13:13:52 user nova-compute[74821]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:13:52 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Received event network-vif-plugged-1f3e50b9-2015-4c0b-adbd-fb91bf9d7753 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] Acquiring lock "a2b373e1-f872-4263-808c-ce5fbddf907c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] Lock "a2b373e1-f872-4263-808c-ce5fbddf907c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] Lock "a2b373e1-f872-4263-808c-ce5fbddf907c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] No waiting events found dispatching network-vif-plugged-1f3e50b9-2015-4c0b-adbd-fb91bf9d7753 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:13:52 user nova-compute[74821]: WARNING nova.compute.manager [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Received unexpected event network-vif-plugged-1f3e50b9-2015-4c0b-adbd-fb91bf9d7753 for instance with vm_state active and task_state deleting.
Nov 06 13:13:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Received event network-vif-unplugged-bbfa9945-6317-4b90-880f-23ee3eefafc1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] Acquiring lock "ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] Lock "ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] Lock "ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] No waiting events found dispatching network-vif-unplugged-bbfa9945-6317-4b90-880f-23ee3eefafc1 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:13:52 user nova-compute[74821]: WARNING nova.compute.manager [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Received unexpected event network-vif-unplugged-bbfa9945-6317-4b90-880f-23ee3eefafc1 for instance with vm_state active and task_state rebuilding.
Nov 06 13:13:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Received event network-vif-plugged-bbfa9945-6317-4b90-880f-23ee3eefafc1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] Acquiring lock "ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] Lock "ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] Lock "ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] No waiting events found dispatching network-vif-plugged-bbfa9945-6317-4b90-880f-23ee3eefafc1 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:13:52 user nova-compute[74821]: WARNING nova.compute.manager [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Received unexpected event network-vif-plugged-bbfa9945-6317-4b90-880f-23ee3eefafc1 for instance with vm_state active and task_state rebuilding.
Nov 06 13:13:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Received event network-vif-plugged-1f3e50b9-2015-4c0b-adbd-fb91bf9d7753 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] Acquiring lock "a2b373e1-f872-4263-808c-ce5fbddf907c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] Lock "a2b373e1-f872-4263-808c-ce5fbddf907c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] Lock "a2b373e1-f872-4263-808c-ce5fbddf907c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] No waiting events found dispatching network-vif-plugged-1f3e50b9-2015-4c0b-adbd-fb91bf9d7753 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:13:52 user nova-compute[74821]: WARNING nova.compute.manager [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Received unexpected event network-vif-plugged-1f3e50b9-2015-4c0b-adbd-fb91bf9d7753 for instance with vm_state active and task_state deleting.
Nov 06 13:13:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Received event network-vif-plugged-1f3e50b9-2015-4c0b-adbd-fb91bf9d7753 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] Acquiring lock "a2b373e1-f872-4263-808c-ce5fbddf907c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] Lock "a2b373e1-f872-4263-808c-ce5fbddf907c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] Lock "a2b373e1-f872-4263-808c-ce5fbddf907c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] No waiting events found dispatching network-vif-plugged-1f3e50b9-2015-4c0b-adbd-fb91bf9d7753 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:13:52 user nova-compute[74821]: WARNING nova.compute.manager [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Received unexpected event network-vif-plugged-1f3e50b9-2015-4c0b-adbd-fb91bf9d7753 for instance with vm_state active and task_state deleting.
Nov 06 13:13:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Received event network-vif-unplugged-1f3e50b9-2015-4c0b-adbd-fb91bf9d7753 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] Acquiring lock "a2b373e1-f872-4263-808c-ce5fbddf907c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] Lock "a2b373e1-f872-4263-808c-ce5fbddf907c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] Lock "a2b373e1-f872-4263-808c-ce5fbddf907c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] No waiting events found dispatching network-vif-unplugged-1f3e50b9-2015-4c0b-adbd-fb91bf9d7753 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Received event network-vif-unplugged-1f3e50b9-2015-4c0b-adbd-fb91bf9d7753 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Received event network-vif-plugged-1f3e50b9-2015-4c0b-adbd-fb91bf9d7753 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] Acquiring lock "a2b373e1-f872-4263-808c-ce5fbddf907c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] Lock "a2b373e1-f872-4263-808c-ce5fbddf907c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] Lock "a2b373e1-f872-4263-808c-ce5fbddf907c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] No waiting events found dispatching network-vif-plugged-1f3e50b9-2015-4c0b-adbd-fb91bf9d7753 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:13:52 user nova-compute[74821]: WARNING nova.compute.manager [req-2541d7c1-31cb-45e7-aac6-5b67b58202ad req-6c80f4a7-18d3-463b-91ed-bce4a4f7b243 service nova] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Received unexpected event network-vif-plugged-1f3e50b9-2015-4c0b-adbd-fb91bf9d7753 for instance with vm_state active and task_state deleting.
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c215117a-a57d-43f9-b610-13a4a4cf368a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6, portal: 172.16.0.220,3260]
Nov 06 13:13:52 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6, portal: 172.16.0.220,3260] successful.
Nov 06 13:13:52 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f307169-ad48-4a5f-9040-39dd55ceb21b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[655fdf61-680a-4670-9dd6-d29e5cb7b8ea]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c (non-flash)
Nov 06 13:13:52 user nova-compute[74821]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:13:52 user nova-compute[74821]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6 (non-flash)
Nov 06 13:13:52 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c (non-flash)
Nov 06 13:13:52 user nova-compute[74821]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:13:52 user nova-compute[74821]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6 (non-flash)
Nov 06 13:13:52 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] HCTL ('33', '-', '-', 0) found on session 6 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9acee6-3df5-47f7-9911-cac6422eca24]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Searching for a device in session 6 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IFwVgDHB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:13:52 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:13:52 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Took 1.14 seconds to deallocate network for instance.
Nov 06 13:13:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-d9c4b315-95ef-47b7-9dbc-f0bd50207b5f req-38de811d-9224-4512-9bf1-a99a3ccdb1fc service nova] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Received event network-vif-deleted-1f3e50b9-2015-4c0b-adbd-fb91bf9d7753 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:13:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:13:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23130313039383462', 'path': '/dev/sdb'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:13:53 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130313039383462', 'path': '/dev/sdb'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:13:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.255s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:13:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:53 user nova-compute[74821]: DEBUG nova.objects.instance [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Lazy-loading 'flavor' on Instance uuid 86ccb546-94c4-482c-8017-852cd42999fe {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:13:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:53 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2e1f3f-2155-4343-886e-dd47cdfcb6db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:13:53 user nova-compute[74821]: No targets found.
Nov 06 13:13:53 user nova-compute[74821]: iSNS:
Nov 06 13:13:53 user nova-compute[74821]: No targets found.
Nov 06 13:13:53 user nova-compute[74821]: STATIC:
Nov 06 13:13:53 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c
Nov 06 13:13:53 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:13:53 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:13:53 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2
Nov 06 13:13:53 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:13:53 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:13:53 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6
Nov 06 13:13:53 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:13:53 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:13:53 user nova-compute[74821]: FIRMWARE:
Nov 06 13:13:53 user nova-compute[74821]: No targets found.
Nov 06 13:13:53 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:13:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:13:53 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:13:53 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:13:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:13:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:53 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 13:13:53 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:13:53 user nova-compute[74821]:   <source dev="/dev/sdb"/>
Nov 06 13:13:53 user nova-compute[74821]:   <target dev="sdc" bus="scsi"/>
Nov 06 13:13:53 user nova-compute[74821]:   <serial>6450be35-c354-4427-8a2d-13e473caf7f6</serial>
Nov 06 13:13:53 user nova-compute[74821]:   <address type="drive" controller="0" unit="2"/>
Nov 06 13:13:53 user nova-compute[74821]: </disk>
Nov 06 13:13:53 user nova-compute[74821]:  {{(pid=74821) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 13:13:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:53 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[957500b8-f45d-46d9-ba33-ee2e903bd249]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:13:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:13:53 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a63c3f4-76bf-46ef-8bb4-736f4b5cfdd2]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:13:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c (non-flash)
Nov 06 13:13:53 user nova-compute[74821]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:13:53 user nova-compute[74821]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6 (non-flash)
Nov 06 13:13:53 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:13:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c (non-flash)
Nov 06 13:13:53 user nova-compute[74821]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:13:53 user nova-compute[74821]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6 (non-flash)
Nov 06 13:13:53 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:13:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e5863c0d0>, {}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:13:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Disconnecting from: [] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:13:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.070s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:13:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] <== disconnect_volume: return (1325ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:13:53 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:13:53 user nova-compute[74821]: INFO nova.compute.manager [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] [instance: a2b373e1-f872-4263-808c-ce5fbddf907c] Took 0.90 seconds to detach 1 volumes for instance.
Nov 06 13:13:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:13:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:13:53 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] No BDM found with device name sda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:13:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:13:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:13:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] No VIF found with MAC fa:16:3e:ba:c2:bf, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:13:54 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:13:54 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:13:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:13:54 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Deleted allocations for instance a2b373e1-f872-4263-808c-ce5fbddf907c
Nov 06 13:13:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5b9fbd4b-f98c-4658-a457-d1581cb711fb tempest-DeleteServersTestJSON-1732675514 tempest-DeleteServersTestJSON-1732675514-project-member] Lock "a2b373e1-f872-4263-808c-ce5fbddf907c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.573s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:13:54 user nova-compute[74821]: DEBUG nova.compute.manager [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Preparing to wait for external event volume-reimaged-e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f {{(pid=74821) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 06 13:13:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Acquiring lock "ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:13:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Lock "ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:13:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Lock "ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:13:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-183eace4-25ab-4fd4-af84-1f2ea7305d13 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Lock "86ccb546-94c4-482c-8017-852cd42999fe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.519s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:13:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Acquiring lock "86ccb546-94c4-482c-8017-852cd42999fe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:13:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Lock "86ccb546-94c4-482c-8017-852cd42999fe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:13:56 user nova-compute[74821]: INFO nova.compute.manager [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Detaching volume 6450be35-c354-4427-8a2d-13e473caf7f6
Nov 06 13:13:56 user nova-compute[74821]: INFO nova.virt.block_device [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Attempting to driver detach volume 6450be35-c354-4427-8a2d-13e473caf7f6 from mountpoint /dev/sdc
Nov 06 13:13:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Attempting to detach device sdc from instance 86ccb546-94c4-482c-8017-852cd42999fe from the persistent domain config. {{(pid=74821) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 13:13:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:13:56 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:13:56 user nova-compute[74821]:   <source dev="/dev/sdb"/>
Nov 06 13:13:56 user nova-compute[74821]:   <target dev="sdc" bus="scsi"/>
Nov 06 13:13:56 user nova-compute[74821]:   <serial>6450be35-c354-4427-8a2d-13e473caf7f6</serial>
Nov 06 13:13:56 user nova-compute[74821]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 06 13:13:56 user nova-compute[74821]: </disk>
Nov 06 13:13:56 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:13:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:13:56 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Successfully detached device sdc from instance 86ccb546-94c4-482c-8017-852cd42999fe from the persistent domain config.
Nov 06 13:13:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 86ccb546-94c4-482c-8017-852cd42999fe from the live domain config. {{(pid=74821) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 13:13:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:13:56 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:13:56 user nova-compute[74821]:   <source dev="/dev/sdb"/>
Nov 06 13:13:56 user nova-compute[74821]:   <target dev="sdc" bus="scsi"/>
Nov 06 13:13:56 user nova-compute[74821]:   <serial>6450be35-c354-4427-8a2d-13e473caf7f6</serial>
Nov 06 13:13:56 user nova-compute[74821]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 06 13:13:56 user nova-compute[74821]: </disk>
Nov 06 13:13:56 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:13:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 86ccb546-94c4-482c-8017-852cd42999fe {{(pid=74821) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 13:14:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:06 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-71ffe9ce-d442-4816-a9a7-eaf70a86aab9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Acquiring lock "c62c177c-bd96-44f6-bc8d-44131914747b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:14:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-71ffe9ce-d442-4816-a9a7-eaf70a86aab9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Lock "c62c177c-bd96-44f6-bc8d-44131914747b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:14:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-71ffe9ce-d442-4816-a9a7-eaf70a86aab9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Acquiring lock "c62c177c-bd96-44f6-bc8d-44131914747b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:14:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-71ffe9ce-d442-4816-a9a7-eaf70a86aab9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Lock "c62c177c-bd96-44f6-bc8d-44131914747b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:14:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-71ffe9ce-d442-4816-a9a7-eaf70a86aab9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Lock "c62c177c-bd96-44f6-bc8d-44131914747b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:14:08 user nova-compute[74821]: INFO nova.compute.manager [None req-71ffe9ce-d442-4816-a9a7-eaf70a86aab9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Terminating instance
Nov 06 13:14:08 user nova-compute[74821]: DEBUG nova.compute.manager [None req-71ffe9ce-d442-4816-a9a7-eaf70a86aab9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:14:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:08 user nova-compute[74821]: DEBUG nova.compute.manager [req-9e52fcf6-660b-4cf1-a2ae-4fa474745345 req-8883a405-0d73-4024-a660-e0a28c2c506e service nova] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Received event network-vif-unplugged-0ebc9cf7-d8f9-4a5e-9142-c515e05e7571 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:14:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-9e52fcf6-660b-4cf1-a2ae-4fa474745345 req-8883a405-0d73-4024-a660-e0a28c2c506e service nova] Acquiring lock "c62c177c-bd96-44f6-bc8d-44131914747b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:14:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-9e52fcf6-660b-4cf1-a2ae-4fa474745345 req-8883a405-0d73-4024-a660-e0a28c2c506e service nova] Lock "c62c177c-bd96-44f6-bc8d-44131914747b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:14:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-9e52fcf6-660b-4cf1-a2ae-4fa474745345 req-8883a405-0d73-4024-a660-e0a28c2c506e service nova] Lock "c62c177c-bd96-44f6-bc8d-44131914747b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:14:08 user nova-compute[74821]: DEBUG nova.compute.manager [req-9e52fcf6-660b-4cf1-a2ae-4fa474745345 req-8883a405-0d73-4024-a660-e0a28c2c506e service nova] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] No waiting events found dispatching network-vif-unplugged-0ebc9cf7-d8f9-4a5e-9142-c515e05e7571 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:14:08 user nova-compute[74821]: DEBUG nova.compute.manager [req-9e52fcf6-660b-4cf1-a2ae-4fa474745345 req-8883a405-0d73-4024-a660-e0a28c2c506e service nova] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Received event network-vif-unplugged-0ebc9cf7-d8f9-4a5e-9142-c515e05e7571 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:14:09 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Instance destroyed successfully.
Nov 06 13:14:09 user nova-compute[74821]: DEBUG nova.objects.instance [None req-71ffe9ce-d442-4816-a9a7-eaf70a86aab9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Lazy-loading 'resources' on Instance uuid c62c177c-bd96-44f6-bc8d-44131914747b {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:14:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-71ffe9ce-d442-4816-a9a7-eaf70a86aab9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:12:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-271307275',display_name='tempest-ServersNegativeTestJSON-server-271307275',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-271307275',id=10,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:12:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86724840a9ba4cc486fd1d0d0477c778',ramdisk_id='',reservation_id='r-20o4ponj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-835160312',owner_user_name='tempest-ServersNegativeTestJSON-835160312-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:12:27Z,user_data=None,user_id='166c2e871760499ab517261aa874f8da',uuid=c62c177c-bd96-44f6-bc8d-44131914747b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ebc9cf7-d8f9-4a5e-9142-c515e05e7571", "address": "fa:16:3e:c3:e6:56", "network": {"id": "d5bae261-3db3-492a-a55e-df6c0fd01fe1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-60002553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86724840a9ba4cc486fd1d0d0477c778", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ebc9cf7-d8", "ovs_interfaceid": "0ebc9cf7-d8f9-4a5e-9142-c515e05e7571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:14:09 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-71ffe9ce-d442-4816-a9a7-eaf70a86aab9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Converting VIF {"id": "0ebc9cf7-d8f9-4a5e-9142-c515e05e7571", "address": "fa:16:3e:c3:e6:56", "network": {"id": "d5bae261-3db3-492a-a55e-df6c0fd01fe1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-60002553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86724840a9ba4cc486fd1d0d0477c778", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ebc9cf7-d8", "ovs_interfaceid": "0ebc9cf7-d8f9-4a5e-9142-c515e05e7571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:14:09 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-71ffe9ce-d442-4816-a9a7-eaf70a86aab9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:e6:56,bridge_name='br-int',has_traffic_filtering=True,id=0ebc9cf7-d8f9-4a5e-9142-c515e05e7571,network=Network(d5bae261-3db3-492a-a55e-df6c0fd01fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ebc9cf7-d8') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:14:09 user nova-compute[74821]: DEBUG os_vif [None req-71ffe9ce-d442-4816-a9a7-eaf70a86aab9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:e6:56,bridge_name='br-int',has_traffic_filtering=True,id=0ebc9cf7-d8f9-4a5e-9142-c515e05e7571,network=Network(d5bae261-3db3-492a-a55e-df6c0fd01fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ebc9cf7-d8') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:14:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ebc9cf7-d8, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:14:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:14:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4a667783-da23-4611-96f5-87136fcbec64) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:14:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:09 user nova-compute[74821]: INFO os_vif [None req-71ffe9ce-d442-4816-a9a7-eaf70a86aab9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:e6:56,bridge_name='br-int',has_traffic_filtering=True,id=0ebc9cf7-d8f9-4a5e-9142-c515e05e7571,network=Network(d5bae261-3db3-492a-a55e-df6c0fd01fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ebc9cf7-d8')
Nov 06 13:14:09 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-71ffe9ce-d442-4816-a9a7-eaf70a86aab9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Deleting instance files /opt/stack/data/nova/instances/c62c177c-bd96-44f6-bc8d-44131914747b_del
Nov 06 13:14:09 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-71ffe9ce-d442-4816-a9a7-eaf70a86aab9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Deletion of /opt/stack/data/nova/instances/c62c177c-bd96-44f6-bc8d-44131914747b_del complete
Nov 06 13:14:09 user nova-compute[74821]: INFO nova.compute.manager [None req-71ffe9ce-d442-4816-a9a7-eaf70a86aab9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 06 13:14:09 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-71ffe9ce-d442-4816-a9a7-eaf70a86aab9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:14:09 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:14:09 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:14:09 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:14:09 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Took 0.68 seconds to deallocate network for instance.
Nov 06 13:14:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-71ffe9ce-d442-4816-a9a7-eaf70a86aab9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:14:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-71ffe9ce-d442-4816-a9a7-eaf70a86aab9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:14:10 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-71ffe9ce-d442-4816-a9a7-eaf70a86aab9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:14:10 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-71ffe9ce-d442-4816-a9a7-eaf70a86aab9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:14:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-71ffe9ce-d442-4816-a9a7-eaf70a86aab9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:14:10 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-71ffe9ce-d442-4816-a9a7-eaf70a86aab9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Deleted allocations for instance c62c177c-bd96-44f6-bc8d-44131914747b
Nov 06 13:14:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-71ffe9ce-d442-4816-a9a7-eaf70a86aab9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Lock "c62c177c-bd96-44f6-bc8d-44131914747b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.348s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:14:10 user nova-compute[74821]: DEBUG nova.compute.manager [req-87ee4f34-001c-4414-8ab4-64ac5b8aa988 req-a7ad7806-3d96-4c6b-abeb-ac4f0723a3b4 service nova] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Received event network-vif-plugged-0ebc9cf7-d8f9-4a5e-9142-c515e05e7571 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:14:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-87ee4f34-001c-4414-8ab4-64ac5b8aa988 req-a7ad7806-3d96-4c6b-abeb-ac4f0723a3b4 service nova] Acquiring lock "c62c177c-bd96-44f6-bc8d-44131914747b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:14:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-87ee4f34-001c-4414-8ab4-64ac5b8aa988 req-a7ad7806-3d96-4c6b-abeb-ac4f0723a3b4 service nova] Lock "c62c177c-bd96-44f6-bc8d-44131914747b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:14:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-87ee4f34-001c-4414-8ab4-64ac5b8aa988 req-a7ad7806-3d96-4c6b-abeb-ac4f0723a3b4 service nova] Lock "c62c177c-bd96-44f6-bc8d-44131914747b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:14:10 user nova-compute[74821]: DEBUG nova.compute.manager [req-87ee4f34-001c-4414-8ab4-64ac5b8aa988 req-a7ad7806-3d96-4c6b-abeb-ac4f0723a3b4 service nova] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] No waiting events found dispatching network-vif-plugged-0ebc9cf7-d8f9-4a5e-9142-c515e05e7571 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:14:10 user nova-compute[74821]: WARNING nova.compute.manager [req-87ee4f34-001c-4414-8ab4-64ac5b8aa988 req-a7ad7806-3d96-4c6b-abeb-ac4f0723a3b4 service nova] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Received unexpected event network-vif-plugged-0ebc9cf7-d8f9-4a5e-9142-c515e05e7571 for instance with vm_state deleted and task_state None.
Nov 06 13:14:10 user nova-compute[74821]: DEBUG nova.compute.manager [req-87ee4f34-001c-4414-8ab4-64ac5b8aa988 req-a7ad7806-3d96-4c6b-abeb-ac4f0723a3b4 service nova] [instance: c62c177c-bd96-44f6-bc8d-44131914747b] Received event network-vif-deleted-0ebc9cf7-d8f9-4a5e-9142-c515e05e7571 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:14:10 user nova-compute[74821]: INFO nova.virt.block_device [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Booting with volume 424fd083-b856-43b1-8c8f-945fe811aa4e at /dev/vdc
Nov 06 13:14:10 user nova-compute[74821]: DEBUG os_brick.utils [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:14:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:10 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1df34e1-61c8-4461-a551-1596f716e25e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:10 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0996ac-934d-4e46-b24e-a7e8feac1c47]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:10 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f42e43d-65fb-4e2e-b617-7939e616fd95]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:10 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0146754-53d4-4cfa-9af1-2b05ef4ec533]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:14:11 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:14:11 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e5cd10-41a1-433f-b40b-f72218cf09b1]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG os_brick.utils [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Updating existing volume attachment record: a83566b7-5b03-435a-bb1a-8cd627d6543d {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:14:11 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 49d05da1-3222-4f9f-b792-8f3d1f0f2890 is timed out.
Nov 06 13:14:11 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Successfully detached device vdb from instance 49d05da1-3222-4f9f-b792-8f3d1f0f2890 from the live domain config.
Nov 06 13:14:11 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oOPZMNkD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:14:11 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:14:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ec00c7-7a28-43dd-a575-fa83ae4c7d31]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:14:11 user nova-compute[74821]: No targets found.
Nov 06 13:14:11 user nova-compute[74821]: iSNS:
Nov 06 13:14:11 user nova-compute[74821]: No targets found.
Nov 06 13:14:11 user nova-compute[74821]: STATIC:
Nov 06 13:14:11 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c
Nov 06 13:14:11 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:14:11 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:14:11 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2
Nov 06 13:14:11 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:14:11 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:14:11 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6
Nov 06 13:14:11 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:14:11 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:14:11 user nova-compute[74821]: FIRMWARE:
Nov 06 13:14:11 user nova-compute[74821]: No targets found.
Nov 06 13:14:11 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:14:11 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:14:11 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4130a7fb-217a-4792-8fd0-dd83e1021560]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebe0843-e00d-4d52-9dc8-bcb9305e8d1c]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c (non-flash)
Nov 06 13:14:11 user nova-compute[74821]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:14:11 user nova-compute[74821]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6 (non-flash)
Nov 06 13:14:11 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c (non-flash)
Nov 06 13:14:11 user nova-compute[74821]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:14:11 user nova-compute[74821]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6 (non-flash)
Nov 06 13:14:11 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e405888b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c'): ({'sdd'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Removing single pathed devices sdd {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d8d3f8-fb77-4b92-bba7-18553644922e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1130763-dc7f-4d17-819e-7c58536d8bf3]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Flushing IO for device /dev/sdd {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf09068e-3b65-4468-8986-9924212a65c1]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:14:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.033s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:12 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[61da3237-ddcb-4d8f-9fc1-50682e4cec3f]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:12 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:14:12 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] SCSI volumes sdd have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:14:12 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:14:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:12 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[276cbb55-5daf-47f3-a42d-d634affa64f5]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:12 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:14:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:12 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d757ccd0-1d3c-4923-ab77-3f7c69ac8459]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:12 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c, portal: 172.16.0.220,3260]
Nov 06 13:14:12 user nova-compute[74821]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c, portal: 172.16.0.220,3260] successful.
Nov 06 13:14:12 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:14:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41948e07-1ed7-473c-b90d-cfea7069fe1c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:12 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ac71af-3e36-4354-ac9d-e57addb90ab9]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:12 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:14:12 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:14:12 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] <== disconnect_volume: return (311ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:14:12 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:14:13 user nova-compute[74821]: DEBUG nova.objects.instance [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Lazy-loading 'flavor' on Instance uuid 49d05da1-3222-4f9f-b792-8f3d1f0f2890 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:14:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2dc01e2e-5f62-49d3-9d6d-993bbd01c74c tempest-VolumesAssistedSnapshotsTest-424038621 tempest-VolumesAssistedSnapshotsTest-424038621-project-admin] Lock "49d05da1-3222-4f9f-b792-8f3d1f0f2890" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.198s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:14:14 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:16 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 86ccb546-94c4-482c-8017-852cd42999fe is timed out.
Nov 06 13:14:16 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Successfully detached device sdc from instance 86ccb546-94c4-482c-8017-852cd42999fe from the live domain config.
Nov 06 13:14:16 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IFwVgDHB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:14:16 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:14:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6388599a-813a-4d7e-b49c-02875781a84a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:14:16 user nova-compute[74821]: No targets found.
Nov 06 13:14:16 user nova-compute[74821]: iSNS:
Nov 06 13:14:16 user nova-compute[74821]: No targets found.
Nov 06 13:14:16 user nova-compute[74821]: STATIC:
Nov 06 13:14:16 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2
Nov 06 13:14:16 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:14:16 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:14:16 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6
Nov 06 13:14:16 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:14:16 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:14:16 user nova-compute[74821]: FIRMWARE:
Nov 06 13:14:16 user nova-compute[74821]: No targets found.
Nov 06 13:14:16 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:14:16 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:14:16 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c740138e-129b-4eeb-833f-70a145483d14]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[26756a49-b1dc-42d0-8cda-31424fe41f55]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:14:16 user nova-compute[74821]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6 (non-flash)
Nov 06 13:14:16 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:14:16 user nova-compute[74821]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6 (non-flash)
Nov 06 13:14:16 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e40589c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6'): ({'sdb'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Removing single pathed devices sdb {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9894d3-0fc1-4137-b103-19442aac8991]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[47dd5a92-e048-45a7-9df8-1499d440cd06]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Flushing IO for device /dev/sdb {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8363ceea-a5d8-4a4f-8d47-7ccc0366b2ae]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89d7bf6-dfe3-41b7-a50b-e66d38dc7b8c]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] SCSI volumes sdb have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0896a752-87b1-450d-89b9-ed020d1ecc0a]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b84a21-6d11-4955-91db-0cf00b202879]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6, portal: 172.16.0.220,3260]
Nov 06 13:14:16 user nova-compute[74821]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6, portal: 172.16.0.220,3260] successful.
Nov 06 13:14:16 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6450be35-c354-4427-8a2d-13e473caf7f6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13ff7ce-3db6-4b5e-87b5-a4a07a13040e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] <== disconnect_volume: return (297ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:14:16 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG nova.compute.manager [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HKIEbLYu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c47906a7-93b9-4527-9318-ed4df54afff6', 'attached_at': '', 'detached_at': '', 'volume_id': '98b405b9-f2d3-4473-83ac-582fbc9f5641', 'serial': '98b405b9-f2d3-4473-83ac-582fbc9f5641'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaLCBrKp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'c47906a7-93b9-4527-9318-ed4df54afff6', 'attached_at': '', 'detached_at': '', 'volume_id': '0c31aa69-3a6d-4c9c-a628-a698806b57c2', 'serial'} {{(pid=74821) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HKIEbLYu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:14:17 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:14:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:14:17 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:14:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:14:17 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:14:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b66b34-b355-4155-abb6-4471982acabe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:14:17 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[539e3f43-7151-4d53-b6f0-32d5669b042a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641] added
Nov 06 13:14:17 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8628561-5bdd-4204-a924-76b4ca7da55e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d233f7bf-ee73-4d15-a79b-1bed75081087]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HKIEbLYu {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HKIEbLYu" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[94205a07-5da2-432b-9c81-c1d6c121563b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HKIEbLYu'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2334d3c-9eca-4fa9-bd86-529a24e45daf]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e2797d-a04a-4816-9ff4-f04ec6e1722c]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:14:17 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:14:17 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ccf349-ad3b-4475-8efc-3f9aa4eb52c4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641, portal: 172.16.0.220,3260]
Nov 06 13:14:17 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641, portal: 172.16.0.220,3260] successful.
Nov 06 13:14:17 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f5b480-4ce4-4596-819a-fbcd0bc65c47]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e42aad-fb1f-4b6e-87d2-77492741a0d3]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:14:17 user nova-compute[74821]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 (non-flash)
Nov 06 13:14:17 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:14:17 user nova-compute[74821]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 (non-flash)
Nov 06 13:14:17 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] HCTL ('33', '-', '-', 0) found on session 7 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e11d5f6-ec83-4b3b-90b1-fdea401ca416]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Searching for a device in session 7 and hctl ['33', '*', '*', 0] yield: None {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG nova.objects.instance [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Lazy-loading 'flavor' on Instance uuid 86ccb546-94c4-482c-8017-852cd42999fe {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:14:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-13f7997c-ecd3-43ef-a38b-7088e8f126c4 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Lock "86ccb546-94c4-482c-8017-852cd42999fe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.854s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:14:18 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Searching for a device in session 7 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:14:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HKIEbLYu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:14:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:14:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26239373830303538', 'path': '/dev/sdb'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:14:18 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239373830303538', 'path': '/dev/sdb'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:14:18 user nova-compute[74821]: DEBUG nova.objects.instance [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Lazy-loading 'flavor' on Instance uuid c47906a7-93b9-4527-9318-ed4df54afff6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:14:18 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74821) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 13:14:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:19 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] COPY block job progress, current cursor: 132120576 final cursor: 1073741824 {{(pid=74821) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 13:14:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-59566aa0-6c1c-4958-a030-228c64176963 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Acquiring lock "86ccb546-94c4-482c-8017-852cd42999fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:14:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-59566aa0-6c1c-4958-a030-228c64176963 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Lock "86ccb546-94c4-482c-8017-852cd42999fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:14:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-59566aa0-6c1c-4958-a030-228c64176963 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Acquiring lock "86ccb546-94c4-482c-8017-852cd42999fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:14:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-59566aa0-6c1c-4958-a030-228c64176963 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Lock "86ccb546-94c4-482c-8017-852cd42999fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:14:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-59566aa0-6c1c-4958-a030-228c64176963 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Lock "86ccb546-94c4-482c-8017-852cd42999fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:14:19 user nova-compute[74821]: INFO nova.compute.manager [None req-59566aa0-6c1c-4958-a030-228c64176963 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Terminating instance
Nov 06 13:14:19 user nova-compute[74821]: DEBUG nova.compute.manager [None req-59566aa0-6c1c-4958-a030-228c64176963 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:14:19 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] COPY block job progress, current cursor: 296747008 final cursor: 1073741824 {{(pid=74821) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 13:14:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:20 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:20 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:20 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:20 user nova-compute[74821]: DEBUG nova.compute.manager [req-fb128316-2ebf-456e-9dc6-784a6d43fe0d req-3fd4eaf7-e8de-4a98-9e5b-d5ef06628021 service nova] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Received event network-vif-unplugged-93600b1e-7a16-42b2-8577-440a7d7f0667 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:14:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fb128316-2ebf-456e-9dc6-784a6d43fe0d req-3fd4eaf7-e8de-4a98-9e5b-d5ef06628021 service nova] Acquiring lock "86ccb546-94c4-482c-8017-852cd42999fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:14:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fb128316-2ebf-456e-9dc6-784a6d43fe0d req-3fd4eaf7-e8de-4a98-9e5b-d5ef06628021 service nova] Lock "86ccb546-94c4-482c-8017-852cd42999fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:14:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fb128316-2ebf-456e-9dc6-784a6d43fe0d req-3fd4eaf7-e8de-4a98-9e5b-d5ef06628021 service nova] Lock "86ccb546-94c4-482c-8017-852cd42999fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:14:20 user nova-compute[74821]: DEBUG nova.compute.manager [req-fb128316-2ebf-456e-9dc6-784a6d43fe0d req-3fd4eaf7-e8de-4a98-9e5b-d5ef06628021 service nova] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] No waiting events found dispatching network-vif-unplugged-93600b1e-7a16-42b2-8577-440a7d7f0667 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:14:20 user nova-compute[74821]: DEBUG nova.compute.manager [req-fb128316-2ebf-456e-9dc6-784a6d43fe0d req-3fd4eaf7-e8de-4a98-9e5b-d5ef06628021 service nova] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Received event network-vif-unplugged-93600b1e-7a16-42b2-8577-440a7d7f0667 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:14:20 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] COPY block job progress, current cursor: 420478976 final cursor: 1073741824 {{(pid=74821) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 13:14:20 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Instance destroyed successfully.
Nov 06 13:14:20 user nova-compute[74821]: DEBUG nova.objects.instance [None req-59566aa0-6c1c-4958-a030-228c64176963 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Lazy-loading 'resources' on Instance uuid 86ccb546-94c4-482c-8017-852cd42999fe {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:14:20 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-59566aa0-6c1c-4958-a030-228c64176963 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2027393985',display_name='tempest-AttachSCSIVolumeTestJSON-server-2027393985',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2027393985',id=6,image_ref='5968e265-b173-4361-97e6-4a44ed4f6fc5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKtApV1r3heOGi31OqfSZUB2u/MSmailsMr88Q4lHjB16ry8TiN61Otk343Nj+oZVa907e7/j0TqLwSbk49PoKoSc26FsCKglBSCCmxbAWHfyskD1zfAxHUt1zW1x9Letw==',key_name='tempest-keypair-1839561808',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:11:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67451985a44547f1b99750173d9c24bc',ramdisk_id='',reservation_id='r-k6gsijq3',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5968e265-b173-4361-97e6-4a44ed4f6fc5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1743036243',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1743036243-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:11:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e9946729f1d4cd18d82868dd3c6dab6',uuid=86ccb546-94c4-482c-8017-852cd42999fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93600b1e-7a16-42b2-8577-440a7d7f0667", "address": "fa:16:3e:ba:c2:bf", "network": {"id": "1b5b94d0-ef68-400c-b1f8-5f2892422587", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-185086197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67451985a44547f1b99750173d9c24bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93600b1e-7a", "ovs_interfaceid": "93600b1e-7a16-42b2-8577-440a7d7f0667", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:14:20 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-59566aa0-6c1c-4958-a030-228c64176963 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Converting VIF {"id": "93600b1e-7a16-42b2-8577-440a7d7f0667", "address": "fa:16:3e:ba:c2:bf", "network": {"id": "1b5b94d0-ef68-400c-b1f8-5f2892422587", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-185086197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67451985a44547f1b99750173d9c24bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93600b1e-7a", "ovs_interfaceid": "93600b1e-7a16-42b2-8577-440a7d7f0667", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:14:20 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-59566aa0-6c1c-4958-a030-228c64176963 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:c2:bf,bridge_name='br-int',has_traffic_filtering=True,id=93600b1e-7a16-42b2-8577-440a7d7f0667,network=Network(1b5b94d0-ef68-400c-b1f8-5f2892422587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93600b1e-7a') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:14:20 user nova-compute[74821]: DEBUG os_vif [None req-59566aa0-6c1c-4958-a030-228c64176963 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:c2:bf,bridge_name='br-int',has_traffic_filtering=True,id=93600b1e-7a16-42b2-8577-440a7d7f0667,network=Network(1b5b94d0-ef68-400c-b1f8-5f2892422587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93600b1e-7a') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:14:20 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:20 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93600b1e-7a, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:14:20 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:20 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:14:20 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:20 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ce657f6-2b9d-41a2-a652-c380cb7e0728) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:14:20 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:20 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:14:20 user nova-compute[74821]: INFO os_vif [None req-59566aa0-6c1c-4958-a030-228c64176963 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:c2:bf,bridge_name='br-int',has_traffic_filtering=True,id=93600b1e-7a16-42b2-8577-440a7d7f0667,network=Network(1b5b94d0-ef68-400c-b1f8-5f2892422587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93600b1e-7a')
Nov 06 13:14:20 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-59566aa0-6c1c-4958-a030-228c64176963 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Deleting instance files /opt/stack/data/nova/instances/86ccb546-94c4-482c-8017-852cd42999fe_del
Nov 06 13:14:20 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-59566aa0-6c1c-4958-a030-228c64176963 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Deletion of /opt/stack/data/nova/instances/86ccb546-94c4-482c-8017-852cd42999fe_del complete
Nov 06 13:14:20 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] COPY block job progress, current cursor: 559939584 final cursor: 1073741824 {{(pid=74821) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 13:14:20 user nova-compute[74821]: INFO nova.compute.manager [None req-59566aa0-6c1c-4958-a030-228c64176963 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 06 13:14:20 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-59566aa0-6c1c-4958-a030-228c64176963 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:14:20 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:14:20 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:14:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] COPY block job progress, current cursor: 657457152 final cursor: 1073741824 {{(pid=74821) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 13:14:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] COPY block job progress, current cursor: 843055104 final cursor: 1073741824 {{(pid=74821) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 13:14:22 user nova-compute[74821]: DEBUG nova.compute.manager [req-001c577c-94cf-484f-a229-2db9bd1e5a50 req-b889e3f8-aa66-4b16-99ce-aeb9190268e9 service nova] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Received event network-vif-plugged-93600b1e-7a16-42b2-8577-440a7d7f0667 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:14:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-001c577c-94cf-484f-a229-2db9bd1e5a50 req-b889e3f8-aa66-4b16-99ce-aeb9190268e9 service nova] Acquiring lock "86ccb546-94c4-482c-8017-852cd42999fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:14:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-001c577c-94cf-484f-a229-2db9bd1e5a50 req-b889e3f8-aa66-4b16-99ce-aeb9190268e9 service nova] Lock "86ccb546-94c4-482c-8017-852cd42999fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:14:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-001c577c-94cf-484f-a229-2db9bd1e5a50 req-b889e3f8-aa66-4b16-99ce-aeb9190268e9 service nova] Lock "86ccb546-94c4-482c-8017-852cd42999fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:14:22 user nova-compute[74821]: DEBUG nova.compute.manager [req-001c577c-94cf-484f-a229-2db9bd1e5a50 req-b889e3f8-aa66-4b16-99ce-aeb9190268e9 service nova] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] No waiting events found dispatching network-vif-plugged-93600b1e-7a16-42b2-8577-440a7d7f0667 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:14:22 user nova-compute[74821]: WARNING nova.compute.manager [req-001c577c-94cf-484f-a229-2db9bd1e5a50 req-b889e3f8-aa66-4b16-99ce-aeb9190268e9 service nova] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Received unexpected event network-vif-plugged-93600b1e-7a16-42b2-8577-440a7d7f0667 for instance with vm_state active and task_state deleting.
Nov 06 13:14:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] COPY block job progress, current cursor: 1021313024 final cursor: 1073741824 {{(pid=74821) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 13:14:22 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:14:22 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Took 1.61 seconds to deallocate network for instance.
Nov 06 13:14:22 user nova-compute[74821]: DEBUG nova.compute.manager [req-e44a87c9-508d-4360-a96f-665982d43333 req-36c0bdba-4b96-4625-b545-3e32b224de4b service nova] [instance: 86ccb546-94c4-482c-8017-852cd42999fe] Received event network-vif-deleted-93600b1e-7a16-42b2-8577-440a7d7f0667 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:14:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-59566aa0-6c1c-4958-a030-228c64176963 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:14:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-59566aa0-6c1c-4958-a030-228c64176963 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:14:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74821) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 13:14:22 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-59566aa0-6c1c-4958-a030-228c64176963 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:14:22 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-59566aa0-6c1c-4958-a030-228c64176963 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:14:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-59566aa0-6c1c-4958-a030-228c64176963 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.334s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaLCBrKp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:14:23 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:14:23 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:14:23 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-59566aa0-6c1c-4958-a030-228c64176963 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Deleted allocations for instance 86ccb546-94c4-482c-8017-852cd42999fe
Nov 06 13:14:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a4494b-c9fc-4098-8cd4-716776582efc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:14:23 user nova-compute[74821]: No targets found.
Nov 06 13:14:23 user nova-compute[74821]: iSNS:
Nov 06 13:14:23 user nova-compute[74821]: No targets found.
Nov 06 13:14:23 user nova-compute[74821]: STATIC:
Nov 06 13:14:23 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f
Nov 06 13:14:23 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:14:23 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:14:23 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2
Nov 06 13:14:23 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:14:23 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:14:23 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641
Nov 06 13:14:23 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:14:23 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:14:23 user nova-compute[74821]: FIRMWARE:
Nov 06 13:14:23 user nova-compute[74821]: No targets found.
Nov 06 13:14:23 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:14:23 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:14:23 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1280d8-17ec-48e0-a3c7-22b63a51953f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b9f34c-fa43-400c-84ae-c63e2d383bd5]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:14:23 user nova-compute[74821]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 (non-flash)
Nov 06 13:14:23 user nova-compute[74821]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f (non-flash)
Nov 06 13:14:23 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:14:23 user nova-compute[74821]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 (non-flash)
Nov 06 13:14:23 user nova-compute[74821]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f (non-flash)
Nov 06 13:14:23 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e405e8700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2'): ({'sde'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Removing single pathed devices sde {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd69f49-d691-4eb9-a8d8-4df8a2df2bbd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a50b66-93a7-4acf-9bd3-7a64e540b5db]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Flushing IO for device /dev/sde {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-59566aa0-6c1c-4958-a030-228c64176963 tempest-AttachSCSIVolumeTestJSON-1743036243 tempest-AttachSCSIVolumeTestJSON-1743036243-project-member] Lock "86ccb546-94c4-482c-8017-852cd42999fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.378s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd9af23-5303-4362-a399-e71ed33079d6]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34eaf95-df2d-4c0d-9502-ad8477349fa8]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] SCSI volumes sde have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.050s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59cef52-cbd8-45d6-ab95-464fa831bdf5]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.146s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[198463f1-2408-485d-a0cd-a9f584f10199]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2, portal: 172.16.0.220,3260]
Nov 06 13:14:23 user nova-compute[74821]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2, portal: 172.16.0.220,3260] successful.
Nov 06 13:14:23 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6fac73-a3d6-4304-aa9d-e037cbc98797]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.447s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] <== disconnect_volume: return (448ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG nova.compute.manager [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HKIEbLYu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'c47906a7-93b9-4527-9318-ed4df54afff6', 'attached_at': '', 'detached_at': '', 'volume_id': '98b405b9-f2d3-4473-83ac-582fbc9f5641', 'serial'} {{(pid=74821) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG nova.compute.manager [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] swap_volume: removing Cinder connection for volume 0c31aa69-3a6d-4c9c-a628-a698806b57c2 {{(pid=74821) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 06 13:14:23 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:14:24 user nova-compute[74821]: DEBUG nova.compute.manager [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] swap_volume: Updating volume 0c31aa69-3a6d-4c9c-a628-a698806b57c2 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "HKIEbLYu", "auth_password": "NpO6FMvIDz8PSu", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "98b405b9-f2d3-4473-83ac-582fbc9f5641"}, "status": "reserved", "instance": "c47906a7-93b9-4527-9318-ed4df54afff6", "attached_at": "", "detached_at": "", "volume_id": "98b405b9-f2d3-4473-83ac-582fbc9f5641", "serial": "98b405b9-f2d3-4473-83ac-582fbc9f5641"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '98b405b9-f2d3-4473-83ac-582fbc9f5641', 'no_device': None, 'attachment_id': 'a12740bb-78a6-472b-9bbe-2cf089788df2'} {{(pid=74821) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 06 13:14:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-add82074-646b-4f57-b63e-879f84adaad8 tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Lock "c47906a7-93b9-4527-9318-ed4df54afff6" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 32.699s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:14:24 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:14:24 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:14:25 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Skipping network cache update for instance because it has been migrated to another host. {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 06 13:14:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Acquiring lock "c47906a7-93b9-4527-9318-ed4df54afff6" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:14:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Lock "c47906a7-93b9-4527-9318-ed4df54afff6" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:14:25 user nova-compute[74821]: DEBUG os_brick.utils [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:14:25 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:25 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:25 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5677119f-5737-483b-9070-195eae9b9557]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:25 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:25 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:25 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[128dbef7-8ac9-40a8-8a8b-e586db520707]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:25 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:25 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:25 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[82445b1d-8e8b-471e-8d3f-2cf417ecfa47]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:25 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d00f63-e313-4bd4-a857-a367a773e1a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:25 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:25 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:14:25 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:14:25 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:25 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:14:25 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:14:25 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddf95a7-1a87-4e2f-99f3-3af280156f10]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:25 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:14:25 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:14:25 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:14:25 user nova-compute[74821]: DEBUG os_brick.utils [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:14:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-49d05da1-3222-4f9f-b792-8f3d1f0f2890" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:14:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-49d05da1-3222-4f9f-b792-8f3d1f0f2890" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:14:25 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:14:25 user nova-compute[74821]: INFO nova.compute.manager [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Swapping volume 98b405b9-f2d3-4473-83ac-582fbc9f5641 for 0c31aa69-3a6d-4c9c-a628-a698806b57c2
Nov 06 13:14:25 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Updating instance_info_cache with network_info: [{"id": "95f3755e-a074-4956-ba1d-5c05945bcff5", "address": "fa:16:3e:17:16:45", "network": {"id": "feb774a4-8d45-4814-bc23-169b2b378e48", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-639136774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0afa9994148b4f9698f0a9cc7c8d1a5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f3755e-a0", "ovs_interfaceid": "95f3755e-a074-4956-ba1d-5c05945bcff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:14:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-49d05da1-3222-4f9f-b792-8f3d1f0f2890" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:14:25 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:14:25 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:14:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:26 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:14:26 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:14:26 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:14:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:14:27 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:14:27 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:14:27 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:14:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:14:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:14:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:14:27 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:14:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49d05da1-3222-4f9f-b792-8f3d1f0f2890/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49d05da1-3222-4f9f-b792-8f3d1f0f2890/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49d05da1-3222-4f9f-b792-8f3d1f0f2890/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49d05da1-3222-4f9f-b792-8f3d1f0f2890/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47906a7-93b9-4527-9318-ed4df54afff6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47906a7-93b9-4527-9318-ed4df54afff6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47906a7-93b9-4527-9318-ed4df54afff6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47906a7-93b9-4527-9318-ed4df54afff6/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:14:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:14:31 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:14:31 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:14:31 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=8015MB free_disk=25.60354232788086GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 3e21d005-f190-478a-a911-e483e1235057 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance f8c537c6-fa3e-4842-9471-7258a22c01f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 311817c5-7b08-4da9-98eb-c685f37e6fd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 49d05da1-3222-4f9f-b792-8f3d1f0f2890 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance c47906a7-93b9-4527-9318-ed4df54afff6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance a33991ce-e911-460d-a6d9-ca738830ef2c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 5a715806-ff8b-4502-8435-c5de3e3c688a has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "5a715806-ff8b-4502-8435-c5de3e3c688a" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "5a715806-ff8b-4502-8435-c5de3e3c688a" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:14:31 user nova-compute[74821]: INFO nova.compute.manager [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Unshelving
Nov 06 13:14:31 user nova-compute[74821]: INFO nova.virt.block_device [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Booting with volume 5b3cce57-c905-4474-bb23-b3927ad008f3 at /dev/vdc
Nov 06 13:14:31 user nova-compute[74821]: DEBUG os_brick.utils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e143cfe5-e2b3-497c-acc2-493b2bdd996d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32a2273-6e60-407b-a34e-a2e1a8f6dcc7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef5b50e-f82d-40c2-8210-02dfdf00d5e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9492f2aa-7ce3-416a-afcf-9b4c3bb5d8a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.610s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:14:31 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:14:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ac691e-6061-4369-8944-616375a12f8b]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG os_brick.utils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:14:31 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Updating existing volume attachment record: df34d962-18e7-4f1b-9c6a-933c4e2d05ba {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:14:32 user nova-compute[74821]: DEBUG nova.compute.manager [req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae req-8862d949-12d0-45ff-af8c-8b64c531f796 service nova] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Received event volume-reimaged-e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:14:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae req-8862d949-12d0-45ff-af8c-8b64c531f796 service nova] Acquiring lock "ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:14:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae req-8862d949-12d0-45ff-af8c-8b64c531f796 service nova] Lock "ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:14:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae req-8862d949-12d0-45ff-af8c-8b64c531f796 service nova] Lock "ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:14:32 user nova-compute[74821]: DEBUG nova.compute.manager [req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae req-8862d949-12d0-45ff-af8c-8b64c531f796 service nova] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Processing event volume-reimaged-e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 06 13:14:32 user nova-compute[74821]: DEBUG nova.compute.manager [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Instance event wait completed in 37 seconds for volume-reimaged {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:14:32 user nova-compute[74821]: INFO nova.virt.block_device [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Booting with volume e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f at /dev/vda
Nov 06 13:14:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:35 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:14:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:14:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:14:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:14:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:14:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG nova.compute.manager [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaLCBrKp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c47906a7-93b9-4527-9318-ed4df54afff6', 'attached_at': '', 'detached_at': '', 'volume_id': '0c31aa69-3a6d-4c9c-a628-a698806b57c2', 'serial': '0c31aa69-3a6d-4c9c-a628-a698806b57c2'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HKIEbLYu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '98b405b9-f2d3-4473-83ac-582fbc9f5641'}, 'status': 'reserved', 'instance': 'c47906a7-93b9-4527-9318-ed4df54afff6', 'attached_at': '', 'detached_at': '', 'volume_id': '98b405b9-f2d3-4473-83ac-582fbc9f5641', 'serial'} {{(pid=74821) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaLCBrKp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:14:49 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:14:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:14:49 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:14:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:14:49 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:14:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fa9fa9-bef6-4dbf-9d60-d8fe28e7aea8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:14:49 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.217s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59c5b92-38fc-4187-b63b-5dbaa8b191f5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2] added
Nov 06 13:14:49 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc5f516-ec8a-4c28-820c-bd69e6b55334]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a7db74-8210-4dfc-abe7-8fafea2f5573]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NaLCBrKp {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NaLCBrKp" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f5612e-e901-4e89-9960-5fd115592b32]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NaLCBrKp'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9ffe64-bf69-4f9e-9418-707cac878ebd]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56d0977-e4bd-449d-a0f0-00e79d45f4b1]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 (non-flash)
Nov 06 13:14:49 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 (non-flash)
Nov 06 13:14:49 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[26846e9b-b390-4104-9079-3f14a8755b4c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2, portal: 172.16.0.220,3260]
Nov 06 13:14:49 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2, portal: 172.16.0.220,3260] successful.
Nov 06 13:14:49 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb20398-af85-44ae-883e-cc1ca161b54c]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a63cdb-8a75-4bab-9494-8cc2b6982f91]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 (non-flash)
Nov 06 13:14:49 user nova-compute[74821]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:14:49 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 (non-flash)
Nov 06 13:14:49 user nova-compute[74821]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:14:49 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.497s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] HCTL ('34', '-', '-', 0) found on session 9 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:14:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:50 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8eaedd-e34e-470c-ab54-6b0dd2faf50c]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:50 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Searching for a device in session 9 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:14:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaLCBrKp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:14:50 user nova-compute[74821]: DEBUG os_brick.utils [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:14:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:50 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb7e8ec-a67b-481b-bc6f-3efd142d780a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:50 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3009872-e51f-4e29-8824-db7aa8ada3a0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:50 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[325d1bf5-7a9e-494d-862d-bf0a265b75a1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:50 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6400ee4f-a582-49c6-a64b-f1e3a34c7ce0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:14:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:14:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:14:50 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:14:50 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6967e5ac-d943-4d1a-bc4f-80c5b750b233]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:14:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:14:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:14:50 user nova-compute[74821]: DEBUG os_brick.utils [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:14:50 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Updating existing volume attachment record: 0aaeaf4b-c6c8-4463-b08f-ad0731867014 {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:14:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:14:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.533s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:14:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] <== connect_volume: return (1534ms) {'type': 'block', 'scsi_wwn': '26234333862333464', 'path': '/dev/sdc'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:14:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234333862333464', 'path': '/dev/sdc'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:14:51 user nova-compute[74821]: DEBUG nova.objects.instance [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Lazy-loading 'flavor' on Instance uuid c47906a7-93b9-4527-9318-ed4df54afff6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:14:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74821) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 13:14:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] COPY block job progress, current cursor: 109051904 final cursor: 1073741824 {{(pid=74821) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 13:14:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] COPY block job progress, current cursor: 273678336 final cursor: 1073741824 {{(pid=74821) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 13:14:53 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] COPY block job progress, current cursor: 386924544 final cursor: 1073741824 {{(pid=74821) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 13:14:53 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] COPY block job progress, current cursor: 547356672 final cursor: 1073741824 {{(pid=74821) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 13:14:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] COPY block job progress, current cursor: 703594496 final cursor: 1073741824 {{(pid=74821) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 13:14:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] COPY block job progress, current cursor: 836763648 final cursor: 1073741824 {{(pid=74821) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] COPY block job progress, current cursor: 967835648 final cursor: 1073741824 {{(pid=74821) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74821) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HKIEbLYu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '98b405b9-f2d3-4473-83ac-582fbc9f5641'}, None), 'kwargs': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:14:55 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:14:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b79922-914c-4f83-9c72-4fafdb75ccb8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:14:55 user nova-compute[74821]: No targets found.
Nov 06 13:14:55 user nova-compute[74821]: iSNS:
Nov 06 13:14:55 user nova-compute[74821]: No targets found.
Nov 06 13:14:55 user nova-compute[74821]: STATIC:
Nov 06 13:14:55 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2
Nov 06 13:14:55 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:14:55 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:14:55 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641
Nov 06 13:14:55 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:14:55 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:14:55 user nova-compute[74821]: FIRMWARE:
Nov 06 13:14:55 user nova-compute[74821]: No targets found.
Nov 06 13:14:55 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:14:55 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:14:55 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d4ccaa-4e6e-4af1-b0a1-b97c206f3442]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3230e2a8-0fbd-49f4-bc67-125f9d1c2177]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 (non-flash)
Nov 06 13:14:55 user nova-compute[74821]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:14:55 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 (non-flash)
Nov 06 13:14:55 user nova-compute[74821]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:14:55 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e405ea440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641'): ({'sdb'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Removing single pathed devices sdb {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c7ee04-fbdc-46ae-8d83-8c1523ca053d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f5bba6-fef1-4769-ae4f-80d474502821]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Flushing IO for device /dev/sdb {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[19df0111-9e8b-4a5b-a736-9e16c9d43562]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a7fe28-33c8-4eb0-99ad-f770d4e90693]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] SCSI volumes sdb have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8debb6-ffd6-4204-91d4-c9dbdcc07e7d]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:14:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:56 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[da848b24-b0e1-4be5-b6d5-7176be6b617a]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641, portal: 172.16.0.220,3260]
Nov 06 13:14:56 user nova-compute[74821]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641, portal: 172.16.0.220,3260] successful.
Nov 06 13:14:56 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:14:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98b405b9-f2d3-4473-83ac-582fbc9f5641 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:56 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[216d8765-5c4c-43ef-95c9-4b35bc04c0b4]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:14:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:14:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] <== disconnect_volume: return (334ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:14:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:14:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2f6a006e-54ff-43b0-b4ff-f21729858f8e tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Acquiring lock "a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:14:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2f6a006e-54ff-43b0-b4ff-f21729858f8e tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Lock "a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:14:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2f6a006e-54ff-43b0-b4ff-f21729858f8e tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Acquiring lock "a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:14:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2f6a006e-54ff-43b0-b4ff-f21729858f8e tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Lock "a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:14:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2f6a006e-54ff-43b0-b4ff-f21729858f8e tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Lock "a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:14:56 user nova-compute[74821]: INFO nova.compute.manager [None req-2f6a006e-54ff-43b0-b4ff-f21729858f8e tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Terminating instance
Nov 06 13:14:56 user nova-compute[74821]: DEBUG nova.compute.manager [None req-2f6a006e-54ff-43b0-b4ff-f21729858f8e tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:14:56 user nova-compute[74821]: DEBUG nova.compute.manager [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaLCBrKp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'c47906a7-93b9-4527-9318-ed4df54afff6', 'attached_at': '', 'detached_at': '', 'volume_id': '0c31aa69-3a6d-4c9c-a628-a698806b57c2', 'serial'} {{(pid=74821) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 06 13:14:56 user nova-compute[74821]: DEBUG nova.compute.manager [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] swap_volume: removing Cinder connection for volume 98b405b9-f2d3-4473-83ac-582fbc9f5641 {{(pid=74821) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 06 13:14:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:14:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:14:56 user nova-compute[74821]: DEBUG nova.objects.instance [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lazy-loading 'pci_requests' on Instance uuid 5a715806-ff8b-4502-8435-c5de3e3c688a {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:14:56 user nova-compute[74821]: DEBUG nova.objects.instance [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lazy-loading 'numa_topology' on Instance uuid 5a715806-ff8b-4502-8435-c5de3e3c688a {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:14:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:14:56 user nova-compute[74821]: INFO nova.compute.claims [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Claim successful on node user
Nov 06 13:14:57 user nova-compute[74821]: DEBUG nova.compute.manager [req-254d84b2-cd4d-4a63-b5bf-617ffc187fbe req-959f480e-c80a-44aa-b496-a25fa909d0c6 service nova] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Received event network-vif-unplugged-b9f947ae-c1a0-427e-9ef3-a8adc468e94b {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:14:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-254d84b2-cd4d-4a63-b5bf-617ffc187fbe req-959f480e-c80a-44aa-b496-a25fa909d0c6 service nova] Acquiring lock "a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:14:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-254d84b2-cd4d-4a63-b5bf-617ffc187fbe req-959f480e-c80a-44aa-b496-a25fa909d0c6 service nova] Lock "a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:14:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-254d84b2-cd4d-4a63-b5bf-617ffc187fbe req-959f480e-c80a-44aa-b496-a25fa909d0c6 service nova] Lock "a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:14:57 user nova-compute[74821]: DEBUG nova.compute.manager [req-254d84b2-cd4d-4a63-b5bf-617ffc187fbe req-959f480e-c80a-44aa-b496-a25fa909d0c6 service nova] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] No waiting events found dispatching network-vif-unplugged-b9f947ae-c1a0-427e-9ef3-a8adc468e94b {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:14:57 user nova-compute[74821]: DEBUG nova.compute.manager [req-254d84b2-cd4d-4a63-b5bf-617ffc187fbe req-959f480e-c80a-44aa-b496-a25fa909d0c6 service nova] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Received event network-vif-unplugged-b9f947ae-c1a0-427e-9ef3-a8adc468e94b for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:14:57 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Instance destroyed successfully.
Nov 06 13:14:57 user nova-compute[74821]: DEBUG nova.objects.instance [None req-2f6a006e-54ff-43b0-b4ff-f21729858f8e tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Lazy-loading 'resources' on Instance uuid a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:14:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-2f6a006e-54ff-43b0-b4ff-f21729858f8e tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-625931241',display_name='tempest-VolumesActionsTest-instance-625931241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-625931241',id=12,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:12:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d784816c0f14c34afecba6292236040',ramdisk_id='',reservation_id='r-zu3zgz2o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1240738149',owner_user_name='tempest-VolumesActionsTest-1240738149-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:12:55Z,user_data=None,user_id='ee1d041e07fd4b7d8a5fcb864243058c',uuid=a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9f947ae-c1a0-427e-9ef3-a8adc468e94b", "address": "fa:16:3e:b3:97:a3", "network": {"id": "e73a1b38-3c27-4b87-a0f0-f746711d4363", "bridge": "br-int", "label": "tempest-VolumesActionsTest-544363737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d784816c0f14c34afecba6292236040", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9f947ae-c1", "ovs_interfaceid": "b9f947ae-c1a0-427e-9ef3-a8adc468e94b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:14:57 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-2f6a006e-54ff-43b0-b4ff-f21729858f8e tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Converting VIF {"id": "b9f947ae-c1a0-427e-9ef3-a8adc468e94b", "address": "fa:16:3e:b3:97:a3", "network": {"id": "e73a1b38-3c27-4b87-a0f0-f746711d4363", "bridge": "br-int", "label": "tempest-VolumesActionsTest-544363737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d784816c0f14c34afecba6292236040", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9f947ae-c1", "ovs_interfaceid": "b9f947ae-c1a0-427e-9ef3-a8adc468e94b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:14:57 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-2f6a006e-54ff-43b0-b4ff-f21729858f8e tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:97:a3,bridge_name='br-int',has_traffic_filtering=True,id=b9f947ae-c1a0-427e-9ef3-a8adc468e94b,network=Network(e73a1b38-3c27-4b87-a0f0-f746711d4363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9f947ae-c1') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:14:57 user nova-compute[74821]: DEBUG os_vif [None req-2f6a006e-54ff-43b0-b4ff-f21729858f8e tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:97:a3,bridge_name='br-int',has_traffic_filtering=True,id=b9f947ae-c1a0-427e-9ef3-a8adc468e94b,network=Network(e73a1b38-3c27-4b87-a0f0-f746711d4363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9f947ae-c1') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:14:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9f947ae-c1, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:14:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:14:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:14:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aff9fd8f-5e65-470a-853e-57881465b797) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:14:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:14:57 user nova-compute[74821]: INFO os_vif [None req-2f6a006e-54ff-43b0-b4ff-f21729858f8e tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:97:a3,bridge_name='br-int',has_traffic_filtering=True,id=b9f947ae-c1a0-427e-9ef3-a8adc468e94b,network=Network(e73a1b38-3c27-4b87-a0f0-f746711d4363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9f947ae-c1')
Nov 06 13:14:57 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-2f6a006e-54ff-43b0-b4ff-f21729858f8e tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Deleting instance files /opt/stack/data/nova/instances/a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3_del
Nov 06 13:14:57 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-2f6a006e-54ff-43b0-b4ff-f21729858f8e tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Deletion of /opt/stack/data/nova/instances/a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3_del complete
Nov 06 13:14:57 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:14:57 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:14:57 user nova-compute[74821]: INFO nova.compute.manager [None req-2f6a006e-54ff-43b0-b4ff-f21729858f8e tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Took 0.77 seconds to destroy the instance on the hypervisor.
Nov 06 13:14:57 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-2f6a006e-54ff-43b0-b4ff-f21729858f8e tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:14:57 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:14:57 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:14:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.622s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:14:57 user nova-compute[74821]: INFO nova.network.neutron [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Updating port d69de9b4-5366-4d42-b01d-e4ec468a5aa2 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG nova.compute.manager [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:14:58 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Creating image(s)
Nov 06 13:14:58 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Did not create local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Ensure instance console log exists: /opt/stack/data/nova/instances/a33991ce-e911-460d-a6d9-ca738830ef2c/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Start _get_guest_xml network_info=[{"id": "8b30affb-e2f5-4151-8fee-fb7edcaf5ae2", "address": "fa:16:3e:6f:35:3a", "network": {"id": "e3826bc5-7316-4738-b8b1-27551cd142ca", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1941910960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b30affb-e2", "ovs_interfaceid": "8b30affb-e2f5-4151-8fee-fb7edcaf5ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "66a37a87-3aa3-44cb-977f-eef4c8ab4e59", "address": "fa:16:3e:74:5e:90", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a37a87-3a", "ovs_interfaceid": "66a37a87-3aa3-44cb-977f-eef4c8ab4e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd", "address": "fa:16:3e:51:39:be", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa9ef4f-04", "ovs_interfaceid": "6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "03c0a994-073b-4b58-8775-0ce28b2f404d", "address": "fa:16:3e:55:e6:a3", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03c0a994-07", "ovs_interfaceid": "03c0a994-073b-4b58-8775-0ce28b2f404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3d9f17a-c9d8-4aaf-8015-dc9825335a25", "address": "fa:16:3e:e8:a8:6c", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d9f17a-c9", "ovs_interfaceid": "d3d9f17a-c9d8-4aaf-8015-dc9825335a25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f523111f-21f0-49ad-8e55-7515ebcfecff", "address": "fa:16:3e:87:21:4b", "network": {"id": "b92087b6-80a8-444b-8732-c31c6e17d4f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-584352862", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf523111f-21", "ovs_interfaceid": "f523111f-21f0-49ad-8e55-7515ebcfecff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "027b08d1-100c-4dc6-9e51-a435642f25f9", "address": "fa:16:3e:9a:3b:d1", "network": {"id": "b92087b6-80a8-444b-8732-c31c6e17d4f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-584352862", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027b08d1-10", "ovs_interfaceid": "027b08d1-100c-4dc6-9e51-a435642f25f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XxPWnkCZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a33991ce-e911-460d-a6d9-ca738830ef2c', 'attached_at': '', 'detached_at': '', 'volume_id': '5dff38fc-6556-4029-b400-b624265adb89', 'serial': '5dff38fc-6556-4029-b400-b624265adb89'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '97a80344-58b1-4ae7-bbb7-9dd9125a4c5f', 'volume_type': None}, {'guest_format': None, 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oKXGetJh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a33991ce-e911-460d-a6d9-ca738830ef2c', 'attached_at': '', 'detached_at': '', 'volume_id': 'a22edf35-5a12-4d6f-b128-d22ed98a282b', 'serial': 'a22edf35-5a12-4d6f-b128-d22ed98a282b'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '7ecdcf66-53a5-4833-9e99-d123e7c278d9', 'volume_type': None}, {'guest_format': None, 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UAgKsmlj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a33991ce-e911-460d-a6d9-ca738830ef2c', 'attached_at': '', 'detached_at': '', 'volume_id': '424fd083-b856-43b1-8c8f-945fe811aa4e', 'serial': '424fd083-b856-43b1-8c8f-945fe811aa4e'}, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'a83566b7-5b03-435a-bb1a-8cd627d6543d', 'volume_type': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:14:58 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:14:58 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:14:58 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XxPWnkCZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:14:58 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:14:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:14:58 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:14:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:14:58 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:14:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fab6bdd-7831-4e5c-90ba-df7f619d0f54]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:14:58 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[243556dc-9154-476e-9dd7-411cba09800b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89] added
Nov 06 13:14:58 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97903ce-bdef-4fdc-9a7f-52cf5dd0bafd]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[58205143-c1bd-4fed-a775-ab50146c2233]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XxPWnkCZ {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XxPWnkCZ" returned: 0 in 0.076s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d2128a-9583-41d1-aba1-72cc6f7cb7d5]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XxPWnkCZ'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.073s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e8cc3e-d55a-41e0-a74a-a9fa943c6100]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e3c47e-5df0-4aed-9bf5-9cb902824766]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:14:58 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:14:58 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8d7f9a-67bd-4250-8283-9807b1688f64]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89, portal: 172.16.0.220,3260]
Nov 06 13:14:58 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89, portal: 172.16.0.220,3260] successful.
Nov 06 13:14:58 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ae4e6f-db64-4d9f-8020-80b27e464b1b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc427e9-98b8-417a-9523-5246a99c703a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 (non-flash)
Nov 06 13:14:58 user nova-compute[74821]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:14:58 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 (non-flash)
Nov 06 13:14:58 user nova-compute[74821]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:14:58 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.427s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] HCTL ('33', '-', '-', 0) found on session 10 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[addea219-a132-4e9f-b2b4-886e5f59eba5]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XxPWnkCZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:14:58 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:14:59 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Took 1.56 seconds to deallocate network for instance.
Nov 06 13:14:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-f591aa6a-3b31-4941-998a-f20edf9e4bbc req-c7a9ae67-b312-44a1-9c98-d2a52f3c3ba6 service nova] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Received event network-vif-deleted-b9f947ae-c1a0-427e-9ef3-a8adc468e94b {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:14:59 user nova-compute[74821]: INFO nova.compute.manager [req-f591aa6a-3b31-4941-998a-f20edf9e4bbc req-c7a9ae67-b312-44a1-9c98-d2a52f3c3ba6 service nova] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Neutron deleted interface b9f947ae-c1a0-427e-9ef3-a8adc468e94b; detaching it from the instance and deleting it from the info cache
Nov 06 13:14:59 user nova-compute[74821]: DEBUG nova.network.neutron [req-f591aa6a-3b31-4941-998a-f20edf9e4bbc req-c7a9ae67-b312-44a1-9c98-d2a52f3c3ba6 service nova] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:14:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-f591aa6a-3b31-4941-998a-f20edf9e4bbc req-c7a9ae67-b312-44a1-9c98-d2a52f3c3ba6 service nova] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Detach interface failed, port_id=b9f947ae-c1a0-427e-9ef3-a8adc468e94b, reason: Instance a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3 could not be found. {{(pid=74821) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 13:14:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2f6a006e-54ff-43b0-b4ff-f21729858f8e tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:14:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2f6a006e-54ff-43b0-b4ff-f21729858f8e tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:14:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-ee3560b7-e47d-470e-9521-690c483297d0 req-a4572c9a-b7b7-44e4-bd48-f2144b829e38 service nova] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Received event network-vif-plugged-b9f947ae-c1a0-427e-9ef3-a8adc468e94b {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:14:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ee3560b7-e47d-470e-9521-690c483297d0 req-a4572c9a-b7b7-44e4-bd48-f2144b829e38 service nova] Acquiring lock "a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:14:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ee3560b7-e47d-470e-9521-690c483297d0 req-a4572c9a-b7b7-44e4-bd48-f2144b829e38 service nova] Lock "a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:14:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ee3560b7-e47d-470e-9521-690c483297d0 req-a4572c9a-b7b7-44e4-bd48-f2144b829e38 service nova] Lock "a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:14:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-ee3560b7-e47d-470e-9521-690c483297d0 req-a4572c9a-b7b7-44e4-bd48-f2144b829e38 service nova] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] No waiting events found dispatching network-vif-plugged-b9f947ae-c1a0-427e-9ef3-a8adc468e94b {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:14:59 user nova-compute[74821]: WARNING nova.compute.manager [req-ee3560b7-e47d-470e-9521-690c483297d0 req-a4572c9a-b7b7-44e4-bd48-f2144b829e38 service nova] [instance: a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3] Received unexpected event network-vif-plugged-b9f947ae-c1a0-427e-9ef3-a8adc468e94b for instance with vm_state deleted and task_state None.
Nov 06 13:14:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "refresh_cache-5a715806-ff8b-4502-8435-c5de3e3c688a" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:14:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquired lock "refresh_cache-5a715806-ff8b-4502-8435-c5de3e3c688a" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:14:59 user nova-compute[74821]: DEBUG nova.network.neutron [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:14:59 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-2f6a006e-54ff-43b0-b4ff-f21729858f8e tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:14:59 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-2f6a006e-54ff-43b0-b4ff-f21729858f8e tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:14:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2f6a006e-54ff-43b0-b4ff-f21729858f8e tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.486s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:14:59 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-2f6a006e-54ff-43b0-b4ff-f21729858f8e tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Deleted allocations for instance a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3
Nov 06 13:14:59 user nova-compute[74821]: DEBUG nova.network.neutron [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Updating instance_info_cache with network_info: [{"id": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "address": "fa:16:3e:e1:45:18", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69de9b4-53", "ovs_interfaceid": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:14:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2f6a006e-54ff-43b0-b4ff-f21729858f8e tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Lock "a6aedc85-9cf1-4e19-a88a-c0346fb4bdb3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.084s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:14:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Releasing lock "refresh_cache-5a715806-ff8b-4502-8435-c5de3e3c688a" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:14:59 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:14:59 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Creating image(s)
Nov 06 13:14:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:14:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "/opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:14:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "/opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:14:59 user nova-compute[74821]: DEBUG nova.objects.instance [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5a715806-ff8b-4502-8435-c5de3e3c688a {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:14:59 user nova-compute[74821]: DEBUG nova.objects.base [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Object Instance<5a715806-ff8b-4502-8435-c5de3e3c688a> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:14:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "bf5f33f04319e72cbea83e7b9cdf20f81b8100f3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:14:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "bf5f33f04319e72cbea83e7b9cdf20f81b8100f3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:14:59 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.475s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:14:59 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] <== connect_volume: return (1477ms) {'type': 'block', 'scsi_wwn': '23930373535316363', 'path': '/dev/sdb'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:14:59 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930373535316363', 'path': '/dev/sdb'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:15:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf5f33f04319e72cbea83e7b9cdf20f81b8100f3.part --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:00 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:15:00 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oKXGetJh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:15:00 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:15:00 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:15:00 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:15:00 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:15:00 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:15:00 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:15:00 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:15:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:00 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc06317-ced6-4b60-9eee-6a3fbafff54f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:00 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:15:00 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:15:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:00 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1dabf9-d474-4a07-9ecf-fa34c3ef5fcf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:00 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b] added
Nov 06 13:15:00 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:15:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:00 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a8dd2a-45bf-4f8b-8461-55aa45b8c17a]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:00 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:15:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:00 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef107aee-5da4-4cd6-aeaf-173855debc34]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:00 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:15:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oKXGetJh {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oKXGetJh" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:00 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6866cb-015f-4193-9b70-459ee995c183]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:00 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oKXGetJh'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:15:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf5f33f04319e72cbea83e7b9cdf20f81b8100f3.part --force-share --output=json" returned: 0 in 0.211s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:00 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[613c54b7-d7c2-4425-bf8d-a880965fc934]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:00 user nova-compute[74821]: DEBUG nova.virt.images [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] a5275226-a56e-4fd2-bd58-624a723ef01d was qcow2, converting to raw {{(pid=74821) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 13:15:00 user nova-compute[74821]: DEBUG nova.privsep.utils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74821) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 13:15:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bf5f33f04319e72cbea83e7b9cdf20f81b8100f3.part /opt/stack/data/nova/instances/_base/bf5f33f04319e72cbea83e7b9cdf20f81b8100f3.converted {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1667939a-1f8b-444a-8371-b64e1c1c6b88]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 (non-flash)
Nov 06 13:15:01 user nova-compute[74821]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:15:01 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 (non-flash)
Nov 06 13:15:01 user nova-compute[74821]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:15:01 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG nova.compute.manager [req-85e2c98f-eeb0-4fc1-b291-c6e4a087d34d req-4cbbbd0b-809b-4464-bf4c-74e00edf510a service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Received event network-changed-d69de9b4-5366-4d42-b01d-e4ec468a5aa2 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG nova.compute.manager [req-85e2c98f-eeb0-4fc1-b291-c6e4a087d34d req-4cbbbd0b-809b-4464-bf4c-74e00edf510a service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Refreshing instance network info cache due to event network-changed-d69de9b4-5366-4d42-b01d-e4ec468a5aa2. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-85e2c98f-eeb0-4fc1-b291-c6e4a087d34d req-4cbbbd0b-809b-4464-bf4c-74e00edf510a service nova] Acquiring lock "refresh_cache-5a715806-ff8b-4502-8435-c5de3e3c688a" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-85e2c98f-eeb0-4fc1-b291-c6e4a087d34d req-4cbbbd0b-809b-4464-bf4c-74e00edf510a service nova] Acquired lock "refresh_cache-5a715806-ff8b-4502-8435-c5de3e3c688a" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG nova.network.neutron [req-85e2c98f-eeb0-4fc1-b291-c6e4a087d34d req-4cbbbd0b-809b-4464-bf4c-74e00edf510a service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Refreshing network info cache for port d69de9b4-5366-4d42-b01d-e4ec468a5aa2 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e478199-7df0-49d2-ae8d-b9fe5cedf263]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b, portal: 172.16.0.220,3260]
Nov 06 13:15:01 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b, portal: 172.16.0.220,3260] successful.
Nov 06 13:15:01 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2742441-4371-4421-81b0-59da53155d42]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b965d2-a492-40bf-b829-d54a67c59d83]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 (non-flash)
Nov 06 13:15:01 user nova-compute[74821]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b (non-flash)
Nov 06 13:15:01 user nova-compute[74821]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:15:01 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 (non-flash)
Nov 06 13:15:01 user nova-compute[74821]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b (non-flash)
Nov 06 13:15:01 user nova-compute[74821]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:15:01 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] HCTL ('35', '-', '-', 0) found on session 11 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bf5f33f04319e72cbea83e7b9cdf20f81b8100f3.part /opt/stack/data/nova/instances/_base/bf5f33f04319e72cbea83e7b9cdf20f81b8100f3.converted" returned: 0 in 0.227s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf5f33f04319e72cbea83e7b9cdf20f81b8100f3.converted --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[811b57fe-b257-4733-87e2-2ed9e41ce1f6]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Searching for a device in session 11 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oKXGetJh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf5f33f04319e72cbea83e7b9cdf20f81b8100f3.converted --force-share --output=json" returned: 0 in 0.239s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "bf5f33f04319e72cbea83e7b9cdf20f81b8100f3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.678s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf5f33f04319e72cbea83e7b9cdf20f81b8100f3 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG nova.network.neutron [req-85e2c98f-eeb0-4fc1-b291-c6e4a087d34d req-4cbbbd0b-809b-4464-bf4c-74e00edf510a service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Updated VIF entry in instance network info cache for port d69de9b4-5366-4d42-b01d-e4ec468a5aa2. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG nova.network.neutron [req-85e2c98f-eeb0-4fc1-b291-c6e4a087d34d req-4cbbbd0b-809b-4464-bf4c-74e00edf510a service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Updating instance_info_cache with network_info: [{"id": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "address": "fa:16:3e:e1:45:18", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69de9b4-53", "ovs_interfaceid": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-85e2c98f-eeb0-4fc1-b291-c6e4a087d34d req-4cbbbd0b-809b-4464-bf4c-74e00edf510a service nova] Releasing lock "refresh_cache-5a715806-ff8b-4502-8435-c5de3e3c688a" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf5f33f04319e72cbea83e7b9cdf20f81b8100f3 --force-share --output=json" returned: 0 in 0.213s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "bf5f33f04319e72cbea83e7b9cdf20f81b8100f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "bf5f33f04319e72cbea83e7b9cdf20f81b8100f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf5f33f04319e72cbea83e7b9cdf20f81b8100f3 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf5f33f04319e72cbea83e7b9cdf20f81b8100f3 --force-share --output=json" returned: 0 in 0.186s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf5f33f04319e72cbea83e7b9cdf20f81b8100f3,backing_fmt=raw /opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf5f33f04319e72cbea83e7b9cdf20f81b8100f3,backing_fmt=raw /opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/disk 1073741824" returned: 0 in 0.063s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "bf5f33f04319e72cbea83e7b9cdf20f81b8100f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf5f33f04319e72cbea83e7b9cdf20f81b8100f3 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf5f33f04319e72cbea83e7b9cdf20f81b8100f3 --force-share --output=json" returned: 0 in 0.210s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG nova.objects.instance [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lazy-loading 'migration_context' on Instance uuid 5a715806-ff8b-4502-8435-c5de3e3c688a {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG nova.objects.base [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Object Instance<5a715806-ff8b-4502-8435-c5de3e3c688a> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:15:02 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Rebasing disk image.
Nov 06 13:15:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.488s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] <== connect_volume: return (1492ms) {'type': 'block', 'scsi_wwn': '26138613565333664', 'path': '/dev/sdd'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138613565333664', 'path': '/dev/sdd'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.238s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 -F raw /opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/disk {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UAgKsmlj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:15:02 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:15:02 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:15:02 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:15:02 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:15:02 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:15:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a461c760-c0f3-4e19-8a5e-bdf00020162f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:15:02 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e427a6a2-0937-4d67-afb7-13da29f34a25]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e] added
Nov 06 13:15:02 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c5279c-0b82-42e2-807c-bdd8924e7647]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.104s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f647debe-3ebc-4384-816d-693464c903b2]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UAgKsmlj {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UAgKsmlj" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf857f9-be78-448a-b517-fc828322962b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UAgKsmlj'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b42b5a6-6d48-4415-9bef-28c2d0661745]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[df537ede-4933-41b3-8b57-b4464c235d51]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 (non-flash)
Nov 06 13:15:02 user nova-compute[74821]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b (non-flash)
Nov 06 13:15:02 user nova-compute[74821]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:15:02 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 (non-flash)
Nov 06 13:15:02 user nova-compute[74821]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b (non-flash)
Nov 06 13:15:02 user nova-compute[74821]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:15:02 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc1d03f-ee53-47b8-9331-40126251b178]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e, portal: 172.16.0.220,3260]
Nov 06 13:15:02 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e, portal: 172.16.0.220,3260] successful.
Nov 06 13:15:02 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[daebdbdc-261c-4779-b607-e9519861f271]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:15:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca80072-4655-46ed-952c-ddd1b43ae0a5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 (non-flash)
Nov 06 13:15:03 user nova-compute[74821]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b (non-flash)
Nov 06 13:15:03 user nova-compute[74821]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e (non-flash)
Nov 06 13:15:03 user nova-compute[74821]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:15:03 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 (non-flash)
Nov 06 13:15:03 user nova-compute[74821]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b (non-flash)
Nov 06 13:15:03 user nova-compute[74821]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e (non-flash)
Nov 06 13:15:03 user nova-compute[74821]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:15:03 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.447s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] HCTL ('36', '-', '-', 0) found on session 12 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdac62c1-a02a-4bb9-a752-4bb6cad5d0b0]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Searching for a device in session 12 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UAgKsmlj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-47809399-62b2-4072-b06a-730df9d5820b tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Acquiring lock "49d05da1-3222-4f9f-b792-8f3d1f0f2890" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-47809399-62b2-4072-b06a-730df9d5820b tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Lock "49d05da1-3222-4f9f-b792-8f3d1f0f2890" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-47809399-62b2-4072-b06a-730df9d5820b tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Acquiring lock "49d05da1-3222-4f9f-b792-8f3d1f0f2890-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-47809399-62b2-4072-b06a-730df9d5820b tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Lock "49d05da1-3222-4f9f-b792-8f3d1f0f2890-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-47809399-62b2-4072-b06a-730df9d5820b tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Lock "49d05da1-3222-4f9f-b792-8f3d1f0f2890-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:03 user nova-compute[74821]: INFO nova.compute.manager [None req-47809399-62b2-4072-b06a-730df9d5820b tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Terminating instance
Nov 06 13:15:03 user nova-compute[74821]: DEBUG nova.compute.manager [None req-47809399-62b2-4072-b06a-730df9d5820b tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG nova.compute.manager [req-736ebabb-e7ed-464b-ae69-83646f4ba65f req-521e442f-bd93-467d-afa6-0e95440109ff service nova] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Received event network-vif-unplugged-95f3755e-a074-4956-ba1d-5c05945bcff5 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-736ebabb-e7ed-464b-ae69-83646f4ba65f req-521e442f-bd93-467d-afa6-0e95440109ff service nova] Acquiring lock "49d05da1-3222-4f9f-b792-8f3d1f0f2890-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-736ebabb-e7ed-464b-ae69-83646f4ba65f req-521e442f-bd93-467d-afa6-0e95440109ff service nova] Lock "49d05da1-3222-4f9f-b792-8f3d1f0f2890-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-736ebabb-e7ed-464b-ae69-83646f4ba65f req-521e442f-bd93-467d-afa6-0e95440109ff service nova] Lock "49d05da1-3222-4f9f-b792-8f3d1f0f2890-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG nova.compute.manager [req-736ebabb-e7ed-464b-ae69-83646f4ba65f req-521e442f-bd93-467d-afa6-0e95440109ff service nova] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] No waiting events found dispatching network-vif-unplugged-95f3755e-a074-4956-ba1d-5c05945bcff5 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG nova.compute.manager [req-736ebabb-e7ed-464b-ae69-83646f4ba65f req-521e442f-bd93-467d-afa6-0e95440109ff service nova] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Received event network-vif-unplugged-95f3755e-a074-4956-ba1d-5c05945bcff5 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:15:03 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Instance destroyed successfully.
Nov 06 13:15:03 user nova-compute[74821]: DEBUG nova.objects.instance [None req-47809399-62b2-4072-b06a-730df9d5820b tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Lazy-loading 'resources' on Instance uuid 49d05da1-3222-4f9f-b792-8f3d1f0f2890 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-47809399-62b2-4072-b06a-730df9d5820b tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:11:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-44820582',display_name='tempest-VolumesAssistedSnapshotsTest-server-44820582',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-44820582',id=7,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGykxPk1R3HA6WWcirlGAsfFCUETlNBorgDQQCdmarhiY0uUTSQJgGZlpf64teD+FzlPPj+DxqUwuEY3C1tl7Ne9Uap3YNtrlV9iGgYZkoqiH+HjyONcmDq5eU5busLMBA==',key_name='tempest-keypair-1466119120',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:11:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0afa9994148b4f9698f0a9cc7c8d1a5a',ramdisk_id='',reservation_id='r-kg2nfmfx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1134855026',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1134855026-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:11:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45a26f79e64944a196c66276feeb30e8',uuid=49d05da1-3222-4f9f-b792-8f3d1f0f2890,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95f3755e-a074-4956-ba1d-5c05945bcff5", "address": "fa:16:3e:17:16:45", "network": {"id": "feb774a4-8d45-4814-bc23-169b2b378e48", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-639136774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0afa9994148b4f9698f0a9cc7c8d1a5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f3755e-a0", "ovs_interfaceid": "95f3755e-a074-4956-ba1d-5c05945bcff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-47809399-62b2-4072-b06a-730df9d5820b tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Converting VIF {"id": "95f3755e-a074-4956-ba1d-5c05945bcff5", "address": "fa:16:3e:17:16:45", "network": {"id": "feb774a4-8d45-4814-bc23-169b2b378e48", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-639136774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0afa9994148b4f9698f0a9cc7c8d1a5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95f3755e-a0", "ovs_interfaceid": "95f3755e-a074-4956-ba1d-5c05945bcff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-47809399-62b2-4072-b06a-730df9d5820b tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:16:45,bridge_name='br-int',has_traffic_filtering=True,id=95f3755e-a074-4956-ba1d-5c05945bcff5,network=Network(feb774a4-8d45-4814-bc23-169b2b378e48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f3755e-a0') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG os_vif [None req-47809399-62b2-4072-b06a-730df9d5820b tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:16:45,bridge_name='br-int',has_traffic_filtering=True,id=95f3755e-a074-4956-ba1d-5c05945bcff5,network=Network(feb774a4-8d45-4814-bc23-169b2b378e48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f3755e-a0') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95f3755e-a0, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=636a3bb6-bc00-4d37-a857-0825efcf6bf5) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:03 user nova-compute[74821]: INFO os_vif [None req-47809399-62b2-4072-b06a-730df9d5820b tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:16:45,bridge_name='br-int',has_traffic_filtering=True,id=95f3755e-a074-4956-ba1d-5c05945bcff5,network=Network(feb774a4-8d45-4814-bc23-169b2b378e48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95f3755e-a0')
Nov 06 13:15:03 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-47809399-62b2-4072-b06a-730df9d5820b tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Deleting instance files /opt/stack/data/nova/instances/49d05da1-3222-4f9f-b792-8f3d1f0f2890_del
Nov 06 13:15:03 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-47809399-62b2-4072-b06a-730df9d5820b tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Deletion of /opt/stack/data/nova/instances/49d05da1-3222-4f9f-b792-8f3d1f0f2890_del complete
Nov 06 13:15:03 user nova-compute[74821]: INFO nova.compute.manager [None req-47809399-62b2-4072-b06a-730df9d5820b tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 06 13:15:03 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-47809399-62b2-4072-b06a-730df9d5820b tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:15:03 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.496s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] <== connect_volume: return (1500ms) {'type': 'block', 'scsi_wwn': '26661323537633562', 'path': '/dev/sde'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661323537633562', 'path': '/dev/sde'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.compute.manager [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] swap_volume: Updating volume 98b405b9-f2d3-4473-83ac-582fbc9f5641 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "NaLCBrKp", "auth_password": "qmo3z9vMVxg4SE", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "0c31aa69-3a6d-4c9c-a628-a698806b57c2"}, "status": "reserved", "instance": "c47906a7-93b9-4527-9318-ed4df54afff6", "attached_at": "", "detached_at": "", "volume_id": "0c31aa69-3a6d-4c9c-a628-a698806b57c2", "serial": "0c31aa69-3a6d-4c9c-a628-a698806b57c2"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '0c31aa69-3a6d-4c9c-a628-a698806b57c2', 'no_device': None, 'attachment_id': '830f4f47-9fd1-4835-8bcd-ac5e641f25aa'} {{(pid=74821) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:12:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1297022969',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1297022969',id=11,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLP/ji3FuPVI791mpvMNdCzayazy8E548yQX5rI/xbqwI/SkIu1OHU0CVIktacWjY+dJT8FzcO0PTuiUa7nivbZYVA2TTHzX3sUyOkOFTFMBhTPYrB59reXAlb/+yF52pA==',key_name='tempest-keypair-721011422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5313e0306714b299bd860177c36f07f',ramdisk_id='',reservation_id='r-q6i6afm1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-244135857',owner_user_name='tempest-TaggedBootDevicesTest-244135857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:12:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55407d95268147d4a75654afebe43631',uuid=a33991ce-e911-460d-a6d9-ca738830ef2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b30affb-e2f5-4151-8fee-fb7edcaf5ae2", "address": "fa:16:3e:6f:35:3a", "network": {"id": "e3826bc5-7316-4738-b8b1-27551cd142ca", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1941910960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b30affb-e2", "ovs_interfaceid": "8b30affb-e2f5-4151-8fee-fb7edcaf5ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converting VIF {"id": "8b30affb-e2f5-4151-8fee-fb7edcaf5ae2", "address": "fa:16:3e:6f:35:3a", "network": {"id": "e3826bc5-7316-4738-b8b1-27551cd142ca", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1941910960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b30affb-e2", "ovs_interfaceid": "8b30affb-e2f5-4151-8fee-fb7edcaf5ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:35:3a,bridge_name='br-int',has_traffic_filtering=True,id=8b30affb-e2f5-4151-8fee-fb7edcaf5ae2,network=Network(e3826bc5-7316-4738-b8b1-27551cd142ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b30affb-e2') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:12:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1297022969',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1297022969',id=11,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLP/ji3FuPVI791mpvMNdCzayazy8E548yQX5rI/xbqwI/SkIu1OHU0CVIktacWjY+dJT8FzcO0PTuiUa7nivbZYVA2TTHzX3sUyOkOFTFMBhTPYrB59reXAlb/+yF52pA==',key_name='tempest-keypair-721011422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5313e0306714b299bd860177c36f07f',ramdisk_id='',reservation_id='r-q6i6afm1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-244135857',owner_user_name='tempest-TaggedBootDevicesTest-244135857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:12:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55407d95268147d4a75654afebe43631',uuid=a33991ce-e911-460d-a6d9-ca738830ef2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66a37a87-3aa3-44cb-977f-eef4c8ab4e59", "address": "fa:16:3e:74:5e:90", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a37a87-3a", "ovs_interfaceid": "66a37a87-3aa3-44cb-977f-eef4c8ab4e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converting VIF {"id": "66a37a87-3aa3-44cb-977f-eef4c8ab4e59", "address": "fa:16:3e:74:5e:90", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a37a87-3a", "ovs_interfaceid": "66a37a87-3aa3-44cb-977f-eef4c8ab4e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:5e:90,bridge_name='br-int',has_traffic_filtering=True,id=66a37a87-3aa3-44cb-977f-eef4c8ab4e59,network=Network(ae5d06b7-0ae1-411c-8f84-b2145c78f042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap66a37a87-3a') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:12:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1297022969',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1297022969',id=11,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLP/ji3FuPVI791mpvMNdCzayazy8E548yQX5rI/xbqwI/SkIu1OHU0CVIktacWjY+dJT8FzcO0PTuiUa7nivbZYVA2TTHzX3sUyOkOFTFMBhTPYrB59reXAlb/+yF52pA==',key_name='tempest-keypair-721011422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5313e0306714b299bd860177c36f07f',ramdisk_id='',reservation_id='r-q6i6afm1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-244135857',owner_user_name='tempest-TaggedBootDevicesTest-244135857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:12:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55407d95268147d4a75654afebe43631',uuid=a33991ce-e911-460d-a6d9-ca738830ef2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd", "address": "fa:16:3e:51:39:be", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa9ef4f-04", "ovs_interfaceid": "6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converting VIF {"id": "6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd", "address": "fa:16:3e:51:39:be", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa9ef4f-04", "ovs_interfaceid": "6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:39:be,bridge_name='br-int',has_traffic_filtering=True,id=6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd,network=Network(ae5d06b7-0ae1-411c-8f84-b2145c78f042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6aa9ef4f-04') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:12:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1297022969',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1297022969',id=11,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLP/ji3FuPVI791mpvMNdCzayazy8E548yQX5rI/xbqwI/SkIu1OHU0CVIktacWjY+dJT8FzcO0PTuiUa7nivbZYVA2TTHzX3sUyOkOFTFMBhTPYrB59reXAlb/+yF52pA==',key_name='tempest-keypair-721011422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5313e0306714b299bd860177c36f07f',ramdisk_id='',reservation_id='r-q6i6afm1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-244135857',owner_user_name='tempest-TaggedBootDevicesTest-244135857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:12:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55407d95268147d4a75654afebe43631',uuid=a33991ce-e911-460d-a6d9-ca738830ef2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03c0a994-073b-4b58-8775-0ce28b2f404d", "address": "fa:16:3e:55:e6:a3", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03c0a994-07", "ovs_interfaceid": "03c0a994-073b-4b58-8775-0ce28b2f404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converting VIF {"id": "03c0a994-073b-4b58-8775-0ce28b2f404d", "address": "fa:16:3e:55:e6:a3", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03c0a994-07", "ovs_interfaceid": "03c0a994-073b-4b58-8775-0ce28b2f404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:e6:a3,bridge_name='br-int',has_traffic_filtering=True,id=03c0a994-073b-4b58-8775-0ce28b2f404d,network=Network(ae5d06b7-0ae1-411c-8f84-b2145c78f042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03c0a994-07') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:12:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1297022969',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1297022969',id=11,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLP/ji3FuPVI791mpvMNdCzayazy8E548yQX5rI/xbqwI/SkIu1OHU0CVIktacWjY+dJT8FzcO0PTuiUa7nivbZYVA2TTHzX3sUyOkOFTFMBhTPYrB59reXAlb/+yF52pA==',key_name='tempest-keypair-721011422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5313e0306714b299bd860177c36f07f',ramdisk_id='',reservation_id='r-q6i6afm1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-244135857',owner_user_name='tempest-TaggedBootDevicesTest-244135857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:12:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55407d95268147d4a75654afebe43631',uuid=a33991ce-e911-460d-a6d9-ca738830ef2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3d9f17a-c9d8-4aaf-8015-dc9825335a25", "address": "fa:16:3e:e8:a8:6c", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d9f17a-c9", "ovs_interfaceid": "d3d9f17a-c9d8-4aaf-8015-dc9825335a25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converting VIF {"id": "d3d9f17a-c9d8-4aaf-8015-dc9825335a25", "address": "fa:16:3e:e8:a8:6c", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d9f17a-c9", "ovs_interfaceid": "d3d9f17a-c9d8-4aaf-8015-dc9825335a25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:a8:6c,bridge_name='br-int',has_traffic_filtering=True,id=d3d9f17a-c9d8-4aaf-8015-dc9825335a25,network=Network(ae5d06b7-0ae1-411c-8f84-b2145c78f042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d9f17a-c9') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:12:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1297022969',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1297022969',id=11,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLP/ji3FuPVI791mpvMNdCzayazy8E548yQX5rI/xbqwI/SkIu1OHU0CVIktacWjY+dJT8FzcO0PTuiUa7nivbZYVA2TTHzX3sUyOkOFTFMBhTPYrB59reXAlb/+yF52pA==',key_name='tempest-keypair-721011422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5313e0306714b299bd860177c36f07f',ramdisk_id='',reservation_id='r-q6i6afm1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-244135857',owner_user_name='tempest-TaggedBootDevicesTest-244135857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:12:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55407d95268147d4a75654afebe43631',uuid=a33991ce-e911-460d-a6d9-ca738830ef2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f523111f-21f0-49ad-8e55-7515ebcfecff", "address": "fa:16:3e:87:21:4b", "network": {"id": "b92087b6-80a8-444b-8732-c31c6e17d4f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-584352862", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf523111f-21", "ovs_interfaceid": "f523111f-21f0-49ad-8e55-7515ebcfecff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converting VIF {"id": "f523111f-21f0-49ad-8e55-7515ebcfecff", "address": "fa:16:3e:87:21:4b", "network": {"id": "b92087b6-80a8-444b-8732-c31c6e17d4f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-584352862", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf523111f-21", "ovs_interfaceid": "f523111f-21f0-49ad-8e55-7515ebcfecff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:21:4b,bridge_name='br-int',has_traffic_filtering=True,id=f523111f-21f0-49ad-8e55-7515ebcfecff,network=Network(b92087b6-80a8-444b-8732-c31c6e17d4f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf523111f-21') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:12:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1297022969',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1297022969',id=11,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLP/ji3FuPVI791mpvMNdCzayazy8E548yQX5rI/xbqwI/SkIu1OHU0CVIktacWjY+dJT8FzcO0PTuiUa7nivbZYVA2TTHzX3sUyOkOFTFMBhTPYrB59reXAlb/+yF52pA==',key_name='tempest-keypair-721011422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5313e0306714b299bd860177c36f07f',ramdisk_id='',reservation_id='r-q6i6afm1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-244135857',owner_user_name='tempest-TaggedBootDevicesTest-244135857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:12:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55407d95268147d4a75654afebe43631',uuid=a33991ce-e911-460d-a6d9-ca738830ef2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "027b08d1-100c-4dc6-9e51-a435642f25f9", "address": "fa:16:3e:9a:3b:d1", "network": {"id": "b92087b6-80a8-444b-8732-c31c6e17d4f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-584352862", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027b08d1-10", "ovs_interfaceid": "027b08d1-100c-4dc6-9e51-a435642f25f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converting VIF {"id": "027b08d1-100c-4dc6-9e51-a435642f25f9", "address": "fa:16:3e:9a:3b:d1", "network": {"id": "b92087b6-80a8-444b-8732-c31c6e17d4f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-584352862", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027b08d1-10", "ovs_interfaceid": "027b08d1-100c-4dc6-9e51-a435642f25f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:3b:d1,bridge_name='br-int',has_traffic_filtering=True,id=027b08d1-100c-4dc6-9e51-a435642f25f9,network=Network(b92087b6-80a8-444b-8732-c31c6e17d4f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027b08d1-10') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.objects.instance [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Lazy-loading 'pci_devices' on Instance uuid a33991ce-e911-460d-a6d9-ca738830ef2c {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9596632a-9d43-4565-8f00-d819aca3f8ae tempest-TestVolumeSwap-122601286 tempest-TestVolumeSwap-122601286-project-admin] Lock "c47906a7-93b9-4527-9318-ed4df54afff6" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 39.085s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:15:04 user nova-compute[74821]:   <uuid>a33991ce-e911-460d-a6d9-ca738830ef2c</uuid>
Nov 06 13:15:04 user nova-compute[74821]:   <name>instance-0000000b</name>
Nov 06 13:15:04 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:15:04 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:15:04 user nova-compute[74821]:   <metadata>
Nov 06 13:15:04 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:15:04 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:15:04 user nova-compute[74821]:       <nova:name>tempest-device-tagging-server-1297022969</nova:name>
Nov 06 13:15:04 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:14:58</nova:creationTime>
Nov 06 13:15:04 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:15:04 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:15:04 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:15:04 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:15:04 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:15:04 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:15:04 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:15:04 user nova-compute[74821]:       <nova:owner>
Nov 06 13:15:04 user nova-compute[74821]:         <nova:user uuid="55407d95268147d4a75654afebe43631">tempest-TaggedBootDevicesTest-244135857-project-member</nova:user>
Nov 06 13:15:04 user nova-compute[74821]:         <nova:project uuid="b5313e0306714b299bd860177c36f07f">tempest-TaggedBootDevicesTest-244135857</nova:project>
Nov 06 13:15:04 user nova-compute[74821]:       </nova:owner>
Nov 06 13:15:04 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:15:04 user nova-compute[74821]:       <nova:ports>
Nov 06 13:15:04 user nova-compute[74821]:         <nova:port uuid="8b30affb-e2f5-4151-8fee-fb7edcaf5ae2">
Nov 06 13:15:04 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 06 13:15:04 user nova-compute[74821]:         </nova:port>
Nov 06 13:15:04 user nova-compute[74821]:         <nova:port uuid="66a37a87-3aa3-44cb-977f-eef4c8ab4e59">
Nov 06 13:15:04 user nova-compute[74821]:           <nova:ip type="fixed" address="10.1.1.73" ipVersion="4"/>
Nov 06 13:15:04 user nova-compute[74821]:         </nova:port>
Nov 06 13:15:04 user nova-compute[74821]:         <nova:port uuid="6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd">
Nov 06 13:15:04 user nova-compute[74821]:           <nova:ip type="fixed" address="10.1.1.47" ipVersion="4"/>
Nov 06 13:15:04 user nova-compute[74821]:         </nova:port>
Nov 06 13:15:04 user nova-compute[74821]:         <nova:port uuid="03c0a994-073b-4b58-8775-0ce28b2f404d">
Nov 06 13:15:04 user nova-compute[74821]:           <nova:ip type="fixed" address="10.1.1.171" ipVersion="4"/>
Nov 06 13:15:04 user nova-compute[74821]:         </nova:port>
Nov 06 13:15:04 user nova-compute[74821]:         <nova:port uuid="d3d9f17a-c9d8-4aaf-8015-dc9825335a25">
Nov 06 13:15:04 user nova-compute[74821]:           <nova:ip type="fixed" address="10.1.1.214" ipVersion="4"/>
Nov 06 13:15:04 user nova-compute[74821]:         </nova:port>
Nov 06 13:15:04 user nova-compute[74821]:         <nova:port uuid="f523111f-21f0-49ad-8e55-7515ebcfecff">
Nov 06 13:15:04 user nova-compute[74821]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 06 13:15:04 user nova-compute[74821]:         </nova:port>
Nov 06 13:15:04 user nova-compute[74821]:         <nova:port uuid="027b08d1-100c-4dc6-9e51-a435642f25f9">
Nov 06 13:15:04 user nova-compute[74821]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 06 13:15:04 user nova-compute[74821]:         </nova:port>
Nov 06 13:15:04 user nova-compute[74821]:       </nova:ports>
Nov 06 13:15:04 user nova-compute[74821]:     </nova:instance>
Nov 06 13:15:04 user nova-compute[74821]:   </metadata>
Nov 06 13:15:04 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:15:04 user nova-compute[74821]:     <system>
Nov 06 13:15:04 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:15:04 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:15:04 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:15:04 user nova-compute[74821]:       <entry name="serial">a33991ce-e911-460d-a6d9-ca738830ef2c</entry>
Nov 06 13:15:04 user nova-compute[74821]:       <entry name="uuid">a33991ce-e911-460d-a6d9-ca738830ef2c</entry>
Nov 06 13:15:04 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:15:04 user nova-compute[74821]:     </system>
Nov 06 13:15:04 user nova-compute[74821]:   </sysinfo>
Nov 06 13:15:04 user nova-compute[74821]:   <os>
Nov 06 13:15:04 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:15:04 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:15:04 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:15:04 user nova-compute[74821]:   </os>
Nov 06 13:15:04 user nova-compute[74821]:   <features>
Nov 06 13:15:04 user nova-compute[74821]:     <acpi/>
Nov 06 13:15:04 user nova-compute[74821]:     <apic/>
Nov 06 13:15:04 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:15:04 user nova-compute[74821]:   </features>
Nov 06 13:15:04 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:15:04 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:15:04 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:15:04 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:15:04 user nova-compute[74821]:   </clock>
Nov 06 13:15:04 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:15:04 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:15:04 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:15:04 user nova-compute[74821]:   </cpu>
Nov 06 13:15:04 user nova-compute[74821]:   <devices>
Nov 06 13:15:04 user nova-compute[74821]:     <disk type="file" device="cdrom">
Nov 06 13:15:04 user nova-compute[74821]:       <driver name="qemu" type="raw" cache="none"/>
Nov 06 13:15:04 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/a33991ce-e911-460d-a6d9-ca738830ef2c/disk.config"/>
Nov 06 13:15:04 user nova-compute[74821]:       <target dev="hda" bus="ide"/>
Nov 06 13:15:04 user nova-compute[74821]:     </disk>
Nov 06 13:15:04 user nova-compute[74821]:     <disk type="block" device="disk">
Nov 06 13:15:04 user nova-compute[74821]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:15:04 user nova-compute[74821]:       <source dev="/dev/sdb"/>
Nov 06 13:15:04 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:15:04 user nova-compute[74821]:       <serial>5dff38fc-6556-4029-b400-b624265adb89</serial>
Nov 06 13:15:04 user nova-compute[74821]:     </disk>
Nov 06 13:15:04 user nova-compute[74821]:     <disk type="block" device="disk">
Nov 06 13:15:04 user nova-compute[74821]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:15:04 user nova-compute[74821]:       <source dev="/dev/sdd"/>
Nov 06 13:15:04 user nova-compute[74821]:       <target dev="vdb" bus="virtio"/>
Nov 06 13:15:04 user nova-compute[74821]:       <serial>a22edf35-5a12-4d6f-b128-d22ed98a282b</serial>
Nov 06 13:15:04 user nova-compute[74821]:     </disk>
Nov 06 13:15:04 user nova-compute[74821]:     <disk type="block" device="disk">
Nov 06 13:15:04 user nova-compute[74821]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:15:04 user nova-compute[74821]:       <source dev="/dev/sde"/>
Nov 06 13:15:04 user nova-compute[74821]:       <target dev="vdc" bus="virtio"/>
Nov 06 13:15:04 user nova-compute[74821]:       <serial>424fd083-b856-43b1-8c8f-945fe811aa4e</serial>
Nov 06 13:15:04 user nova-compute[74821]:     </disk>
Nov 06 13:15:04 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:15:04 user nova-compute[74821]:       <mac address="fa:16:3e:6f:35:3a"/>
Nov 06 13:15:04 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:15:04 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:15:04 user nova-compute[74821]:       <target dev="tap8b30affb-e2"/>
Nov 06 13:15:04 user nova-compute[74821]:     </interface>
Nov 06 13:15:04 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:15:04 user nova-compute[74821]:       <mac address="fa:16:3e:74:5e:90"/>
Nov 06 13:15:04 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:15:04 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:15:04 user nova-compute[74821]:       <target dev="tap66a37a87-3a"/>
Nov 06 13:15:04 user nova-compute[74821]:     </interface>
Nov 06 13:15:04 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:15:04 user nova-compute[74821]:       <mac address="fa:16:3e:51:39:be"/>
Nov 06 13:15:04 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:15:04 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:15:04 user nova-compute[74821]:       <target dev="tap6aa9ef4f-04"/>
Nov 06 13:15:04 user nova-compute[74821]:     </interface>
Nov 06 13:15:04 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:15:04 user nova-compute[74821]:       <mac address="fa:16:3e:55:e6:a3"/>
Nov 06 13:15:04 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:15:04 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:15:04 user nova-compute[74821]:       <target dev="tap03c0a994-07"/>
Nov 06 13:15:04 user nova-compute[74821]:     </interface>
Nov 06 13:15:04 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:15:04 user nova-compute[74821]:       <mac address="fa:16:3e:e8:a8:6c"/>
Nov 06 13:15:04 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:15:04 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:15:04 user nova-compute[74821]:       <target dev="tapd3d9f17a-c9"/>
Nov 06 13:15:04 user nova-compute[74821]:     </interface>
Nov 06 13:15:04 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:15:04 user nova-compute[74821]:       <mac address="fa:16:3e:87:21:4b"/>
Nov 06 13:15:04 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:15:04 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:15:04 user nova-compute[74821]:       <target dev="tapf523111f-21"/>
Nov 06 13:15:04 user nova-compute[74821]:     </interface>
Nov 06 13:15:04 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:15:04 user nova-compute[74821]:       <mac address="fa:16:3e:9a:3b:d1"/>
Nov 06 13:15:04 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:15:04 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:15:04 user nova-compute[74821]:       <target dev="tap027b08d1-10"/>
Nov 06 13:15:04 user nova-compute[74821]:     </interface>
Nov 06 13:15:04 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:15:04 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/a33991ce-e911-460d-a6d9-ca738830ef2c/console.log" append="off"/>
Nov 06 13:15:04 user nova-compute[74821]:     </serial>
Nov 06 13:15:04 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:15:04 user nova-compute[74821]:     <video>
Nov 06 13:15:04 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:15:04 user nova-compute[74821]:     </video>
Nov 06 13:15:04 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:15:04 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:15:04 user nova-compute[74821]:     </rng>
Nov 06 13:15:04 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:15:04 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:15:04 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:15:04 user nova-compute[74821]:     </memballoon>
Nov 06 13:15:04 user nova-compute[74821]:   </devices>
Nov 06 13:15:04 user nova-compute[74821]: </domain>
Nov 06 13:15:04 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:12:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1297022969',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1297022969',id=11,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLP/ji3FuPVI791mpvMNdCzayazy8E548yQX5rI/xbqwI/SkIu1OHU0CVIktacWjY+dJT8FzcO0PTuiUa7nivbZYVA2TTHzX3sUyOkOFTFMBhTPYrB59reXAlb/+yF52pA==',key_name='tempest-keypair-721011422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5313e0306714b299bd860177c36f07f',ramdisk_id='',reservation_id='r-q6i6afm1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-244135857',owner_user_name='tempest-TaggedBootDevicesTest-244135857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:12:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55407d95268147d4a75654afebe43631',uuid=a33991ce-e911-460d-a6d9-ca738830ef2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b30affb-e2f5-4151-8fee-fb7edcaf5ae2", "address": "fa:16:3e:6f:35:3a", "network": {"id": "e3826bc5-7316-4738-b8b1-27551cd142ca", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1941910960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b30affb-e2", "ovs_interfaceid": "8b30affb-e2f5-4151-8fee-fb7edcaf5ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converting VIF {"id": "8b30affb-e2f5-4151-8fee-fb7edcaf5ae2", "address": "fa:16:3e:6f:35:3a", "network": {"id": "e3826bc5-7316-4738-b8b1-27551cd142ca", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1941910960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b30affb-e2", "ovs_interfaceid": "8b30affb-e2f5-4151-8fee-fb7edcaf5ae2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:35:3a,bridge_name='br-int',has_traffic_filtering=True,id=8b30affb-e2f5-4151-8fee-fb7edcaf5ae2,network=Network(e3826bc5-7316-4738-b8b1-27551cd142ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b30affb-e2') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG os_vif [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:35:3a,bridge_name='br-int',has_traffic_filtering=True,id=8b30affb-e2f5-4151-8fee-fb7edcaf5ae2,network=Network(e3826bc5-7316-4738-b8b1-27551cd142ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b30affb-e2') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c6534d35-1a27-51c0-bbdb-a7ce6acaa7a2', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b30affb-e2, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b30affb-e2, col_values=(('qos', UUID('2e105baa-1ef0-4387-ae0b-c88779c1983d')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b30affb-e2, col_values=(('external_ids', {'iface-id': '8b30affb-e2f5-4151-8fee-fb7edcaf5ae2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:35:3a', 'vm-uuid': 'a33991ce-e911-460d-a6d9-ca738830ef2c'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: INFO os_vif [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:35:3a,bridge_name='br-int',has_traffic_filtering=True,id=8b30affb-e2f5-4151-8fee-fb7edcaf5ae2,network=Network(e3826bc5-7316-4738-b8b1-27551cd142ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b30affb-e2')
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:12:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1297022969',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1297022969',id=11,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLP/ji3FuPVI791mpvMNdCzayazy8E548yQX5rI/xbqwI/SkIu1OHU0CVIktacWjY+dJT8FzcO0PTuiUa7nivbZYVA2TTHzX3sUyOkOFTFMBhTPYrB59reXAlb/+yF52pA==',key_name='tempest-keypair-721011422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5313e0306714b299bd860177c36f07f',ramdisk_id='',reservation_id='r-q6i6afm1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-244135857',owner_user_name='tempest-TaggedBootDevicesTest-244135857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:12:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55407d95268147d4a75654afebe43631',uuid=a33991ce-e911-460d-a6d9-ca738830ef2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66a37a87-3aa3-44cb-977f-eef4c8ab4e59", "address": "fa:16:3e:74:5e:90", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a37a87-3a", "ovs_interfaceid": "66a37a87-3aa3-44cb-977f-eef4c8ab4e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converting VIF {"id": "66a37a87-3aa3-44cb-977f-eef4c8ab4e59", "address": "fa:16:3e:74:5e:90", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a37a87-3a", "ovs_interfaceid": "66a37a87-3aa3-44cb-977f-eef4c8ab4e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:5e:90,bridge_name='br-int',has_traffic_filtering=True,id=66a37a87-3aa3-44cb-977f-eef4c8ab4e59,network=Network(ae5d06b7-0ae1-411c-8f84-b2145c78f042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap66a37a87-3a') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG os_vif [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:5e:90,bridge_name='br-int',has_traffic_filtering=True,id=66a37a87-3aa3-44cb-977f-eef4c8ab4e59,network=Network(ae5d06b7-0ae1-411c-8f84-b2145c78f042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap66a37a87-3a') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b227ab57-1314-5988-b8f4-296cb60b2aaf', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66a37a87-3a, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap66a37a87-3a, col_values=(('qos', UUID('c287b489-06d0-42ef-8010-0c6b738bea32')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap66a37a87-3a, col_values=(('external_ids', {'iface-id': '66a37a87-3aa3-44cb-977f-eef4c8ab4e59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:5e:90', 'vm-uuid': 'a33991ce-e911-460d-a6d9-ca738830ef2c'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: INFO os_vif [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:5e:90,bridge_name='br-int',has_traffic_filtering=True,id=66a37a87-3aa3-44cb-977f-eef4c8ab4e59,network=Network(ae5d06b7-0ae1-411c-8f84-b2145c78f042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap66a37a87-3a')
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:12:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1297022969',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1297022969',id=11,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLP/ji3FuPVI791mpvMNdCzayazy8E548yQX5rI/xbqwI/SkIu1OHU0CVIktacWjY+dJT8FzcO0PTuiUa7nivbZYVA2TTHzX3sUyOkOFTFMBhTPYrB59reXAlb/+yF52pA==',key_name='tempest-keypair-721011422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5313e0306714b299bd860177c36f07f',ramdisk_id='',reservation_id='r-q6i6afm1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-244135857',owner_user_name='tempest-TaggedBootDevicesTest-244135857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:12:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55407d95268147d4a75654afebe43631',uuid=a33991ce-e911-460d-a6d9-ca738830ef2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd", "address": "fa:16:3e:51:39:be", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa9ef4f-04", "ovs_interfaceid": "6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converting VIF {"id": "6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd", "address": "fa:16:3e:51:39:be", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa9ef4f-04", "ovs_interfaceid": "6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:39:be,bridge_name='br-int',has_traffic_filtering=True,id=6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd,network=Network(ae5d06b7-0ae1-411c-8f84-b2145c78f042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6aa9ef4f-04') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG os_vif [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:39:be,bridge_name='br-int',has_traffic_filtering=True,id=6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd,network=Network(ae5d06b7-0ae1-411c-8f84-b2145c78f042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6aa9ef4f-04') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6ebf8fb2-c0c7-5d81-97bf-c82c1e7de951', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6aa9ef4f-04, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6aa9ef4f-04, col_values=(('qos', UUID('2a29c24d-8591-46e1-845e-9292630e87ca')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6aa9ef4f-04, col_values=(('external_ids', {'iface-id': '6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:39:be', 'vm-uuid': 'a33991ce-e911-460d-a6d9-ca738830ef2c'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: INFO os_vif [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:39:be,bridge_name='br-int',has_traffic_filtering=True,id=6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd,network=Network(ae5d06b7-0ae1-411c-8f84-b2145c78f042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6aa9ef4f-04')
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:12:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1297022969',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1297022969',id=11,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLP/ji3FuPVI791mpvMNdCzayazy8E548yQX5rI/xbqwI/SkIu1OHU0CVIktacWjY+dJT8FzcO0PTuiUa7nivbZYVA2TTHzX3sUyOkOFTFMBhTPYrB59reXAlb/+yF52pA==',key_name='tempest-keypair-721011422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5313e0306714b299bd860177c36f07f',ramdisk_id='',reservation_id='r-q6i6afm1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-244135857',owner_user_name='tempest-TaggedBootDevicesTest-244135857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:12:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55407d95268147d4a75654afebe43631',uuid=a33991ce-e911-460d-a6d9-ca738830ef2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03c0a994-073b-4b58-8775-0ce28b2f404d", "address": "fa:16:3e:55:e6:a3", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03c0a994-07", "ovs_interfaceid": "03c0a994-073b-4b58-8775-0ce28b2f404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converting VIF {"id": "03c0a994-073b-4b58-8775-0ce28b2f404d", "address": "fa:16:3e:55:e6:a3", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03c0a994-07", "ovs_interfaceid": "03c0a994-073b-4b58-8775-0ce28b2f404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:e6:a3,bridge_name='br-int',has_traffic_filtering=True,id=03c0a994-073b-4b58-8775-0ce28b2f404d,network=Network(ae5d06b7-0ae1-411c-8f84-b2145c78f042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03c0a994-07') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG os_vif [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:e6:a3,bridge_name='br-int',has_traffic_filtering=True,id=03c0a994-073b-4b58-8775-0ce28b2f404d,network=Network(ae5d06b7-0ae1-411c-8f84-b2145c78f042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03c0a994-07') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '198a4758-17fd-5976-b7a0-d19a912e4308', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03c0a994-07, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap03c0a994-07, col_values=(('qos', UUID('8ad87b25-dccf-425a-bd18-5370ff9ccc40')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap03c0a994-07, col_values=(('external_ids', {'iface-id': '03c0a994-073b-4b58-8775-0ce28b2f404d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:e6:a3', 'vm-uuid': 'a33991ce-e911-460d-a6d9-ca738830ef2c'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.volume.cinder [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Update attachment failed for attachment 0aaeaf4b-c6c8-4463-b08f-ad0731867014. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-98194ea1-5d5c-451a-ae88-c66d42e6e014) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-98194ea1-5d5c-451a-ae88-c66d42e6e014)
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: INFO os_vif [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:e6:a3,bridge_name='br-int',has_traffic_filtering=True,id=03c0a994-073b-4b58-8775-0ce28b2f404d,network=Network(ae5d06b7-0ae1-411c-8f84-b2145c78f042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03c0a994-07')
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:12:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1297022969',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1297022969',id=11,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLP/ji3FuPVI791mpvMNdCzayazy8E548yQX5rI/xbqwI/SkIu1OHU0CVIktacWjY+dJT8FzcO0PTuiUa7nivbZYVA2TTHzX3sUyOkOFTFMBhTPYrB59reXAlb/+yF52pA==',key_name='tempest-keypair-721011422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5313e0306714b299bd860177c36f07f',ramdisk_id='',reservation_id='r-q6i6afm1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-244135857',owner_user_name='tempest-TaggedBootDevicesTest-244135857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:12:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55407d95268147d4a75654afebe43631',uuid=a33991ce-e911-460d-a6d9-ca738830ef2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3d9f17a-c9d8-4aaf-8015-dc9825335a25", "address": "fa:16:3e:e8:a8:6c", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d9f17a-c9", "ovs_interfaceid": "d3d9f17a-c9d8-4aaf-8015-dc9825335a25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converting VIF {"id": "d3d9f17a-c9d8-4aaf-8015-dc9825335a25", "address": "fa:16:3e:e8:a8:6c", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d9f17a-c9", "ovs_interfaceid": "d3d9f17a-c9d8-4aaf-8015-dc9825335a25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:a8:6c,bridge_name='br-int',has_traffic_filtering=True,id=d3d9f17a-c9d8-4aaf-8015-dc9825335a25,network=Network(ae5d06b7-0ae1-411c-8f84-b2145c78f042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d9f17a-c9') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG os_vif [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:a8:6c,bridge_name='br-int',has_traffic_filtering=True,id=d3d9f17a-c9d8-4aaf-8015-dc9825335a25,network=Network(ae5d06b7-0ae1-411c-8f84-b2145c78f042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d9f17a-c9') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '19a53d9a-bfa3-5663-8fad-0162d91ca34f', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-98194ea1-5d5c-451a-ae88-c66d42e6e014)
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Traceback (most recent call last):
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/nova/nova/compute/manager.py", line 4132, in _do_rebuild_instance
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     self.driver.rebuild(**kwargs)
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     raise NotImplementedError()
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] NotImplementedError
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] 
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] During handling of the above exception, another exception occurred:
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] 
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Traceback (most recent call last):
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     driver_block_device.attach_block_devices(
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     _log_and_attach(device)
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     bdm.attach(*attach_args, **attach_kwargs)
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     ret_val = method(obj, context, *args, **kwargs)
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     self._do_attach(context, instance, volume, volume_api,
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     self._volume_attach(context, volume, connector, instance,
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     connection_info = volume_api.attachment_update(
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     res = method(self, ctx, *args, **kwargs)
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     with excutils.save_and_reraise_exception():
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     self.force_reraise()
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     raise self.value
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     context, '3.44', skip_version_check=True).attachments.update(
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     return method.func(obj, *args, **kwargs)
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     resp = self._update('/attachments/%s' % id, body)
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     return self._cs_request(url, 'PUT', **kwargs)
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     return self.request(url, method, **kwargs)
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     raise exceptions.from_response(resp, body)
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-98194ea1-5d5c-451a-ae88-c66d42e6e014)
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] 
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3d9f17a-c9, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd3d9f17a-c9, col_values=(('qos', UUID('290bd458-6b4e-4f4d-a064-f2bd9f66b758')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd3d9f17a-c9, col_values=(('external_ids', {'iface-id': 'd3d9f17a-c9d8-4aaf-8015-dc9825335a25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:a8:6c', 'vm-uuid': 'a33991ce-e911-460d-a6d9-ca738830ef2c'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: INFO os_vif [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:a8:6c,bridge_name='br-int',has_traffic_filtering=True,id=d3d9f17a-c9d8-4aaf-8015-dc9825335a25,network=Network(ae5d06b7-0ae1-411c-8f84-b2145c78f042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d9f17a-c9')
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:12:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1297022969',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1297022969',id=11,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLP/ji3FuPVI791mpvMNdCzayazy8E548yQX5rI/xbqwI/SkIu1OHU0CVIktacWjY+dJT8FzcO0PTuiUa7nivbZYVA2TTHzX3sUyOkOFTFMBhTPYrB59reXAlb/+yF52pA==',key_name='tempest-keypair-721011422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5313e0306714b299bd860177c36f07f',ramdisk_id='',reservation_id='r-q6i6afm1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-244135857',owner_user_name='tempest-TaggedBootDevicesTest-244135857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:12:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55407d95268147d4a75654afebe43631',uuid=a33991ce-e911-460d-a6d9-ca738830ef2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f523111f-21f0-49ad-8e55-7515ebcfecff", "address": "fa:16:3e:87:21:4b", "network": {"id": "b92087b6-80a8-444b-8732-c31c6e17d4f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-584352862", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf523111f-21", "ovs_interfaceid": "f523111f-21f0-49ad-8e55-7515ebcfecff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converting VIF {"id": "f523111f-21f0-49ad-8e55-7515ebcfecff", "address": "fa:16:3e:87:21:4b", "network": {"id": "b92087b6-80a8-444b-8732-c31c6e17d4f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-584352862", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf523111f-21", "ovs_interfaceid": "f523111f-21f0-49ad-8e55-7515ebcfecff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:21:4b,bridge_name='br-int',has_traffic_filtering=True,id=f523111f-21f0-49ad-8e55-7515ebcfecff,network=Network(b92087b6-80a8-444b-8732-c31c6e17d4f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf523111f-21') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG os_vif [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:21:4b,bridge_name='br-int',has_traffic_filtering=True,id=f523111f-21f0-49ad-8e55-7515ebcfecff,network=Network(b92087b6-80a8-444b-8732-c31c6e17d4f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf523111f-21') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fe68886a-0de4-5b18-9db8-8d1abae28b67', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.compute.utils [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-98194ea1-5d5c-451a-ae88-c66d42e6e014) {{(pid=74821) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Setting instance vm_state to ERROR: nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-98194ea1-5d5c-451a-ae88-c66d42e6e014)
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Traceback (most recent call last):
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/nova/nova/compute/manager.py", line 4132, in _do_rebuild_instance
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     self.driver.rebuild(**kwargs)
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     raise NotImplementedError()
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] NotImplementedError
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] 
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] During handling of the above exception, another exception occurred:
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] 
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Traceback (most recent call last):
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     driver_block_device.attach_block_devices(
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     _log_and_attach(device)
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     bdm.attach(*attach_args, **attach_kwargs)
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     ret_val = method(obj, context, *args, **kwargs)
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     self._do_attach(context, instance, volume, volume_api,
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     self._volume_attach(context, volume, connector, instance,
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     connection_info = volume_api.attachment_update(
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     res = method(self, ctx, *args, **kwargs)
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     with excutils.save_and_reraise_exception():
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     self.force_reraise()
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     raise self.value
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     context, '3.44', skip_version_check=True).attachments.update(
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     return method.func(obj, *args, **kwargs)
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     resp = self._update('/attachments/%s' % id, body)
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     return self._cs_request(url, 'PUT', **kwargs)
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     return self.request(url, method, **kwargs)
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     raise exceptions.from_response(resp, body)
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-98194ea1-5d5c-451a-ae88-c66d42e6e014)
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] 
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] During handling of the above exception, another exception occurred:
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] 
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Traceback (most recent call last):
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/nova/nova/compute/manager.py", line 10846, in _error_out_instance_on_exception
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     yield
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/nova/nova/compute/manager.py", line 3858, in rebuild_instance
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     self._do_rebuild_instance_with_claim(
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/nova/nova/compute/manager.py", line 3944, in _do_rebuild_instance_with_claim
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     self._do_rebuild_instance(
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/nova/nova/compute/manager.py", line 4136, in _do_rebuild_instance
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     self._rebuild_default_impl(**kwargs)
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/nova/nova/compute/manager.py", line 3719, in _rebuild_default_impl
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     new_block_device_info = attach_block_devices(context, instance, bdms)
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]   File "/opt/stack/nova/nova/compute/manager.py", line 2209, in _prep_block_device
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5]     raise exception.InvalidBDM(str(ex))
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-98194ea1-5d5c-451a-ae88-c66d42e6e014)
Nov 06 13:15:04 user nova-compute[74821]: ERROR nova.compute.manager [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] 
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf523111f-21, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf523111f-21, col_values=(('qos', UUID('4c26df62-0c8f-4e50-a717-2b7b0a51cd5b')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf523111f-21, col_values=(('external_ids', {'iface-id': 'f523111f-21f0-49ad-8e55-7515ebcfecff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:21:4b', 'vm-uuid': 'a33991ce-e911-460d-a6d9-ca738830ef2c'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: INFO os_vif [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:21:4b,bridge_name='br-int',has_traffic_filtering=True,id=f523111f-21f0-49ad-8e55-7515ebcfecff,network=Network(b92087b6-80a8-444b-8732-c31c6e17d4f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf523111f-21')
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:12:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1297022969',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1297022969',id=11,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLP/ji3FuPVI791mpvMNdCzayazy8E548yQX5rI/xbqwI/SkIu1OHU0CVIktacWjY+dJT8FzcO0PTuiUa7nivbZYVA2TTHzX3sUyOkOFTFMBhTPYrB59reXAlb/+yF52pA==',key_name='tempest-keypair-721011422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5313e0306714b299bd860177c36f07f',ramdisk_id='',reservation_id='r-q6i6afm1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-244135857',owner_user_name='tempest-TaggedBootDevicesTest-244135857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:12:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55407d95268147d4a75654afebe43631',uuid=a33991ce-e911-460d-a6d9-ca738830ef2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "027b08d1-100c-4dc6-9e51-a435642f25f9", "address": "fa:16:3e:9a:3b:d1", "network": {"id": "b92087b6-80a8-444b-8732-c31c6e17d4f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-584352862", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027b08d1-10", "ovs_interfaceid": "027b08d1-100c-4dc6-9e51-a435642f25f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converting VIF {"id": "027b08d1-100c-4dc6-9e51-a435642f25f9", "address": "fa:16:3e:9a:3b:d1", "network": {"id": "b92087b6-80a8-444b-8732-c31c6e17d4f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-584352862", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027b08d1-10", "ovs_interfaceid": "027b08d1-100c-4dc6-9e51-a435642f25f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:3b:d1,bridge_name='br-int',has_traffic_filtering=True,id=027b08d1-100c-4dc6-9e51-a435642f25f9,network=Network(b92087b6-80a8-444b-8732-c31c6e17d4f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027b08d1-10') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG os_vif [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:3b:d1,bridge_name='br-int',has_traffic_filtering=True,id=027b08d1-100c-4dc6-9e51-a435642f25f9,network=Network(b92087b6-80a8-444b-8732-c31c6e17d4f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027b08d1-10') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f10c3af1-4a78-5e9e-84cd-990cc3f4b0b5', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap027b08d1-10, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap027b08d1-10, col_values=(('qos', UUID('804804c2-0145-4090-aaeb-98c817e77197')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap027b08d1-10, col_values=(('external_ids', {'iface-id': '027b08d1-100c-4dc6-9e51-a435642f25f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:3b:d1', 'vm-uuid': 'a33991ce-e911-460d-a6d9-ca738830ef2c'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:15:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:04 user nova-compute[74821]: INFO os_vif [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:3b:d1,bridge_name='br-int',has_traffic_filtering=True,id=027b08d1-100c-4dc6-9e51-a435642f25f9,network=Network(b92087b6-80a8-444b-8732-c31c6e17d4f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027b08d1-10')
Nov 06 13:15:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] No BDM found with device name hda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] No VIF found with MAC fa:16:3e:6f:35:3a, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] No VIF found with MAC fa:16:3e:e8:a8:6c, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:15:05 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Using config drive
Nov 06 13:15:05 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:05 user nova-compute[74821]: INFO nova.compute.manager [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Successfully reverted task state from rebuild_block_device_mapping on failure for instance.
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server [None req-0aa4fb71-606a-4ae5-98ff-b4cfb22f3fae tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Exception during message handling: nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-98194ea1-5d5c-451a-ae88-c66d42e6e014)
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4132, in _do_rebuild_instance
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     self.driver.rebuild(**kwargs)
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     raise NotImplementedError()
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server NotImplementedError
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server 
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server 
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     driver_block_device.attach_block_devices(
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     _log_and_attach(device)
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     bdm.attach(*attach_args, **attach_kwargs)
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-98194ea1-5d5c-451a-ae88-c66d42e6e014)
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server 
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server 
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3858, in rebuild_instance
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance_with_claim(
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3944, in _do_rebuild_instance_with_claim
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance(
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4136, in _do_rebuild_instance
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     self._rebuild_default_impl(**kwargs)
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3719, in _rebuild_default_impl
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     new_block_device_info = attach_block_devices(context, instance, bdms)
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2209, in _prep_block_device
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     raise exception.InvalidBDM(str(ex))
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-98194ea1-5d5c-451a-ae88-c66d42e6e014)
Nov 06 13:15:05 user nova-compute[74821]: ERROR oslo_messaging.rpc.server 
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 -F raw /opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/disk" returned: 0 in 2.873s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Ensure instance console log exists: /opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Start _get_guest_xml network_info=[{"id": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "address": "fa:16:3e:e1:45:18", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69de9b4-53", "ovs_interfaceid": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b36ae980c1948c90e5629589a8c86ae5',container_format='bare',created_at=2023-11-06T13:12:38Z,direct_url=<?>,disk_format='qcow2',id=a5275226-a56e-4fd2-bd58-624a723ef01d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-618364180-shelved',owner='07250ce4ef1b429f8a5c3c7763866763',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-06T13:12:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UJCMvTfy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '5a715806-ff8b-4502-8435-c5de3e3c688a', 'attached_at': '', 'detached_at': '', 'volume_id': '5b3cce57-c905-4474-bb23-b3927ad008f3', 'serial': '5b3cce57-c905-4474-bb23-b3927ad008f3'}, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'df34d962-18e7-4f1b-9c6a-933c4e2d05ba', 'volume_type': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:15:05 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:15:05 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:15:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b36ae980c1948c90e5629589a8c86ae5',container_format='bare',created_at=2023-11-06T13:12:38Z,direct_url=<?>,disk_format='qcow2',id=a5275226-a56e-4fd2-bd58-624a723ef01d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-618364180-shelved',owner='07250ce4ef1b429f8a5c3c7763866763',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-06T13:12:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG nova.objects.instance [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5a715806-ff8b-4502-8435-c5de3e3c688a {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG nova.objects.base [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Object Instance<5a715806-ff8b-4502-8435-c5de3e3c688a> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UJCMvTfy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:15:05 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:15:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:15:05 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:15:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:15:05 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b36283-f221-492a-9548-f09596fe1338]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:15:05 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[baab94b3-9ad4-4040-b4e3-12f565466e4b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3] added
Nov 06 13:15:05 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba716fa-e1c7-4a76-8702-f51543af7a5e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG nova.compute.manager [req-789681a5-a652-4309-9c73-e78dc0974bed req-e30415f1-1532-4b02-a2ed-3bc90bff0555 service nova] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Received event network-vif-plugged-95f3755e-a074-4956-ba1d-5c05945bcff5 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-789681a5-a652-4309-9c73-e78dc0974bed req-e30415f1-1532-4b02-a2ed-3bc90bff0555 service nova] Acquiring lock "49d05da1-3222-4f9f-b792-8f3d1f0f2890-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-789681a5-a652-4309-9c73-e78dc0974bed req-e30415f1-1532-4b02-a2ed-3bc90bff0555 service nova] Lock "49d05da1-3222-4f9f-b792-8f3d1f0f2890-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-789681a5-a652-4309-9c73-e78dc0974bed req-e30415f1-1532-4b02-a2ed-3bc90bff0555 service nova] Lock "49d05da1-3222-4f9f-b792-8f3d1f0f2890-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG nova.compute.manager [req-789681a5-a652-4309-9c73-e78dc0974bed req-e30415f1-1532-4b02-a2ed-3bc90bff0555 service nova] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] No waiting events found dispatching network-vif-plugged-95f3755e-a074-4956-ba1d-5c05945bcff5 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:15:05 user nova-compute[74821]: WARNING nova.compute.manager [req-789681a5-a652-4309-9c73-e78dc0974bed req-e30415f1-1532-4b02-a2ed-3bc90bff0555 service nova] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Received unexpected event network-vif-plugged-95f3755e-a074-4956-ba1d-5c05945bcff5 for instance with vm_state active and task_state deleting.
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[749c30f2-3218-4490-9b20-6cf20688e3c8]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UJCMvTfy {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UJCMvTfy" returned: 0 in 0.029s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e52c52-06cc-4a1f-ae70-9cea3e04ec58]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UJCMvTfy'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c80454-aab2-48e4-b27e-91de52fe7001]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ac3f85-3a72-4d09-9972-b645fb9b75c4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 (non-flash)
Nov 06 13:15:05 user nova-compute[74821]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b (non-flash)
Nov 06 13:15:05 user nova-compute[74821]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e (non-flash)
Nov 06 13:15:05 user nova-compute[74821]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:15:05 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 (non-flash)
Nov 06 13:15:05 user nova-compute[74821]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b (non-flash)
Nov 06 13:15:05 user nova-compute[74821]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e (non-flash)
Nov 06 13:15:05 user nova-compute[74821]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:15:05 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:15:05 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Took 1.76 seconds to deallocate network for instance.
Nov 06 13:15:05 user nova-compute[74821]: DEBUG nova.compute.manager [req-912e9e0b-b14e-4252-8094-8e3aee484df1 req-a63674a1-0790-434e-8522-0521b1008c55 service nova] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Received event network-vif-deleted-95f3755e-a074-4956-ba1d-5c05945bcff5 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:15:05 user nova-compute[74821]: INFO nova.compute.manager [req-912e9e0b-b14e-4252-8094-8e3aee484df1 req-a63674a1-0790-434e-8522-0521b1008c55 service nova] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Neutron deleted interface 95f3755e-a074-4956-ba1d-5c05945bcff5; detaching it from the instance and deleting it from the info cache
Nov 06 13:15:05 user nova-compute[74821]: DEBUG nova.network.neutron [req-912e9e0b-b14e-4252-8094-8e3aee484df1 req-a63674a1-0790-434e-8522-0521b1008c55 service nova] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1585c36c-29dd-4130-8b87-01d96965439c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3, portal: 172.16.0.220,3260]
Nov 06 13:15:05 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3, portal: 172.16.0.220,3260] successful.
Nov 06 13:15:05 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:15:05 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Creating config drive at /opt/stack/data/nova/instances/a33991ce-e911-460d-a6d9-ca738830ef2c/disk.config
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a33991ce-e911-460d-a6d9-ca738830ef2c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptd_oolxe {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea26c957-be1a-4ec9-9fa4-e5c6b0317a53]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-47809399-62b2-4072-b06a-730df9d5820b tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-47809399-62b2-4072-b06a-730df9d5820b tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a33991ce-e911-460d-a6d9-ca738830ef2c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptd_oolxe" returned: 0 in 0.072s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG nova.compute.manager [req-912e9e0b-b14e-4252-8094-8e3aee484df1 req-a63674a1-0790-434e-8522-0521b1008c55 service nova] [instance: 49d05da1-3222-4f9f-b792-8f3d1f0f2890] Detach interface failed, port_id=95f3755e-a074-4956-ba1d-5c05945bcff5, reason: Instance 49d05da1-3222-4f9f-b792-8f3d1f0f2890 could not be found. {{(pid=74821) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4f3d6f-6682-4bda-87f7-f5c03e7a0d10]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 (non-flash)
Nov 06 13:15:05 user nova-compute[74821]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b (non-flash)
Nov 06 13:15:05 user nova-compute[74821]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e (non-flash)
Nov 06 13:15:05 user nova-compute[74821]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3 (non-flash)
Nov 06 13:15:05 user nova-compute[74821]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:15:05 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 (non-flash)
Nov 06 13:15:05 user nova-compute[74821]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b (non-flash)
Nov 06 13:15:05 user nova-compute[74821]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e (non-flash)
Nov 06 13:15:05 user nova-compute[74821]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3 (non-flash)
Nov 06 13:15:05 user nova-compute[74821]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:15:05 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.423s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] HCTL ('37', '-', '-', 0) found on session 13 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2159e139-a31a-4417-b43a-379fc086176e]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Searching for a device in session 13 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UJCMvTfy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Acquiring lock "c47906a7-93b9-4527-9318-ed4df54afff6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Lock "c47906a7-93b9-4527-9318-ed4df54afff6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:05 user nova-compute[74821]: INFO nova.compute.manager [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Detaching volume 0c31aa69-3a6d-4c9c-a628-a698806b57c2
Nov 06 13:15:06 user nova-compute[74821]: INFO nova.virt.block_device [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Attempting to driver detach volume 0c31aa69-3a6d-4c9c-a628-a698806b57c2 from mountpoint /dev/vdb
Nov 06 13:15:06 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Attempting to detach device vdb from instance c47906a7-93b9-4527-9318-ed4df54afff6 from the persistent domain config. {{(pid=74821) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 13:15:06 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:15:06 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:15:06 user nova-compute[74821]:   <source dev="/dev/sdc"/>
Nov 06 13:15:06 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:15:06 user nova-compute[74821]:   <serial>0c31aa69-3a6d-4c9c-a628-a698806b57c2</serial>
Nov 06 13:15:06 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:15:06 user nova-compute[74821]: </disk>
Nov 06 13:15:06 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:15:06 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-47809399-62b2-4072-b06a-730df9d5820b tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:15:06 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Successfully detached device vdb from instance c47906a7-93b9-4527-9318-ed4df54afff6 from the persistent domain config.
Nov 06 13:15:06 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c47906a7-93b9-4527-9318-ed4df54afff6 from the live domain config. {{(pid=74821) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 13:15:06 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:15:06 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:15:06 user nova-compute[74821]:   <source dev="/dev/sdc"/>
Nov 06 13:15:06 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:15:06 user nova-compute[74821]:   <serial>0c31aa69-3a6d-4c9c-a628-a698806b57c2</serial>
Nov 06 13:15:06 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:15:06 user nova-compute[74821]: </disk>
Nov 06 13:15:06 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:15:06 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-47809399-62b2-4072-b06a-730df9d5820b tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:15:06 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-47809399-62b2-4072-b06a-730df9d5820b tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.386s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:06 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-47809399-62b2-4072-b06a-730df9d5820b tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Deleted allocations for instance 49d05da1-3222-4f9f-b792-8f3d1f0f2890
Nov 06 13:15:06 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-47809399-62b2-4072-b06a-730df9d5820b tempest-VolumesAssistedSnapshotsTest-1134855026 tempest-VolumesAssistedSnapshotsTest-1134855026-project-member] Lock "49d05da1-3222-4f9f-b792-8f3d1f0f2890" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.348s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:06 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c47906a7-93b9-4527-9318-ed4df54afff6 {{(pid=74821) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 13:15:06 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.474s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:15:06 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] <== connect_volume: return (1477ms) {'type': 'block', 'scsi_wwn': '23439366530656631', 'path': '/dev/sdf'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:15:06 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439366530656631', 'path': '/dev/sdf'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:15:06 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T13:10:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-618364180',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-618364180',id=5,image_ref='a5275226-a56e-4fd2-bd58-624a723ef01d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1555089865',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:10:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='07250ce4ef1b429f8a5c3c7763866763',ramdisk_id='',reservation_id='r-ls92k48z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-374688010',owner_user_name='tempest-AttachVolumeShelveTestJSON-374688010-project-member',shelved_at='2023-11-06T13:12:45.205446',shelved_host='user',shelved_image_id='a5275226-a56e-4fd2-bd58-624a723ef01d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:14:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c82a5e63234e40f6a8e63b3cb4dc97b3',uuid=5a715806-ff8b-4502-8435-c5de3e3c688a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "address": "fa:16:3e:e1:45:18", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69de9b4-53", "ovs_interfaceid": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:15:06 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Converting VIF {"id": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "address": "fa:16:3e:e1:45:18", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69de9b4-53", "ovs_interfaceid": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:15:06 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:45:18,bridge_name='br-int',has_traffic_filtering=True,id=d69de9b4-5366-4d42-b01d-e4ec468a5aa2,network=Network(5318228c-491a-4ea1-a2b2-49ea8e15dccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69de9b4-53') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:15:06 user nova-compute[74821]: DEBUG nova.objects.instance [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a715806-ff8b-4502-8435-c5de3e3c688a {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:15:06 user nova-compute[74821]: DEBUG nova.objects.base [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Object Instance<5a715806-ff8b-4502-8435-c5de3e3c688a> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:15:06 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:15:06 user nova-compute[74821]:   <uuid>5a715806-ff8b-4502-8435-c5de3e3c688a</uuid>
Nov 06 13:15:06 user nova-compute[74821]:   <name>instance-00000005</name>
Nov 06 13:15:06 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:15:06 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:15:06 user nova-compute[74821]:   <metadata>
Nov 06 13:15:06 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:15:06 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:15:06 user nova-compute[74821]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-618364180</nova:name>
Nov 06 13:15:06 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:15:05</nova:creationTime>
Nov 06 13:15:06 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:15:06 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:15:06 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:15:06 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:15:06 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:15:06 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:15:06 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:15:06 user nova-compute[74821]:       <nova:owner>
Nov 06 13:15:06 user nova-compute[74821]:         <nova:user uuid="c82a5e63234e40f6a8e63b3cb4dc97b3">tempest-AttachVolumeShelveTestJSON-374688010-project-member</nova:user>
Nov 06 13:15:06 user nova-compute[74821]:         <nova:project uuid="07250ce4ef1b429f8a5c3c7763866763">tempest-AttachVolumeShelveTestJSON-374688010</nova:project>
Nov 06 13:15:06 user nova-compute[74821]:       </nova:owner>
Nov 06 13:15:06 user nova-compute[74821]:       <nova:root type="image" uuid="a5275226-a56e-4fd2-bd58-624a723ef01d"/>
Nov 06 13:15:06 user nova-compute[74821]:       <nova:ports>
Nov 06 13:15:06 user nova-compute[74821]:         <nova:port uuid="d69de9b4-5366-4d42-b01d-e4ec468a5aa2">
Nov 06 13:15:06 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 13:15:06 user nova-compute[74821]:         </nova:port>
Nov 06 13:15:06 user nova-compute[74821]:       </nova:ports>
Nov 06 13:15:06 user nova-compute[74821]:     </nova:instance>
Nov 06 13:15:06 user nova-compute[74821]:   </metadata>
Nov 06 13:15:06 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:15:06 user nova-compute[74821]:     <system>
Nov 06 13:15:06 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:15:06 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:15:06 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:15:06 user nova-compute[74821]:       <entry name="serial">5a715806-ff8b-4502-8435-c5de3e3c688a</entry>
Nov 06 13:15:06 user nova-compute[74821]:       <entry name="uuid">5a715806-ff8b-4502-8435-c5de3e3c688a</entry>
Nov 06 13:15:06 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:15:06 user nova-compute[74821]:     </system>
Nov 06 13:15:06 user nova-compute[74821]:   </sysinfo>
Nov 06 13:15:06 user nova-compute[74821]:   <os>
Nov 06 13:15:06 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:15:06 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:15:06 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:15:06 user nova-compute[74821]:   </os>
Nov 06 13:15:06 user nova-compute[74821]:   <features>
Nov 06 13:15:06 user nova-compute[74821]:     <acpi/>
Nov 06 13:15:06 user nova-compute[74821]:     <apic/>
Nov 06 13:15:06 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:15:06 user nova-compute[74821]:   </features>
Nov 06 13:15:06 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:15:06 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:15:06 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:15:06 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:15:06 user nova-compute[74821]:   </clock>
Nov 06 13:15:06 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:15:06 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:15:06 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:15:06 user nova-compute[74821]:   </cpu>
Nov 06 13:15:06 user nova-compute[74821]:   <devices>
Nov 06 13:15:06 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:15:06 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:15:06 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/disk"/>
Nov 06 13:15:06 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:15:06 user nova-compute[74821]:     </disk>
Nov 06 13:15:06 user nova-compute[74821]:     <disk type="block" device="disk">
Nov 06 13:15:06 user nova-compute[74821]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:15:06 user nova-compute[74821]:       <source dev="/dev/sdf"/>
Nov 06 13:15:06 user nova-compute[74821]:       <target dev="vdc" bus="virtio"/>
Nov 06 13:15:06 user nova-compute[74821]:       <serial>5b3cce57-c905-4474-bb23-b3927ad008f3</serial>
Nov 06 13:15:06 user nova-compute[74821]:     </disk>
Nov 06 13:15:06 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:15:06 user nova-compute[74821]:       <mac address="fa:16:3e:e1:45:18"/>
Nov 06 13:15:06 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:15:06 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:15:06 user nova-compute[74821]:       <target dev="tapd69de9b4-53"/>
Nov 06 13:15:06 user nova-compute[74821]:     </interface>
Nov 06 13:15:06 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:15:06 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/console.log" append="off"/>
Nov 06 13:15:06 user nova-compute[74821]:     </serial>
Nov 06 13:15:06 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:15:06 user nova-compute[74821]:     <video>
Nov 06 13:15:06 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:15:06 user nova-compute[74821]:     </video>
Nov 06 13:15:06 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:15:06 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:15:06 user nova-compute[74821]:     </rng>
Nov 06 13:15:06 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:15:06 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:15:06 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:15:06 user nova-compute[74821]:     </memballoon>
Nov 06 13:15:06 user nova-compute[74821]:   </devices>
Nov 06 13:15:06 user nova-compute[74821]: </domain>
Nov 06 13:15:06 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:15:07 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T13:10:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-618364180',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-618364180',id=5,image_ref='a5275226-a56e-4fd2-bd58-624a723ef01d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1555089865',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:10:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='07250ce4ef1b429f8a5c3c7763866763',ramdisk_id='',reservation_id='r-ls92k48z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-374688010',owner_user_name='tempest-AttachVolumeShelveTestJSON-374688010-project-member',shelved_at='2023-11-06T13:12:45.205446',shelved_host='user',shelved_image_id='a5275226-a56e-4fd2-bd58-624a723ef01d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:14:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c82a5e63234e40f6a8e63b3cb4dc97b3',uuid=5a715806-ff8b-4502-8435-c5de3e3c688a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "address": "fa:16:3e:e1:45:18", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69de9b4-53", "ovs_interfaceid": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:15:07 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Converting VIF {"id": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "address": "fa:16:3e:e1:45:18", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69de9b4-53", "ovs_interfaceid": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:15:07 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:45:18,bridge_name='br-int',has_traffic_filtering=True,id=d69de9b4-5366-4d42-b01d-e4ec468a5aa2,network=Network(5318228c-491a-4ea1-a2b2-49ea8e15dccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69de9b4-53') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:15:07 user nova-compute[74821]: DEBUG os_vif [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:45:18,bridge_name='br-int',has_traffic_filtering=True,id=d69de9b4-5366-4d42-b01d-e4ec468a5aa2,network=Network(5318228c-491a-4ea1-a2b2-49ea8e15dccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69de9b4-53') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:15:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:15:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0eb3ecc5-d781-5180-81e5-9dba5aca32ab', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:15:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd69de9b4-53, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd69de9b4-53, col_values=(('qos', UUID('6ae5dfab-a6d1-4bc6-88ae-4b1be0d8ed1d')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd69de9b4-53, col_values=(('external_ids', {'iface-id': 'd69de9b4-5366-4d42-b01d-e4ec468a5aa2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:45:18', 'vm-uuid': '5a715806-ff8b-4502-8435-c5de3e3c688a'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:15:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:07 user nova-compute[74821]: INFO os_vif [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:45:18,bridge_name='br-int',has_traffic_filtering=True,id=d69de9b4-5366-4d42-b01d-e4ec468a5aa2,network=Network(5318228c-491a-4ea1-a2b2-49ea8e15dccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69de9b4-53')
Nov 06 13:15:07 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:15:07 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:15:07 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] No VIF found with MAC fa:16:3e:e1:45:18, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:15:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:08 user nova-compute[74821]: DEBUG nova.compute.manager [req-2e8b10f3-d61f-478b-8e40-05e5419bb6a6 req-ce41b56c-addd-4178-bd89-69705b379462 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-plugged-8b30affb-e2f5-4151-8fee-fb7edcaf5ae2 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:15:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2e8b10f3-d61f-478b-8e40-05e5419bb6a6 req-ce41b56c-addd-4178-bd89-69705b379462 service nova] Acquiring lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2e8b10f3-d61f-478b-8e40-05e5419bb6a6 req-ce41b56c-addd-4178-bd89-69705b379462 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2e8b10f3-d61f-478b-8e40-05e5419bb6a6 req-ce41b56c-addd-4178-bd89-69705b379462 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:08 user nova-compute[74821]: DEBUG nova.compute.manager [req-2e8b10f3-d61f-478b-8e40-05e5419bb6a6 req-ce41b56c-addd-4178-bd89-69705b379462 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] No waiting events found dispatching network-vif-plugged-8b30affb-e2f5-4151-8fee-fb7edcaf5ae2 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:15:08 user nova-compute[74821]: WARNING nova.compute.manager [req-2e8b10f3-d61f-478b-8e40-05e5419bb6a6 req-ce41b56c-addd-4178-bd89-69705b379462 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received unexpected event network-vif-plugged-8b30affb-e2f5-4151-8fee-fb7edcaf5ae2 for instance with vm_state building and task_state spawning.
Nov 06 13:15:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:08 user nova-compute[74821]: DEBUG nova.compute.manager [req-466a9ef8-8709-4dcc-8c2b-601c2c9902f0 req-dd089588-8d8e-4a2a-a714-ad204f52fa06 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-plugged-66a37a87-3aa3-44cb-977f-eef4c8ab4e59 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:15:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-466a9ef8-8709-4dcc-8c2b-601c2c9902f0 req-dd089588-8d8e-4a2a-a714-ad204f52fa06 service nova] Acquiring lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-466a9ef8-8709-4dcc-8c2b-601c2c9902f0 req-dd089588-8d8e-4a2a-a714-ad204f52fa06 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-466a9ef8-8709-4dcc-8c2b-601c2c9902f0 req-dd089588-8d8e-4a2a-a714-ad204f52fa06 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:08 user nova-compute[74821]: DEBUG nova.compute.manager [req-466a9ef8-8709-4dcc-8c2b-601c2c9902f0 req-dd089588-8d8e-4a2a-a714-ad204f52fa06 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] No waiting events found dispatching network-vif-plugged-66a37a87-3aa3-44cb-977f-eef4c8ab4e59 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:15:08 user nova-compute[74821]: WARNING nova.compute.manager [req-466a9ef8-8709-4dcc-8c2b-601c2c9902f0 req-dd089588-8d8e-4a2a-a714-ad204f52fa06 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received unexpected event network-vif-plugged-66a37a87-3aa3-44cb-977f-eef4c8ab4e59 for instance with vm_state building and task_state spawning.
Nov 06 13:15:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:10 user nova-compute[74821]: DEBUG nova.compute.manager [req-8d3d2d1c-a166-4510-a24a-c215aa2d53fe req-7be2ed53-74ba-4a00-bfbc-61d87b8470ed service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-plugged-8b30affb-e2f5-4151-8fee-fb7edcaf5ae2 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:15:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8d3d2d1c-a166-4510-a24a-c215aa2d53fe req-7be2ed53-74ba-4a00-bfbc-61d87b8470ed service nova] Acquiring lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8d3d2d1c-a166-4510-a24a-c215aa2d53fe req-7be2ed53-74ba-4a00-bfbc-61d87b8470ed service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8d3d2d1c-a166-4510-a24a-c215aa2d53fe req-7be2ed53-74ba-4a00-bfbc-61d87b8470ed service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:10 user nova-compute[74821]: DEBUG nova.compute.manager [req-8d3d2d1c-a166-4510-a24a-c215aa2d53fe req-7be2ed53-74ba-4a00-bfbc-61d87b8470ed service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] No waiting events found dispatching network-vif-plugged-8b30affb-e2f5-4151-8fee-fb7edcaf5ae2 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:15:10 user nova-compute[74821]: WARNING nova.compute.manager [req-8d3d2d1c-a166-4510-a24a-c215aa2d53fe req-7be2ed53-74ba-4a00-bfbc-61d87b8470ed service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received unexpected event network-vif-plugged-8b30affb-e2f5-4151-8fee-fb7edcaf5ae2 for instance with vm_state building and task_state spawning.
Nov 06 13:15:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:10 user nova-compute[74821]: DEBUG nova.compute.manager [req-4fbb7ca2-ceb7-4db0-aa07-af2c89a46061 req-04e11db3-6eeb-4e27-9c9b-d8a7c5c376f4 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-plugged-66a37a87-3aa3-44cb-977f-eef4c8ab4e59 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:15:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4fbb7ca2-ceb7-4db0-aa07-af2c89a46061 req-04e11db3-6eeb-4e27-9c9b-d8a7c5c376f4 service nova] Acquiring lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4fbb7ca2-ceb7-4db0-aa07-af2c89a46061 req-04e11db3-6eeb-4e27-9c9b-d8a7c5c376f4 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4fbb7ca2-ceb7-4db0-aa07-af2c89a46061 req-04e11db3-6eeb-4e27-9c9b-d8a7c5c376f4 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:10 user nova-compute[74821]: DEBUG nova.compute.manager [req-4fbb7ca2-ceb7-4db0-aa07-af2c89a46061 req-04e11db3-6eeb-4e27-9c9b-d8a7c5c376f4 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] No waiting events found dispatching network-vif-plugged-66a37a87-3aa3-44cb-977f-eef4c8ab4e59 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:15:10 user nova-compute[74821]: WARNING nova.compute.manager [req-4fbb7ca2-ceb7-4db0-aa07-af2c89a46061 req-04e11db3-6eeb-4e27-9c9b-d8a7c5c376f4 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received unexpected event network-vif-plugged-66a37a87-3aa3-44cb-977f-eef4c8ab4e59 for instance with vm_state building and task_state spawning.
Nov 06 13:15:10 user nova-compute[74821]: DEBUG nova.compute.manager [req-4fbb7ca2-ceb7-4db0-aa07-af2c89a46061 req-04e11db3-6eeb-4e27-9c9b-d8a7c5c376f4 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-plugged-6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:15:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4fbb7ca2-ceb7-4db0-aa07-af2c89a46061 req-04e11db3-6eeb-4e27-9c9b-d8a7c5c376f4 service nova] Acquiring lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4fbb7ca2-ceb7-4db0-aa07-af2c89a46061 req-04e11db3-6eeb-4e27-9c9b-d8a7c5c376f4 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4fbb7ca2-ceb7-4db0-aa07-af2c89a46061 req-04e11db3-6eeb-4e27-9c9b-d8a7c5c376f4 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:10 user nova-compute[74821]: DEBUG nova.compute.manager [req-4fbb7ca2-ceb7-4db0-aa07-af2c89a46061 req-04e11db3-6eeb-4e27-9c9b-d8a7c5c376f4 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] No waiting events found dispatching network-vif-plugged-6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:15:10 user nova-compute[74821]: WARNING nova.compute.manager [req-4fbb7ca2-ceb7-4db0-aa07-af2c89a46061 req-04e11db3-6eeb-4e27-9c9b-d8a7c5c376f4 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received unexpected event network-vif-plugged-6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd for instance with vm_state building and task_state spawning.
Nov 06 13:15:10 user nova-compute[74821]: DEBUG nova.compute.manager [req-4fbb7ca2-ceb7-4db0-aa07-af2c89a46061 req-04e11db3-6eeb-4e27-9c9b-d8a7c5c376f4 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-plugged-6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:15:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4fbb7ca2-ceb7-4db0-aa07-af2c89a46061 req-04e11db3-6eeb-4e27-9c9b-d8a7c5c376f4 service nova] Acquiring lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4fbb7ca2-ceb7-4db0-aa07-af2c89a46061 req-04e11db3-6eeb-4e27-9c9b-d8a7c5c376f4 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4fbb7ca2-ceb7-4db0-aa07-af2c89a46061 req-04e11db3-6eeb-4e27-9c9b-d8a7c5c376f4 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:10 user nova-compute[74821]: DEBUG nova.compute.manager [req-4fbb7ca2-ceb7-4db0-aa07-af2c89a46061 req-04e11db3-6eeb-4e27-9c9b-d8a7c5c376f4 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] No waiting events found dispatching network-vif-plugged-6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:15:10 user nova-compute[74821]: WARNING nova.compute.manager [req-4fbb7ca2-ceb7-4db0-aa07-af2c89a46061 req-04e11db3-6eeb-4e27-9c9b-d8a7c5c376f4 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received unexpected event network-vif-plugged-6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd for instance with vm_state building and task_state spawning.
Nov 06 13:15:10 user nova-compute[74821]: DEBUG nova.compute.manager [req-4fbb7ca2-ceb7-4db0-aa07-af2c89a46061 req-04e11db3-6eeb-4e27-9c9b-d8a7c5c376f4 service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Received event network-vif-plugged-d69de9b4-5366-4d42-b01d-e4ec468a5aa2 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:15:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4fbb7ca2-ceb7-4db0-aa07-af2c89a46061 req-04e11db3-6eeb-4e27-9c9b-d8a7c5c376f4 service nova] Acquiring lock "5a715806-ff8b-4502-8435-c5de3e3c688a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4fbb7ca2-ceb7-4db0-aa07-af2c89a46061 req-04e11db3-6eeb-4e27-9c9b-d8a7c5c376f4 service nova] Lock "5a715806-ff8b-4502-8435-c5de3e3c688a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4fbb7ca2-ceb7-4db0-aa07-af2c89a46061 req-04e11db3-6eeb-4e27-9c9b-d8a7c5c376f4 service nova] Lock "5a715806-ff8b-4502-8435-c5de3e3c688a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:10 user nova-compute[74821]: DEBUG nova.compute.manager [req-4fbb7ca2-ceb7-4db0-aa07-af2c89a46061 req-04e11db3-6eeb-4e27-9c9b-d8a7c5c376f4 service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] No waiting events found dispatching network-vif-plugged-d69de9b4-5366-4d42-b01d-e4ec468a5aa2 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:15:10 user nova-compute[74821]: WARNING nova.compute.manager [req-4fbb7ca2-ceb7-4db0-aa07-af2c89a46061 req-04e11db3-6eeb-4e27-9c9b-d8a7c5c376f4 service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Received unexpected event network-vif-plugged-d69de9b4-5366-4d42-b01d-e4ec468a5aa2 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 06 13:15:10 user nova-compute[74821]: DEBUG nova.compute.manager [req-4fbb7ca2-ceb7-4db0-aa07-af2c89a46061 req-04e11db3-6eeb-4e27-9c9b-d8a7c5c376f4 service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Received event network-vif-plugged-d69de9b4-5366-4d42-b01d-e4ec468a5aa2 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:15:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4fbb7ca2-ceb7-4db0-aa07-af2c89a46061 req-04e11db3-6eeb-4e27-9c9b-d8a7c5c376f4 service nova] Acquiring lock "5a715806-ff8b-4502-8435-c5de3e3c688a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4fbb7ca2-ceb7-4db0-aa07-af2c89a46061 req-04e11db3-6eeb-4e27-9c9b-d8a7c5c376f4 service nova] Lock "5a715806-ff8b-4502-8435-c5de3e3c688a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4fbb7ca2-ceb7-4db0-aa07-af2c89a46061 req-04e11db3-6eeb-4e27-9c9b-d8a7c5c376f4 service nova] Lock "5a715806-ff8b-4502-8435-c5de3e3c688a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:10 user nova-compute[74821]: DEBUG nova.compute.manager [req-4fbb7ca2-ceb7-4db0-aa07-af2c89a46061 req-04e11db3-6eeb-4e27-9c9b-d8a7c5c376f4 service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] No waiting events found dispatching network-vif-plugged-d69de9b4-5366-4d42-b01d-e4ec468a5aa2 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:15:10 user nova-compute[74821]: WARNING nova.compute.manager [req-4fbb7ca2-ceb7-4db0-aa07-af2c89a46061 req-04e11db3-6eeb-4e27-9c9b-d8a7c5c376f4 service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Received unexpected event network-vif-plugged-d69de9b4-5366-4d42-b01d-e4ec468a5aa2 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 06 13:15:11 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:11 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:11 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:11 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:11 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:11 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:11 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:11 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:11 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:11 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:11 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-06b88508-41ae-41df-9aad-28952577ccc0 req-9409cfa5-0faa-4ba2-9c7d-db6a181fc14e service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-plugged-03c0a994-073b-4b58-8775-0ce28b2f404d {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-06b88508-41ae-41df-9aad-28952577ccc0 req-9409cfa5-0faa-4ba2-9c7d-db6a181fc14e service nova] Acquiring lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-06b88508-41ae-41df-9aad-28952577ccc0 req-9409cfa5-0faa-4ba2-9c7d-db6a181fc14e service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-06b88508-41ae-41df-9aad-28952577ccc0 req-9409cfa5-0faa-4ba2-9c7d-db6a181fc14e service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-06b88508-41ae-41df-9aad-28952577ccc0 req-9409cfa5-0faa-4ba2-9c7d-db6a181fc14e service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] No waiting events found dispatching network-vif-plugged-03c0a994-073b-4b58-8775-0ce28b2f404d {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:15:12 user nova-compute[74821]: WARNING nova.compute.manager [req-06b88508-41ae-41df-9aad-28952577ccc0 req-9409cfa5-0faa-4ba2-9c7d-db6a181fc14e service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received unexpected event network-vif-plugged-03c0a994-073b-4b58-8775-0ce28b2f404d for instance with vm_state building and task_state spawning.
Nov 06 13:15:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-06b88508-41ae-41df-9aad-28952577ccc0 req-9409cfa5-0faa-4ba2-9c7d-db6a181fc14e service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-plugged-03c0a994-073b-4b58-8775-0ce28b2f404d {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-06b88508-41ae-41df-9aad-28952577ccc0 req-9409cfa5-0faa-4ba2-9c7d-db6a181fc14e service nova] Acquiring lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-06b88508-41ae-41df-9aad-28952577ccc0 req-9409cfa5-0faa-4ba2-9c7d-db6a181fc14e service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-06b88508-41ae-41df-9aad-28952577ccc0 req-9409cfa5-0faa-4ba2-9c7d-db6a181fc14e service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-06b88508-41ae-41df-9aad-28952577ccc0 req-9409cfa5-0faa-4ba2-9c7d-db6a181fc14e service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] No waiting events found dispatching network-vif-plugged-03c0a994-073b-4b58-8775-0ce28b2f404d {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:15:12 user nova-compute[74821]: WARNING nova.compute.manager [req-06b88508-41ae-41df-9aad-28952577ccc0 req-9409cfa5-0faa-4ba2-9c7d-db6a181fc14e service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received unexpected event network-vif-plugged-03c0a994-073b-4b58-8775-0ce28b2f404d for instance with vm_state building and task_state spawning.
Nov 06 13:15:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-06b88508-41ae-41df-9aad-28952577ccc0 req-9409cfa5-0faa-4ba2-9c7d-db6a181fc14e service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-plugged-d3d9f17a-c9d8-4aaf-8015-dc9825335a25 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-06b88508-41ae-41df-9aad-28952577ccc0 req-9409cfa5-0faa-4ba2-9c7d-db6a181fc14e service nova] Acquiring lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-06b88508-41ae-41df-9aad-28952577ccc0 req-9409cfa5-0faa-4ba2-9c7d-db6a181fc14e service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-06b88508-41ae-41df-9aad-28952577ccc0 req-9409cfa5-0faa-4ba2-9c7d-db6a181fc14e service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-06b88508-41ae-41df-9aad-28952577ccc0 req-9409cfa5-0faa-4ba2-9c7d-db6a181fc14e service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] No waiting events found dispatching network-vif-plugged-d3d9f17a-c9d8-4aaf-8015-dc9825335a25 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:15:12 user nova-compute[74821]: WARNING nova.compute.manager [req-06b88508-41ae-41df-9aad-28952577ccc0 req-9409cfa5-0faa-4ba2-9c7d-db6a181fc14e service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received unexpected event network-vif-plugged-d3d9f17a-c9d8-4aaf-8015-dc9825335a25 for instance with vm_state building and task_state spawning.
Nov 06 13:15:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-06b88508-41ae-41df-9aad-28952577ccc0 req-9409cfa5-0faa-4ba2-9c7d-db6a181fc14e service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-plugged-d3d9f17a-c9d8-4aaf-8015-dc9825335a25 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-06b88508-41ae-41df-9aad-28952577ccc0 req-9409cfa5-0faa-4ba2-9c7d-db6a181fc14e service nova] Acquiring lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-06b88508-41ae-41df-9aad-28952577ccc0 req-9409cfa5-0faa-4ba2-9c7d-db6a181fc14e service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-06b88508-41ae-41df-9aad-28952577ccc0 req-9409cfa5-0faa-4ba2-9c7d-db6a181fc14e service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-06b88508-41ae-41df-9aad-28952577ccc0 req-9409cfa5-0faa-4ba2-9c7d-db6a181fc14e service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] No waiting events found dispatching network-vif-plugged-d3d9f17a-c9d8-4aaf-8015-dc9825335a25 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:15:12 user nova-compute[74821]: WARNING nova.compute.manager [req-06b88508-41ae-41df-9aad-28952577ccc0 req-9409cfa5-0faa-4ba2-9c7d-db6a181fc14e service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received unexpected event network-vif-plugged-d3d9f17a-c9d8-4aaf-8015-dc9825335a25 for instance with vm_state building and task_state spawning.
Nov 06 13:15:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-dbbc9eca-0392-463a-b2af-3063b46c1506 req-1d540322-7cf3-4c14-a016-8e70b4d4f5e2 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-plugged-f523111f-21f0-49ad-8e55-7515ebcfecff {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-dbbc9eca-0392-463a-b2af-3063b46c1506 req-1d540322-7cf3-4c14-a016-8e70b4d4f5e2 service nova] Acquiring lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-dbbc9eca-0392-463a-b2af-3063b46c1506 req-1d540322-7cf3-4c14-a016-8e70b4d4f5e2 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-dbbc9eca-0392-463a-b2af-3063b46c1506 req-1d540322-7cf3-4c14-a016-8e70b4d4f5e2 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-dbbc9eca-0392-463a-b2af-3063b46c1506 req-1d540322-7cf3-4c14-a016-8e70b4d4f5e2 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] No waiting events found dispatching network-vif-plugged-f523111f-21f0-49ad-8e55-7515ebcfecff {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:15:12 user nova-compute[74821]: WARNING nova.compute.manager [req-dbbc9eca-0392-463a-b2af-3063b46c1506 req-1d540322-7cf3-4c14-a016-8e70b4d4f5e2 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received unexpected event network-vif-plugged-f523111f-21f0-49ad-8e55-7515ebcfecff for instance with vm_state building and task_state spawning.
Nov 06 13:15:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-dbbc9eca-0392-463a-b2af-3063b46c1506 req-1d540322-7cf3-4c14-a016-8e70b4d4f5e2 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-plugged-f523111f-21f0-49ad-8e55-7515ebcfecff {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-dbbc9eca-0392-463a-b2af-3063b46c1506 req-1d540322-7cf3-4c14-a016-8e70b4d4f5e2 service nova] Acquiring lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-dbbc9eca-0392-463a-b2af-3063b46c1506 req-1d540322-7cf3-4c14-a016-8e70b4d4f5e2 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-dbbc9eca-0392-463a-b2af-3063b46c1506 req-1d540322-7cf3-4c14-a016-8e70b4d4f5e2 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-dbbc9eca-0392-463a-b2af-3063b46c1506 req-1d540322-7cf3-4c14-a016-8e70b4d4f5e2 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] No waiting events found dispatching network-vif-plugged-f523111f-21f0-49ad-8e55-7515ebcfecff {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:15:12 user nova-compute[74821]: WARNING nova.compute.manager [req-dbbc9eca-0392-463a-b2af-3063b46c1506 req-1d540322-7cf3-4c14-a016-8e70b4d4f5e2 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received unexpected event network-vif-plugged-f523111f-21f0-49ad-8e55-7515ebcfecff for instance with vm_state building and task_state spawning.
Nov 06 13:15:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-dbbc9eca-0392-463a-b2af-3063b46c1506 req-1d540322-7cf3-4c14-a016-8e70b4d4f5e2 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-plugged-027b08d1-100c-4dc6-9e51-a435642f25f9 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-dbbc9eca-0392-463a-b2af-3063b46c1506 req-1d540322-7cf3-4c14-a016-8e70b4d4f5e2 service nova] Acquiring lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-dbbc9eca-0392-463a-b2af-3063b46c1506 req-1d540322-7cf3-4c14-a016-8e70b4d4f5e2 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-dbbc9eca-0392-463a-b2af-3063b46c1506 req-1d540322-7cf3-4c14-a016-8e70b4d4f5e2 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-dbbc9eca-0392-463a-b2af-3063b46c1506 req-1d540322-7cf3-4c14-a016-8e70b4d4f5e2 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] No waiting events found dispatching network-vif-plugged-027b08d1-100c-4dc6-9e51-a435642f25f9 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:15:12 user nova-compute[74821]: WARNING nova.compute.manager [req-dbbc9eca-0392-463a-b2af-3063b46c1506 req-1d540322-7cf3-4c14-a016-8e70b4d4f5e2 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received unexpected event network-vif-plugged-027b08d1-100c-4dc6-9e51-a435642f25f9 for instance with vm_state building and task_state spawning.
Nov 06 13:15:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-dbbc9eca-0392-463a-b2af-3063b46c1506 req-1d540322-7cf3-4c14-a016-8e70b4d4f5e2 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-plugged-027b08d1-100c-4dc6-9e51-a435642f25f9 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-dbbc9eca-0392-463a-b2af-3063b46c1506 req-1d540322-7cf3-4c14-a016-8e70b4d4f5e2 service nova] Acquiring lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-dbbc9eca-0392-463a-b2af-3063b46c1506 req-1d540322-7cf3-4c14-a016-8e70b4d4f5e2 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-dbbc9eca-0392-463a-b2af-3063b46c1506 req-1d540322-7cf3-4c14-a016-8e70b4d4f5e2 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-dbbc9eca-0392-463a-b2af-3063b46c1506 req-1d540322-7cf3-4c14-a016-8e70b4d4f5e2 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] No waiting events found dispatching network-vif-plugged-027b08d1-100c-4dc6-9e51-a435642f25f9 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:15:12 user nova-compute[74821]: WARNING nova.compute.manager [req-dbbc9eca-0392-463a-b2af-3063b46c1506 req-1d540322-7cf3-4c14-a016-8e70b4d4f5e2 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received unexpected event network-vif-plugged-027b08d1-100c-4dc6-9e51-a435642f25f9 for instance with vm_state building and task_state spawning.
Nov 06 13:15:14 user nova-compute[74821]: DEBUG nova.compute.manager [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:15:14 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:15:14 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Instance spawned successfully.
Nov 06 13:15:14 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:14 user nova-compute[74821]: DEBUG nova.compute.manager [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:15:14 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:15:14 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Instance spawned successfully.
Nov 06 13:15:14 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:15:14 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:15:14 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:15:14 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:15:14 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:15:14 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:15:14 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:15:14 user nova-compute[74821]: INFO nova.compute.manager [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Took 15.84 seconds to spawn the instance on the hypervisor.
Nov 06 13:15:14 user nova-compute[74821]: DEBUG nova.compute.manager [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:15:14 user nova-compute[74821]: INFO nova.compute.manager [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Took 159.74 seconds to build instance.
Nov 06 13:15:14 user nova-compute[74821]: DEBUG nova.compute.manager [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:15:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0dd49cff-12b0-4769-bb0d-a80774ea0009 tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 159.900s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e8d2eeb-9d7f-47d7-9949-9a8209c43ab7 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "5a715806-ff8b-4502-8435-c5de3e3c688a" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 42.908s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:15 user nova-compute[74821]: INFO nova.compute.manager [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Rescuing
Nov 06 13:15:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "refresh_cache-3e21d005-f190-478a-a911-e483e1235057" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:15:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquired lock "refresh_cache-3e21d005-f190-478a-a911-e483e1235057" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:15:15 user nova-compute[74821]: DEBUG nova.network.neutron [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:15:16 user nova-compute[74821]: DEBUG nova.network.neutron [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Updating instance_info_cache with network_info: [{"id": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "address": "fa:16:3e:e0:fc:40", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6fb684-24", "ovs_interfaceid": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:15:16 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Releasing lock "refresh_cache-3e21d005-f190-478a-a911-e483e1235057" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:15:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:16 user nova-compute[74821]: DEBUG nova.compute.manager [req-43d1026b-4c64-47d4-a8b5-0754aca689ea req-1d424f1a-149d-4b27-b9a5-7d0291b98ecf service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] Received event network-vif-unplugged-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:15:16 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-43d1026b-4c64-47d4-a8b5-0754aca689ea req-1d424f1a-149d-4b27-b9a5-7d0291b98ecf service nova] Acquiring lock "3e21d005-f190-478a-a911-e483e1235057-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:16 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-43d1026b-4c64-47d4-a8b5-0754aca689ea req-1d424f1a-149d-4b27-b9a5-7d0291b98ecf service nova] Lock "3e21d005-f190-478a-a911-e483e1235057-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:16 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-43d1026b-4c64-47d4-a8b5-0754aca689ea req-1d424f1a-149d-4b27-b9a5-7d0291b98ecf service nova] Lock "3e21d005-f190-478a-a911-e483e1235057-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:16 user nova-compute[74821]: DEBUG nova.compute.manager [req-43d1026b-4c64-47d4-a8b5-0754aca689ea req-1d424f1a-149d-4b27-b9a5-7d0291b98ecf service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] No waiting events found dispatching network-vif-unplugged-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:15:16 user nova-compute[74821]: WARNING nova.compute.manager [req-43d1026b-4c64-47d4-a8b5-0754aca689ea req-1d424f1a-149d-4b27-b9a5-7d0291b98ecf service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] Received unexpected event network-vif-unplugged-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 for instance with vm_state active and task_state rescuing.
Nov 06 13:15:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:17 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 3e21d005-f190-478a-a911-e483e1235057] Instance destroyed successfully.
Nov 06 13:15:17 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Attempting rescue
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74821) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Instance directory exists: not creating {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 06 13:15:17 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Creating image(s)
Nov 06 13:15:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "/opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "/opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "/opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.objects.instance [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3e21d005-f190-478a-a911-e483e1235057 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.190s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk.rescue {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk.rescue" returned: 0 in 0.060s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.objects.instance [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lazy-loading 'migration_context' on Instance uuid 3e21d005-f190-478a-a911-e483e1235057 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.objects.base [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Object Instance<3e21d005-f190-478a-a911-e483e1235057> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Start _get_guest_xml network_info=[{"id": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "address": "fa:16:3e:e0:fc:40", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "vif_mac": "fa:16:3e:e0:fc:40"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6fb684-24", "ovs_interfaceid": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.objects.instance [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lazy-loading 'resources' on Instance uuid 3e21d005-f190-478a-a911-e483e1235057 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.objects.base [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Object Instance<3e21d005-f190-478a-a911-e483e1235057> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.objects.instance [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lazy-loading 'numa_topology' on Instance uuid 3e21d005-f190-478a-a911-e483e1235057 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.objects.base [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Object Instance<3e21d005-f190-478a-a911-e483e1235057> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:15:17 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:15:17 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.objects.instance [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3e21d005-f190-478a-a911-e483e1235057 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.objects.base [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Object Instance<3e21d005-f190-478a-a911-e483e1235057> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1653169687',display_name='tempest-ServerRescueNegativeTestJSON-server-1653169687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1653169687',id=1,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:10:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e246e1fd12054401988f9d49f6ad9373',ramdisk_id='',reservation_id='r-zs0g66cj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1107947568',owner_user_name='tempest-ServerRescueNegativeTestJSON-1107947568-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:10:45Z,user_data=None,user_id='4a0f35998b664c32990f079ca1cd5e6d',uuid=3e21d005-f190-478a-a911-e483e1235057,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "address": "fa:16:3e:e0:fc:40", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "vif_mac": "fa:16:3e:e0:fc:40"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6fb684-24", "ovs_interfaceid": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Converting VIF {"id": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "address": "fa:16:3e:e0:fc:40", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "vif_mac": "fa:16:3e:e0:fc:40"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6fb684-24", "ovs_interfaceid": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:fc:40,bridge_name='br-int',has_traffic_filtering=True,id=1f6fb684-24b2-4edc-a5c7-e5097ef2fb16,network=Network(45ec1f7e-dbfa-4746-8d35-e32f7c938a0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6fb684-24') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.objects.instance [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e21d005-f190-478a-a911-e483e1235057 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.objects.base [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Object Instance<3e21d005-f190-478a-a911-e483e1235057> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:15:17 user nova-compute[74821]:   <uuid>3e21d005-f190-478a-a911-e483e1235057</uuid>
Nov 06 13:15:17 user nova-compute[74821]:   <name>instance-00000001</name>
Nov 06 13:15:17 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:15:17 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:15:17 user nova-compute[74821]:   <metadata>
Nov 06 13:15:17 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:15:17 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:15:17 user nova-compute[74821]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1653169687</nova:name>
Nov 06 13:15:17 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:15:17</nova:creationTime>
Nov 06 13:15:17 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:15:17 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:15:17 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:15:17 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:15:17 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:15:17 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:15:17 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:15:17 user nova-compute[74821]:       <nova:owner>
Nov 06 13:15:17 user nova-compute[74821]:         <nova:user uuid="4a0f35998b664c32990f079ca1cd5e6d">tempest-ServerRescueNegativeTestJSON-1107947568-project-member</nova:user>
Nov 06 13:15:17 user nova-compute[74821]:         <nova:project uuid="e246e1fd12054401988f9d49f6ad9373">tempest-ServerRescueNegativeTestJSON-1107947568</nova:project>
Nov 06 13:15:17 user nova-compute[74821]:       </nova:owner>
Nov 06 13:15:17 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:15:17 user nova-compute[74821]:       <nova:ports>
Nov 06 13:15:17 user nova-compute[74821]:         <nova:port uuid="1f6fb684-24b2-4edc-a5c7-e5097ef2fb16">
Nov 06 13:15:17 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 13:15:17 user nova-compute[74821]:         </nova:port>
Nov 06 13:15:17 user nova-compute[74821]:       </nova:ports>
Nov 06 13:15:17 user nova-compute[74821]:     </nova:instance>
Nov 06 13:15:17 user nova-compute[74821]:   </metadata>
Nov 06 13:15:17 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:15:17 user nova-compute[74821]:     <system>
Nov 06 13:15:17 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:15:17 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:15:17 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:15:17 user nova-compute[74821]:       <entry name="serial">3e21d005-f190-478a-a911-e483e1235057</entry>
Nov 06 13:15:17 user nova-compute[74821]:       <entry name="uuid">3e21d005-f190-478a-a911-e483e1235057</entry>
Nov 06 13:15:17 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:15:17 user nova-compute[74821]:     </system>
Nov 06 13:15:17 user nova-compute[74821]:   </sysinfo>
Nov 06 13:15:17 user nova-compute[74821]:   <os>
Nov 06 13:15:17 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:15:17 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:15:17 user nova-compute[74821]:   </os>
Nov 06 13:15:17 user nova-compute[74821]:   <features>
Nov 06 13:15:17 user nova-compute[74821]:     <acpi/>
Nov 06 13:15:17 user nova-compute[74821]:     <apic/>
Nov 06 13:15:17 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:15:17 user nova-compute[74821]:   </features>
Nov 06 13:15:17 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:15:17 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:15:17 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:15:17 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:15:17 user nova-compute[74821]:   </clock>
Nov 06 13:15:17 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:15:17 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:15:17 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:15:17 user nova-compute[74821]:   </cpu>
Nov 06 13:15:17 user nova-compute[74821]:   <devices>
Nov 06 13:15:17 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:15:17 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:15:17 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk.rescue"/>
Nov 06 13:15:17 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:15:17 user nova-compute[74821]:     </disk>
Nov 06 13:15:17 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:15:17 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:15:17 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk"/>
Nov 06 13:15:17 user nova-compute[74821]:       <target dev="vdb" bus="virtio"/>
Nov 06 13:15:17 user nova-compute[74821]:     </disk>
Nov 06 13:15:17 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:15:17 user nova-compute[74821]:       <mac address="fa:16:3e:e0:fc:40"/>
Nov 06 13:15:17 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:15:17 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:15:17 user nova-compute[74821]:       <target dev="tap1f6fb684-24"/>
Nov 06 13:15:17 user nova-compute[74821]:     </interface>
Nov 06 13:15:17 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:15:17 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/console.log" append="off"/>
Nov 06 13:15:17 user nova-compute[74821]:     </serial>
Nov 06 13:15:17 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:15:17 user nova-compute[74821]:     <video>
Nov 06 13:15:17 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:15:17 user nova-compute[74821]:     </video>
Nov 06 13:15:17 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:15:17 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:15:17 user nova-compute[74821]:     </rng>
Nov 06 13:15:17 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:15:17 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:15:17 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:15:17 user nova-compute[74821]:     </memballoon>
Nov 06 13:15:17 user nova-compute[74821]:   </devices>
Nov 06 13:15:17 user nova-compute[74821]: </domain>
Nov 06 13:15:17 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:15:17 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 3e21d005-f190-478a-a911-e483e1235057] Instance destroyed successfully.
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:15:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] No VIF found with MAC fa:16:3e:e0:fc:40, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:15:18 user nova-compute[74821]: DEBUG nova.compute.manager [req-fafdc486-4ee1-41fd-b5fd-3b663ec4998b req-c7250f7c-fff1-4025-a20b-aec34a509071 service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] Received event network-vif-plugged-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:15:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fafdc486-4ee1-41fd-b5fd-3b663ec4998b req-c7250f7c-fff1-4025-a20b-aec34a509071 service nova] Acquiring lock "3e21d005-f190-478a-a911-e483e1235057-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fafdc486-4ee1-41fd-b5fd-3b663ec4998b req-c7250f7c-fff1-4025-a20b-aec34a509071 service nova] Lock "3e21d005-f190-478a-a911-e483e1235057-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fafdc486-4ee1-41fd-b5fd-3b663ec4998b req-c7250f7c-fff1-4025-a20b-aec34a509071 service nova] Lock "3e21d005-f190-478a-a911-e483e1235057-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:18 user nova-compute[74821]: DEBUG nova.compute.manager [req-fafdc486-4ee1-41fd-b5fd-3b663ec4998b req-c7250f7c-fff1-4025-a20b-aec34a509071 service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] No waiting events found dispatching network-vif-plugged-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:15:18 user nova-compute[74821]: WARNING nova.compute.manager [req-fafdc486-4ee1-41fd-b5fd-3b663ec4998b req-c7250f7c-fff1-4025-a20b-aec34a509071 service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] Received unexpected event network-vif-plugged-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 for instance with vm_state active and task_state rescuing.
Nov 06 13:15:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:20 user nova-compute[74821]: DEBUG nova.compute.manager [req-8c94a514-451f-42d3-b3f8-b798502e1b92 req-5ebd2beb-9e06-469b-9fb4-229229920179 service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] Received event network-vif-plugged-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:15:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8c94a514-451f-42d3-b3f8-b798502e1b92 req-5ebd2beb-9e06-469b-9fb4-229229920179 service nova] Acquiring lock "3e21d005-f190-478a-a911-e483e1235057-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8c94a514-451f-42d3-b3f8-b798502e1b92 req-5ebd2beb-9e06-469b-9fb4-229229920179 service nova] Lock "3e21d005-f190-478a-a911-e483e1235057-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8c94a514-451f-42d3-b3f8-b798502e1b92 req-5ebd2beb-9e06-469b-9fb4-229229920179 service nova] Lock "3e21d005-f190-478a-a911-e483e1235057-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:20 user nova-compute[74821]: DEBUG nova.compute.manager [req-8c94a514-451f-42d3-b3f8-b798502e1b92 req-5ebd2beb-9e06-469b-9fb4-229229920179 service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] No waiting events found dispatching network-vif-plugged-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:15:20 user nova-compute[74821]: WARNING nova.compute.manager [req-8c94a514-451f-42d3-b3f8-b798502e1b92 req-5ebd2beb-9e06-469b-9fb4-229229920179 service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] Received unexpected event network-vif-plugged-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 for instance with vm_state active and task_state rescuing.
Nov 06 13:15:20 user nova-compute[74821]: DEBUG nova.compute.manager [req-8c94a514-451f-42d3-b3f8-b798502e1b92 req-5ebd2beb-9e06-469b-9fb4-229229920179 service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] Received event network-vif-plugged-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:15:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8c94a514-451f-42d3-b3f8-b798502e1b92 req-5ebd2beb-9e06-469b-9fb4-229229920179 service nova] Acquiring lock "3e21d005-f190-478a-a911-e483e1235057-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8c94a514-451f-42d3-b3f8-b798502e1b92 req-5ebd2beb-9e06-469b-9fb4-229229920179 service nova] Lock "3e21d005-f190-478a-a911-e483e1235057-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8c94a514-451f-42d3-b3f8-b798502e1b92 req-5ebd2beb-9e06-469b-9fb4-229229920179 service nova] Lock "3e21d005-f190-478a-a911-e483e1235057-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:20 user nova-compute[74821]: DEBUG nova.compute.manager [req-8c94a514-451f-42d3-b3f8-b798502e1b92 req-5ebd2beb-9e06-469b-9fb4-229229920179 service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] No waiting events found dispatching network-vif-plugged-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:15:20 user nova-compute[74821]: WARNING nova.compute.manager [req-8c94a514-451f-42d3-b3f8-b798502e1b92 req-5ebd2beb-9e06-469b-9fb4-229229920179 service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] Received unexpected event network-vif-plugged-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 for instance with vm_state active and task_state rescuing.
Nov 06 13:15:20 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:22 user nova-compute[74821]: DEBUG nova.compute.manager [None req-6ffd111e-4f99-4b30-adca-5699a5250784 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:15:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:24 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:15:25 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:15:26 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c47906a7-93b9-4527-9318-ed4df54afff6 is timed out.
Nov 06 13:15:26 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Successfully detached device vdb from instance c47906a7-93b9-4527-9318-ed4df54afff6 from the live domain config.
Nov 06 13:15:26 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:15:26 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaLCBrKp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '0c31aa69-3a6d-4c9c-a628-a698806b57c2'}, None), 'kwargs': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:15:26 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:15:26 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:15:26 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:15:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:26 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2434556c-066c-4a4f-ab11-8949e7ae745c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:26 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:15:26 user nova-compute[74821]: No targets found.
Nov 06 13:15:26 user nova-compute[74821]: iSNS:
Nov 06 13:15:26 user nova-compute[74821]: No targets found.
Nov 06 13:15:26 user nova-compute[74821]: STATIC:
Nov 06 13:15:26 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89
Nov 06 13:15:26 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:15:26 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:15:26 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2
Nov 06 13:15:26 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:15:26 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:15:26 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b
Nov 06 13:15:26 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:15:26 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:15:26 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3
Nov 06 13:15:26 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:15:26 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:15:26 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e
Nov 06 13:15:26 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:15:26 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:15:26 user nova-compute[74821]: FIRMWARE:
Nov 06 13:15:26 user nova-compute[74821]: No targets found.
Nov 06 13:15:26 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:15:26 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:15:26 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:15:26 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:15:26 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:15:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:26 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[056d5954-4368-4245-9f1e-adb8c8b223b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:26 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:15:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:15:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Rebuilding the list of instances to heal {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 13:15:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:26 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[921aa144-fad8-4734-8820-f04e814afff4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:26 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 (non-flash)
Nov 06 13:15:26 user nova-compute[74821]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b (non-flash)
Nov 06 13:15:26 user nova-compute[74821]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e (non-flash)
Nov 06 13:15:26 user nova-compute[74821]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3 (non-flash)
Nov 06 13:15:26 user nova-compute[74821]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:15:26 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:15:26 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 (non-flash)
Nov 06 13:15:26 user nova-compute[74821]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b (non-flash)
Nov 06 13:15:26 user nova-compute[74821]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e (non-flash)
Nov 06 13:15:26 user nova-compute[74821]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3 (non-flash)
Nov 06 13:15:26 user nova-compute[74821]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 (non-flash)
Nov 06 13:15:26 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:15:26 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e405eb7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2'): ({'sdc'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Removing single pathed devices sdc {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ff1eeb-5655-4546-b08c-f6dc26ab6b96]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.033s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cc8a4d-8a07-46af-a4cf-cfa910a82359]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Flushing IO for device /dev/sdc {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf16fdf-0874-4a41-803f-6bdf42f698c0]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.062s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d4e435-9086-4fc0-af65-aa6440c4c9e1]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] SCSI volumes sdc have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d6d3fc-8aaf-4a92-95ee-a010fed4651d]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef36ec17-1c83-482f-8632-1974c269525a]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2, portal: 172.16.0.220,3260]
Nov 06 13:15:27 user nova-compute[74821]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2, portal: 172.16.0.220,3260] successful.
Nov 06 13:15:27 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c31aa69-3a6d-4c9c-a628-a698806b57c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1789d5a4-9f64-42aa-a43a-22a2edd4899f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.462s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] <== disconnect_volume: return (464ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-3e21d005-f190-478a-a911-e483e1235057" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-3e21d005-f190-478a-a911-e483e1235057" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 3e21d005-f190-478a-a911-e483e1235057] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:15:27 user nova-compute[74821]: DEBUG nova.objects.instance [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lazy-loading 'info_cache' on Instance uuid 3e21d005-f190-478a-a911-e483e1235057 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:15:28 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 3e21d005-f190-478a-a911-e483e1235057] Updating instance_info_cache with network_info: [{"id": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "address": "fa:16:3e:e0:fc:40", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6fb684-24", "ovs_interfaceid": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:15:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-3e21d005-f190-478a-a911-e483e1235057" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:15:28 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 3e21d005-f190-478a-a911-e483e1235057] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:15:28 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:15:28 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:15:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:28 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:15:28 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:15:28 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:15:28 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:15:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:29 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:15:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json" returned: 0 in 0.376s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:29 user nova-compute[74821]: DEBUG nova.objects.instance [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Lazy-loading 'flavor' on Instance uuid c47906a7-93b9-4527-9318-ed4df54afff6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:15:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ce72fe67-b08f-4e07-801a-f5c15288e0d6 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Lock "c47906a7-93b9-4527-9318-ed4df54afff6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.909s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47906a7-93b9-4527-9318-ed4df54afff6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47906a7-93b9-4527-9318-ed4df54afff6/disk --force-share --output=json" returned: 0 in 0.365s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47906a7-93b9-4527-9318-ed4df54afff6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c47906a7-93b9-4527-9318-ed4df54afff6/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk.rescue --force-share --output=json" returned: 0 in 0.290s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Acquiring lock "ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Lock "ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Acquiring lock "ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Lock "ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Lock "ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:32 user nova-compute[74821]: INFO nova.compute.manager [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Terminating instance
Nov 06 13:15:32 user nova-compute[74821]: DEBUG nova.compute.manager [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [-] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] During wait destroy, instance disappeared. {{(pid=74821) _wait_for_destroy /opt/stack/nova/nova/virt/libvirt/driver.py:1527}}
Nov 06 13:15:32 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Instance destroyed successfully.
Nov 06 13:15:32 user nova-compute[74821]: DEBUG nova.objects.instance [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Lazy-loading 'resources' on Instance uuid ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T13:11:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-55767323',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-272403543',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYJm0cyElUjil24imeyuGUtyD8RFmEZ21wSS4yaGDzXXrR9VKn5Z9Rvk9M2W47duumtOI552lIs37Yh7wbD5f0dboHXCGJQYXqGlPPG0wo8M+okGKaG9RpC65rRd95e9A==',key_name='tempest-keypair-1379795935',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:12:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1448bac90e444d38a97183dba44c98de',ramdisk_id='',reservation_id='r-balxag8t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-662359766',owner_user_name='tempest-ServerActionsV293TestJSON-662359766-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:15:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be36fa52c6ef4c5bab9841e42eb16a16',uuid=ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='error') vif={"id": "bbfa9945-6317-4b90-880f-23ee3eefafc1", "address": "fa:16:3e:1b:dd:99", "network": {"id": "028f273f-8e31-4b8e-9662-d0a94d5ea802", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1047617218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1448bac90e444d38a97183dba44c98de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbfa9945-63", "ovs_interfaceid": "bbfa9945-6317-4b90-880f-23ee3eefafc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Converting VIF {"id": "bbfa9945-6317-4b90-880f-23ee3eefafc1", "address": "fa:16:3e:1b:dd:99", "network": {"id": "028f273f-8e31-4b8e-9662-d0a94d5ea802", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1047617218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1448bac90e444d38a97183dba44c98de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbfa9945-63", "ovs_interfaceid": "bbfa9945-6317-4b90-880f-23ee3eefafc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:dd:99,bridge_name='br-int',has_traffic_filtering=True,id=bbfa9945-6317-4b90-880f-23ee3eefafc1,network=Network(028f273f-8e31-4b8e-9662-d0a94d5ea802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbfa9945-63') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG os_vif [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:dd:99,bridge_name='br-int',has_traffic_filtering=True,id=bbfa9945-6317-4b90-880f-23ee3eefafc1,network=Network(028f273f-8e31-4b8e-9662-d0a94d5ea802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbfa9945-63') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbbfa9945-63, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:15:32 user nova-compute[74821]: INFO os_vif [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:dd:99,bridge_name='br-int',has_traffic_filtering=True,id=bbfa9945-6317-4b90-880f-23ee3eefafc1,network=Network(028f273f-8e31-4b8e-9662-d0a94d5ea802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbfa9945-63')
Nov 06 13:15:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DLjnzvpG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:15:32 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:15:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ae9540-befc-4f6f-a73e-833bf62e1d0e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:15:32 user nova-compute[74821]: No targets found.
Nov 06 13:15:32 user nova-compute[74821]: iSNS:
Nov 06 13:15:32 user nova-compute[74821]: No targets found.
Nov 06 13:15:32 user nova-compute[74821]: STATIC:
Nov 06 13:15:32 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89
Nov 06 13:15:32 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:15:32 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:15:32 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b
Nov 06 13:15:32 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:15:32 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:15:32 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3
Nov 06 13:15:32 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:15:32 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:15:32 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e
Nov 06 13:15:32 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:15:32 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:15:32 user nova-compute[74821]: FIRMWARE:
Nov 06 13:15:32 user nova-compute[74821]: No targets found.
Nov 06 13:15:32 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:15:32 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:15:32 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5f2d71-1939-4b7f-bc8e-929080149c25]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18cd4da-4b34-45fd-aa7c-2f706f25bef0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 (non-flash)
Nov 06 13:15:32 user nova-compute[74821]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b (non-flash)
Nov 06 13:15:32 user nova-compute[74821]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e (non-flash)
Nov 06 13:15:32 user nova-compute[74821]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3 (non-flash)
Nov 06 13:15:32 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 (non-flash)
Nov 06 13:15:32 user nova-compute[74821]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b (non-flash)
Nov 06 13:15:32 user nova-compute[74821]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e (non-flash)
Nov 06 13:15:32 user nova-compute[74821]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3 (non-flash)
Nov 06 13:15:32 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e500e20e0>, {}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Disconnecting from: [] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.147s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] <== disconnect_volume: return (148ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:15:32 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Deletion of /opt/stack/data/nova/instances/ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5_del complete
Nov 06 13:15:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:32 user nova-compute[74821]: INFO nova.compute.manager [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Took 0.31 seconds to destroy the instance on the hypervisor.
Nov 06 13:15:32 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:15:32 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:15:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:34 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:15:34 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:15:34 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=8175MB free_disk=25.67816925048828GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:15:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:34 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 3e21d005-f190-478a-a911-e483e1235057 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:15:34 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 311817c5-7b08-4da9-98eb-c685f37e6fd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:15:34 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance f8c537c6-fa3e-4842-9471-7258a22c01f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:15:34 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance c47906a7-93b9-4527-9318-ed4df54afff6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:15:34 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance a33991ce-e911-460d-a6d9-ca738830ef2c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:15:34 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 5a715806-ff8b-4502-8435-c5de3e3c688a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:15:34 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:15:34 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:15:35 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:15:35 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:15:35 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:15:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.973s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:35 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:15:35 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Took 2.62 seconds to deallocate network for instance.
Nov 06 13:15:35 user nova-compute[74821]: DEBUG nova.compute.manager [req-d78e75ae-79c7-49a4-beb7-179a05f08536 req-565e0e60-d271-442c-9597-dad4cf573c22 service nova] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Received event network-vif-deleted-bbfa9945-6317-4b90-880f-23ee3eefafc1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:15:35 user nova-compute[74821]: INFO nova.compute.manager [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Took 0.09 seconds to detach 1 volumes for instance.
Nov 06 13:15:35 user nova-compute[74821]: DEBUG nova.compute.manager [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] [instance: ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5] Deleting volume: e749d6ce-fdbf-44e4-9bc6-2df3c8cc714f {{(pid=74821) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 06 13:15:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:36 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:15:36 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:15:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-79eb27e3-dcca-4737-a7da-9a374e2e7f9a tempest-ServerActionsV293TestJSON-662359766 tempest-ServerActionsV293TestJSON-662359766-project-member] Lock "ce90f138-17a9-4e1e-83c2-9e3fcdf2bac5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.703s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:38 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:15:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Acquiring lock "f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Lock "f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:48 user nova-compute[74821]: DEBUG nova.compute.manager [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:15:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:48 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:15:48 user nova-compute[74821]: INFO nova.compute.claims [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Claim successful on node user
Nov 06 13:15:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:49 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:15:49 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:15:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:49 user nova-compute[74821]: DEBUG nova.compute.manager [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:15:49 user nova-compute[74821]: DEBUG nova.compute.manager [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:15:49 user nova-compute[74821]: DEBUG nova.network.neutron [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:15:49 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:15:49 user nova-compute[74821]: DEBUG nova.compute.manager [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:15:49 user nova-compute[74821]: DEBUG nova.policy [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ee1d041e07fd4b7d8a5fcb864243058c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d784816c0f14c34afecba6292236040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:15:49 user nova-compute[74821]: DEBUG nova.compute.manager [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:15:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:15:49 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Creating image(s)
Nov 06 13:15:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Lock "/opt/stack/data/nova/instances/f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Lock "/opt/stack/data/nova/instances/f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.029s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.813s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.234s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf/disk 1073741824" returned: 0 in 0.068s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.311s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:50 user nova-compute[74821]: DEBUG nova.network.neutron [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Successfully created port: 2d631a76-0d6f-4132-a87b-c6baf800c911 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:15:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.187s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:50 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:15:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:51 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Cannot resize image /opt/stack/data/nova/instances/f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:15:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:15:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Ensure instance console log exists: /opt/stack/data/nova/instances/f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:15:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.network.neutron [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Successfully updated port: 2d631a76-0d6f-4132-a87b-c6baf800c911 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Acquiring lock "refresh_cache-f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Acquired lock "refresh_cache-f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.network.neutron [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-fa06c955-e48c-440c-8710-f20bd6e4718a req-224c4d35-e0b4-49a5-afc6-cfe1df946ca0 service nova] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Received event network-changed-2d631a76-0d6f-4132-a87b-c6baf800c911 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-fa06c955-e48c-440c-8710-f20bd6e4718a req-224c4d35-e0b4-49a5-afc6-cfe1df946ca0 service nova] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Refreshing instance network info cache due to event network-changed-2d631a76-0d6f-4132-a87b-c6baf800c911. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fa06c955-e48c-440c-8710-f20bd6e4718a req-224c4d35-e0b4-49a5-afc6-cfe1df946ca0 service nova] Acquiring lock "refresh_cache-f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.network.neutron [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "2de346cb-9858-47b8-a86c-4fde720d6127" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "2de346cb-9858-47b8-a86c-4fde720d6127" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.compute.manager [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:15:52 user nova-compute[74821]: INFO nova.compute.claims [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Claim successful on node user
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.network.neutron [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Updating instance_info_cache with network_info: [{"id": "2d631a76-0d6f-4132-a87b-c6baf800c911", "address": "fa:16:3e:9e:a0:c0", "network": {"id": "e73a1b38-3c27-4b87-a0f0-f746711d4363", "bridge": "br-int", "label": "tempest-VolumesActionsTest-544363737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d784816c0f14c34afecba6292236040", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d631a76-0d", "ovs_interfaceid": "2d631a76-0d6f-4132-a87b-c6baf800c911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Releasing lock "refresh_cache-f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.compute.manager [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Instance network_info: |[{"id": "2d631a76-0d6f-4132-a87b-c6baf800c911", "address": "fa:16:3e:9e:a0:c0", "network": {"id": "e73a1b38-3c27-4b87-a0f0-f746711d4363", "bridge": "br-int", "label": "tempest-VolumesActionsTest-544363737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d784816c0f14c34afecba6292236040", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d631a76-0d", "ovs_interfaceid": "2d631a76-0d6f-4132-a87b-c6baf800c911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fa06c955-e48c-440c-8710-f20bd6e4718a req-224c4d35-e0b4-49a5-afc6-cfe1df946ca0 service nova] Acquired lock "refresh_cache-f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.network.neutron [req-fa06c955-e48c-440c-8710-f20bd6e4718a req-224c4d35-e0b4-49a5-afc6-cfe1df946ca0 service nova] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Refreshing network info cache for port 2d631a76-0d6f-4132-a87b-c6baf800c911 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Start _get_guest_xml network_info=[{"id": "2d631a76-0d6f-4132-a87b-c6baf800c911", "address": "fa:16:3e:9e:a0:c0", "network": {"id": "e73a1b38-3c27-4b87-a0f0-f746711d4363", "bridge": "br-int", "label": "tempest-VolumesActionsTest-544363737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d784816c0f14c34afecba6292236040", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d631a76-0d", "ovs_interfaceid": "2d631a76-0d6f-4132-a87b-c6baf800c911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:15:52 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:15:52 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:15:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-362922964',display_name='tempest-VolumesActionsTest-instance-362922964',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-362922964',id=13,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d784816c0f14c34afecba6292236040',ramdisk_id='',reservation_id='r-8ghcduzw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1240738149',owner_user_name='tempest-VolumesActionsTest-1240738149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:15:50Z,user_data=None,user_id='ee1d041e07fd4b7d8a5fcb864243058c',uuid=f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d631a76-0d6f-4132-a87b-c6baf800c911", "address": "fa:16:3e:9e:a0:c0", "network": {"id": "e73a1b38-3c27-4b87-a0f0-f746711d4363", "bridge": "br-int", "label": "tempest-VolumesActionsTest-544363737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d784816c0f14c34afecba6292236040", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d631a76-0d", "ovs_interfaceid": "2d631a76-0d6f-4132-a87b-c6baf800c911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Converting VIF {"id": "2d631a76-0d6f-4132-a87b-c6baf800c911", "address": "fa:16:3e:9e:a0:c0", "network": {"id": "e73a1b38-3c27-4b87-a0f0-f746711d4363", "bridge": "br-int", "label": "tempest-VolumesActionsTest-544363737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d784816c0f14c34afecba6292236040", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d631a76-0d", "ovs_interfaceid": "2d631a76-0d6f-4132-a87b-c6baf800c911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a0:c0,bridge_name='br-int',has_traffic_filtering=True,id=2d631a76-0d6f-4132-a87b-c6baf800c911,network=Network(e73a1b38-3c27-4b87-a0f0-f746711d4363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d631a76-0d') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.objects.instance [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Lazy-loading 'pci_devices' on Instance uuid f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:15:52 user nova-compute[74821]:   <uuid>f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf</uuid>
Nov 06 13:15:52 user nova-compute[74821]:   <name>instance-0000000d</name>
Nov 06 13:15:52 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:15:52 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:15:52 user nova-compute[74821]:   <metadata>
Nov 06 13:15:52 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:15:52 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:15:52 user nova-compute[74821]:       <nova:name>tempest-VolumesActionsTest-instance-362922964</nova:name>
Nov 06 13:15:52 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:15:52</nova:creationTime>
Nov 06 13:15:52 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:15:52 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:15:52 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:15:52 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:15:52 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:15:52 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:15:52 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:15:52 user nova-compute[74821]:       <nova:owner>
Nov 06 13:15:52 user nova-compute[74821]:         <nova:user uuid="ee1d041e07fd4b7d8a5fcb864243058c">tempest-VolumesActionsTest-1240738149-project-member</nova:user>
Nov 06 13:15:52 user nova-compute[74821]:         <nova:project uuid="6d784816c0f14c34afecba6292236040">tempest-VolumesActionsTest-1240738149</nova:project>
Nov 06 13:15:52 user nova-compute[74821]:       </nova:owner>
Nov 06 13:15:52 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:15:52 user nova-compute[74821]:       <nova:ports>
Nov 06 13:15:52 user nova-compute[74821]:         <nova:port uuid="2d631a76-0d6f-4132-a87b-c6baf800c911">
Nov 06 13:15:52 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 06 13:15:52 user nova-compute[74821]:         </nova:port>
Nov 06 13:15:52 user nova-compute[74821]:       </nova:ports>
Nov 06 13:15:52 user nova-compute[74821]:     </nova:instance>
Nov 06 13:15:52 user nova-compute[74821]:   </metadata>
Nov 06 13:15:52 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:15:52 user nova-compute[74821]:     <system>
Nov 06 13:15:52 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:15:52 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:15:52 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:15:52 user nova-compute[74821]:       <entry name="serial">f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf</entry>
Nov 06 13:15:52 user nova-compute[74821]:       <entry name="uuid">f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf</entry>
Nov 06 13:15:52 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:15:52 user nova-compute[74821]:     </system>
Nov 06 13:15:52 user nova-compute[74821]:   </sysinfo>
Nov 06 13:15:52 user nova-compute[74821]:   <os>
Nov 06 13:15:52 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:15:52 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:15:52 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:15:52 user nova-compute[74821]:   </os>
Nov 06 13:15:52 user nova-compute[74821]:   <features>
Nov 06 13:15:52 user nova-compute[74821]:     <acpi/>
Nov 06 13:15:52 user nova-compute[74821]:     <apic/>
Nov 06 13:15:52 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:15:52 user nova-compute[74821]:   </features>
Nov 06 13:15:52 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:15:52 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:15:52 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:15:52 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:15:52 user nova-compute[74821]:   </clock>
Nov 06 13:15:52 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:15:52 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:15:52 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:15:52 user nova-compute[74821]:   </cpu>
Nov 06 13:15:52 user nova-compute[74821]:   <devices>
Nov 06 13:15:52 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:15:52 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:15:52 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf/disk"/>
Nov 06 13:15:52 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:15:52 user nova-compute[74821]:     </disk>
Nov 06 13:15:52 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:15:52 user nova-compute[74821]:       <mac address="fa:16:3e:9e:a0:c0"/>
Nov 06 13:15:52 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:15:52 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:15:52 user nova-compute[74821]:       <target dev="tap2d631a76-0d"/>
Nov 06 13:15:52 user nova-compute[74821]:     </interface>
Nov 06 13:15:52 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:15:52 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf/console.log" append="off"/>
Nov 06 13:15:52 user nova-compute[74821]:     </serial>
Nov 06 13:15:52 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:15:52 user nova-compute[74821]:     <video>
Nov 06 13:15:52 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:15:52 user nova-compute[74821]:     </video>
Nov 06 13:15:52 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:15:52 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:15:52 user nova-compute[74821]:     </rng>
Nov 06 13:15:52 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:15:52 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:15:52 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:15:52 user nova-compute[74821]:     </memballoon>
Nov 06 13:15:52 user nova-compute[74821]:   </devices>
Nov 06 13:15:52 user nova-compute[74821]: </domain>
Nov 06 13:15:52 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:15:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-362922964',display_name='tempest-VolumesActionsTest-instance-362922964',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-362922964',id=13,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d784816c0f14c34afecba6292236040',ramdisk_id='',reservation_id='r-8ghcduzw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1240738149',owner_user_name='tempest-VolumesActionsTest-1240738149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:15:50Z,user_data=None,user_id='ee1d041e07fd4b7d8a5fcb864243058c',uuid=f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d631a76-0d6f-4132-a87b-c6baf800c911", "address": "fa:16:3e:9e:a0:c0", "network": {"id": "e73a1b38-3c27-4b87-a0f0-f746711d4363", "bridge": "br-int", "label": "tempest-VolumesActionsTest-544363737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d784816c0f14c34afecba6292236040", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d631a76-0d", "ovs_interfaceid": "2d631a76-0d6f-4132-a87b-c6baf800c911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Converting VIF {"id": "2d631a76-0d6f-4132-a87b-c6baf800c911", "address": "fa:16:3e:9e:a0:c0", "network": {"id": "e73a1b38-3c27-4b87-a0f0-f746711d4363", "bridge": "br-int", "label": "tempest-VolumesActionsTest-544363737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d784816c0f14c34afecba6292236040", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d631a76-0d", "ovs_interfaceid": "2d631a76-0d6f-4132-a87b-c6baf800c911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a0:c0,bridge_name='br-int',has_traffic_filtering=True,id=2d631a76-0d6f-4132-a87b-c6baf800c911,network=Network(e73a1b38-3c27-4b87-a0f0-f746711d4363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d631a76-0d') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG os_vif [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a0:c0,bridge_name='br-int',has_traffic_filtering=True,id=2d631a76-0d6f-4132-a87b-c6baf800c911,network=Network(e73a1b38-3c27-4b87-a0f0-f746711d4363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d631a76-0d') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e9419873-769f-5fef-aa38-c4bedcee14d3', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d631a76-0d, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d631a76-0d, col_values=(('qos', UUID('b7537a9f-fd7a-4279-8f22-66afdd4f5eb6')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d631a76-0d, col_values=(('external_ids', {'iface-id': '2d631a76-0d6f-4132-a87b-c6baf800c911', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:a0:c0', 'vm-uuid': 'f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:52 user nova-compute[74821]: INFO os_vif [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a0:c0,bridge_name='br-int',has_traffic_filtering=True,id=2d631a76-0d6f-4132-a87b-c6baf800c911,network=Network(e73a1b38-3c27-4b87-a0f0-f746711d4363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d631a76-0d')
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] No VIF found with MAC fa:16:3e:9e:a0:c0, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:52 user nova-compute[74821]: DEBUG nova.compute.manager [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:15:53 user nova-compute[74821]: DEBUG nova.compute.manager [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:15:53 user nova-compute[74821]: DEBUG nova.network.neutron [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:15:53 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:15:53 user nova-compute[74821]: DEBUG nova.compute.manager [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:15:53 user nova-compute[74821]: DEBUG nova.policy [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0620d1928d8d434fbe0bc1cdb31a2a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77233758870b4fdfbb7ca76829f0f82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:15:53 user nova-compute[74821]: DEBUG nova.network.neutron [req-fa06c955-e48c-440c-8710-f20bd6e4718a req-224c4d35-e0b4-49a5-afc6-cfe1df946ca0 service nova] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Updated VIF entry in instance network info cache for port 2d631a76-0d6f-4132-a87b-c6baf800c911. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:15:53 user nova-compute[74821]: DEBUG nova.network.neutron [req-fa06c955-e48c-440c-8710-f20bd6e4718a req-224c4d35-e0b4-49a5-afc6-cfe1df946ca0 service nova] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Updating instance_info_cache with network_info: [{"id": "2d631a76-0d6f-4132-a87b-c6baf800c911", "address": "fa:16:3e:9e:a0:c0", "network": {"id": "e73a1b38-3c27-4b87-a0f0-f746711d4363", "bridge": "br-int", "label": "tempest-VolumesActionsTest-544363737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d784816c0f14c34afecba6292236040", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d631a76-0d", "ovs_interfaceid": "2d631a76-0d6f-4132-a87b-c6baf800c911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:15:53 user nova-compute[74821]: DEBUG nova.compute.manager [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:15:53 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:15:53 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Creating image(s)
Nov 06 13:15:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "/opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "/opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "/opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fa06c955-e48c-440c-8710-f20bd6e4718a req-224c4d35-e0b4-49a5-afc6-cfe1df946ca0 service nova] Releasing lock "refresh_cache-f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:15:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.186s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.211s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk 1073741824" returned: 0 in 0.052s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.190s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:53 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:15:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:15:53 user nova-compute[74821]: DEBUG nova.network.neutron [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Successfully created port: 364b4308-8730-4b11-90a1-48ea6ab3de60 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:15:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:15:54 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Cannot resize image /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:15:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:15:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Ensure instance console log exists: /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:15:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:55 user nova-compute[74821]: DEBUG nova.compute.manager [req-a0884175-4d7e-4233-b92f-d671fa5dba12 req-67902182-a66a-4e22-9a58-98318ea975b2 service nova] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Received event network-vif-plugged-2d631a76-0d6f-4132-a87b-c6baf800c911 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:15:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-a0884175-4d7e-4233-b92f-d671fa5dba12 req-67902182-a66a-4e22-9a58-98318ea975b2 service nova] Acquiring lock "f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-a0884175-4d7e-4233-b92f-d671fa5dba12 req-67902182-a66a-4e22-9a58-98318ea975b2 service nova] Lock "f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-a0884175-4d7e-4233-b92f-d671fa5dba12 req-67902182-a66a-4e22-9a58-98318ea975b2 service nova] Lock "f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:55 user nova-compute[74821]: DEBUG nova.compute.manager [req-a0884175-4d7e-4233-b92f-d671fa5dba12 req-67902182-a66a-4e22-9a58-98318ea975b2 service nova] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] No waiting events found dispatching network-vif-plugged-2d631a76-0d6f-4132-a87b-c6baf800c911 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:15:55 user nova-compute[74821]: WARNING nova.compute.manager [req-a0884175-4d7e-4233-b92f-d671fa5dba12 req-67902182-a66a-4e22-9a58-98318ea975b2 service nova] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Received unexpected event network-vif-plugged-2d631a76-0d6f-4132-a87b-c6baf800c911 for instance with vm_state building and task_state spawning.
Nov 06 13:15:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:55 user nova-compute[74821]: DEBUG nova.network.neutron [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Successfully updated port: 364b4308-8730-4b11-90a1-48ea6ab3de60 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:15:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "refresh_cache-2de346cb-9858-47b8-a86c-4fde720d6127" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:15:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquired lock "refresh_cache-2de346cb-9858-47b8-a86c-4fde720d6127" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:15:55 user nova-compute[74821]: DEBUG nova.network.neutron [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:15:55 user nova-compute[74821]: DEBUG nova.network.neutron [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG nova.network.neutron [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Updating instance_info_cache with network_info: [{"id": "364b4308-8730-4b11-90a1-48ea6ab3de60", "address": "fa:16:3e:48:8d:c6", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b4308-87", "ovs_interfaceid": "364b4308-8730-4b11-90a1-48ea6ab3de60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Releasing lock "refresh_cache-2de346cb-9858-47b8-a86c-4fde720d6127" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG nova.compute.manager [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Instance network_info: |[{"id": "364b4308-8730-4b11-90a1-48ea6ab3de60", "address": "fa:16:3e:48:8d:c6", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b4308-87", "ovs_interfaceid": "364b4308-8730-4b11-90a1-48ea6ab3de60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Start _get_guest_xml network_info=[{"id": "364b4308-8730-4b11-90a1-48ea6ab3de60", "address": "fa:16:3e:48:8d:c6", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b4308-87", "ovs_interfaceid": "364b4308-8730-4b11-90a1-48ea6ab3de60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:15:56 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:15:56 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:15:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:15:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1598854789',display_name='tempest-ServerActionsTestOtherA-server-1598854789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1598854789',id=14,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4JiUWhVtBLaIMVWmdaDGfPw0zGPPsGUpSPMYouFUdE8U/JVhpnD9HPYPDsmw237Zq0kahTjlP/cerosJ2tVPbLsi+XC2cHQjqtX7zMb9rwN9mSYsloUtu1O3SiQuCuOw==',key_name='tempest-keypair-1142367632',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77233758870b4fdfbb7ca76829f0f82e',ramdisk_id='',reservation_id='r-78h1l50t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1986828412',owner_user_name='tempest-ServerActionsTestOtherA-1986828412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:15:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0620d1928d8d434fbe0bc1cdb31a2a89',uuid=2de346cb-9858-47b8-a86c-4fde720d6127,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "364b4308-8730-4b11-90a1-48ea6ab3de60", "address": "fa:16:3e:48:8d:c6", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b4308-87", "ovs_interfaceid": "364b4308-8730-4b11-90a1-48ea6ab3de60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Converting VIF {"id": "364b4308-8730-4b11-90a1-48ea6ab3de60", "address": "fa:16:3e:48:8d:c6", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b4308-87", "ovs_interfaceid": "364b4308-8730-4b11-90a1-48ea6ab3de60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:8d:c6,bridge_name='br-int',has_traffic_filtering=True,id=364b4308-8730-4b11-90a1-48ea6ab3de60,network=Network(a3838abe-b3bb-4878-9d5d-eb80a8cf60a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap364b4308-87') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG nova.objects.instance [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lazy-loading 'pci_devices' on Instance uuid 2de346cb-9858-47b8-a86c-4fde720d6127 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:15:56 user nova-compute[74821]:   <uuid>2de346cb-9858-47b8-a86c-4fde720d6127</uuid>
Nov 06 13:15:56 user nova-compute[74821]:   <name>instance-0000000e</name>
Nov 06 13:15:56 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:15:56 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:15:56 user nova-compute[74821]:   <metadata>
Nov 06 13:15:56 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:15:56 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:15:56 user nova-compute[74821]:       <nova:name>tempest-ServerActionsTestOtherA-server-1598854789</nova:name>
Nov 06 13:15:56 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:15:56</nova:creationTime>
Nov 06 13:15:56 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:15:56 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:15:56 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:15:56 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:15:56 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:15:56 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:15:56 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:15:56 user nova-compute[74821]:       <nova:owner>
Nov 06 13:15:56 user nova-compute[74821]:         <nova:user uuid="0620d1928d8d434fbe0bc1cdb31a2a89">tempest-ServerActionsTestOtherA-1986828412-project-member</nova:user>
Nov 06 13:15:56 user nova-compute[74821]:         <nova:project uuid="77233758870b4fdfbb7ca76829f0f82e">tempest-ServerActionsTestOtherA-1986828412</nova:project>
Nov 06 13:15:56 user nova-compute[74821]:       </nova:owner>
Nov 06 13:15:56 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:15:56 user nova-compute[74821]:       <nova:ports>
Nov 06 13:15:56 user nova-compute[74821]:         <nova:port uuid="364b4308-8730-4b11-90a1-48ea6ab3de60">
Nov 06 13:15:56 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 06 13:15:56 user nova-compute[74821]:         </nova:port>
Nov 06 13:15:56 user nova-compute[74821]:       </nova:ports>
Nov 06 13:15:56 user nova-compute[74821]:     </nova:instance>
Nov 06 13:15:56 user nova-compute[74821]:   </metadata>
Nov 06 13:15:56 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:15:56 user nova-compute[74821]:     <system>
Nov 06 13:15:56 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:15:56 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:15:56 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:15:56 user nova-compute[74821]:       <entry name="serial">2de346cb-9858-47b8-a86c-4fde720d6127</entry>
Nov 06 13:15:56 user nova-compute[74821]:       <entry name="uuid">2de346cb-9858-47b8-a86c-4fde720d6127</entry>
Nov 06 13:15:56 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:15:56 user nova-compute[74821]:     </system>
Nov 06 13:15:56 user nova-compute[74821]:   </sysinfo>
Nov 06 13:15:56 user nova-compute[74821]:   <os>
Nov 06 13:15:56 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:15:56 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:15:56 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:15:56 user nova-compute[74821]:   </os>
Nov 06 13:15:56 user nova-compute[74821]:   <features>
Nov 06 13:15:56 user nova-compute[74821]:     <acpi/>
Nov 06 13:15:56 user nova-compute[74821]:     <apic/>
Nov 06 13:15:56 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:15:56 user nova-compute[74821]:   </features>
Nov 06 13:15:56 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:15:56 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:15:56 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:15:56 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:15:56 user nova-compute[74821]:   </clock>
Nov 06 13:15:56 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:15:56 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:15:56 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:15:56 user nova-compute[74821]:   </cpu>
Nov 06 13:15:56 user nova-compute[74821]:   <devices>
Nov 06 13:15:56 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:15:56 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:15:56 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk"/>
Nov 06 13:15:56 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:15:56 user nova-compute[74821]:     </disk>
Nov 06 13:15:56 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:15:56 user nova-compute[74821]:       <mac address="fa:16:3e:48:8d:c6"/>
Nov 06 13:15:56 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:15:56 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:15:56 user nova-compute[74821]:       <target dev="tap364b4308-87"/>
Nov 06 13:15:56 user nova-compute[74821]:     </interface>
Nov 06 13:15:56 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:15:56 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/console.log" append="off"/>
Nov 06 13:15:56 user nova-compute[74821]:     </serial>
Nov 06 13:15:56 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:15:56 user nova-compute[74821]:     <video>
Nov 06 13:15:56 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:15:56 user nova-compute[74821]:     </video>
Nov 06 13:15:56 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:15:56 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:15:56 user nova-compute[74821]:     </rng>
Nov 06 13:15:56 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:15:56 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:15:56 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:15:56 user nova-compute[74821]:     </memballoon>
Nov 06 13:15:56 user nova-compute[74821]:   </devices>
Nov 06 13:15:56 user nova-compute[74821]: </domain>
Nov 06 13:15:56 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:15:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1598854789',display_name='tempest-ServerActionsTestOtherA-server-1598854789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1598854789',id=14,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4JiUWhVtBLaIMVWmdaDGfPw0zGPPsGUpSPMYouFUdE8U/JVhpnD9HPYPDsmw237Zq0kahTjlP/cerosJ2tVPbLsi+XC2cHQjqtX7zMb9rwN9mSYsloUtu1O3SiQuCuOw==',key_name='tempest-keypair-1142367632',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77233758870b4fdfbb7ca76829f0f82e',ramdisk_id='',reservation_id='r-78h1l50t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1986828412',owner_user_name='tempest-ServerActionsTestOtherA-1986828412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:15:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0620d1928d8d434fbe0bc1cdb31a2a89',uuid=2de346cb-9858-47b8-a86c-4fde720d6127,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "364b4308-8730-4b11-90a1-48ea6ab3de60", "address": "fa:16:3e:48:8d:c6", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b4308-87", "ovs_interfaceid": "364b4308-8730-4b11-90a1-48ea6ab3de60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Converting VIF {"id": "364b4308-8730-4b11-90a1-48ea6ab3de60", "address": "fa:16:3e:48:8d:c6", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b4308-87", "ovs_interfaceid": "364b4308-8730-4b11-90a1-48ea6ab3de60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:8d:c6,bridge_name='br-int',has_traffic_filtering=True,id=364b4308-8730-4b11-90a1-48ea6ab3de60,network=Network(a3838abe-b3bb-4878-9d5d-eb80a8cf60a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap364b4308-87') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG os_vif [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:8d:c6,bridge_name='br-int',has_traffic_filtering=True,id=364b4308-8730-4b11-90a1-48ea6ab3de60,network=Network(a3838abe-b3bb-4878-9d5d-eb80a8cf60a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap364b4308-87') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c09b3951-cdb8-56b2-8fbf-cee2631c4821', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap364b4308-87, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap364b4308-87, col_values=(('qos', UUID('c6fdf81c-c61e-4348-931f-402a8cb9a874')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap364b4308-87, col_values=(('external_ids', {'iface-id': '364b4308-8730-4b11-90a1-48ea6ab3de60', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:8d:c6', 'vm-uuid': '2de346cb-9858-47b8-a86c-4fde720d6127'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:56 user nova-compute[74821]: INFO os_vif [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:8d:c6,bridge_name='br-int',has_traffic_filtering=True,id=364b4308-8730-4b11-90a1-48ea6ab3de60,network=Network(a3838abe-b3bb-4878-9d5d-eb80a8cf60a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap364b4308-87')
Nov 06 13:15:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] No VIF found with MAC fa:16:3e:48:8d:c6, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-89ed4cd6-b4e7-4eab-b8b2-0b98ad7845b3 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Acquiring lock "c47906a7-93b9-4527-9318-ed4df54afff6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-89ed4cd6-b4e7-4eab-b8b2-0b98ad7845b3 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Lock "c47906a7-93b9-4527-9318-ed4df54afff6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-89ed4cd6-b4e7-4eab-b8b2-0b98ad7845b3 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Acquiring lock "c47906a7-93b9-4527-9318-ed4df54afff6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-89ed4cd6-b4e7-4eab-b8b2-0b98ad7845b3 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Lock "c47906a7-93b9-4527-9318-ed4df54afff6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.007s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-89ed4cd6-b4e7-4eab-b8b2-0b98ad7845b3 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Lock "c47906a7-93b9-4527-9318-ed4df54afff6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:56 user nova-compute[74821]: INFO nova.compute.manager [None req-89ed4cd6-b4e7-4eab-b8b2-0b98ad7845b3 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Terminating instance
Nov 06 13:15:56 user nova-compute[74821]: DEBUG nova.compute.manager [None req-89ed4cd6-b4e7-4eab-b8b2-0b98ad7845b3 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG nova.compute.manager [req-ec5cffa6-574e-4486-82f3-e10302c5de38 req-80155aad-6180-44c8-88b3-d72adffbe14c service nova] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Received event network-vif-unplugged-e1111ad3-3eff-4594-bbf4-37026e6059c9 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ec5cffa6-574e-4486-82f3-e10302c5de38 req-80155aad-6180-44c8-88b3-d72adffbe14c service nova] Acquiring lock "c47906a7-93b9-4527-9318-ed4df54afff6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ec5cffa6-574e-4486-82f3-e10302c5de38 req-80155aad-6180-44c8-88b3-d72adffbe14c service nova] Lock "c47906a7-93b9-4527-9318-ed4df54afff6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ec5cffa6-574e-4486-82f3-e10302c5de38 req-80155aad-6180-44c8-88b3-d72adffbe14c service nova] Lock "c47906a7-93b9-4527-9318-ed4df54afff6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG nova.compute.manager [req-ec5cffa6-574e-4486-82f3-e10302c5de38 req-80155aad-6180-44c8-88b3-d72adffbe14c service nova] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] No waiting events found dispatching network-vif-unplugged-e1111ad3-3eff-4594-bbf4-37026e6059c9 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:15:56 user nova-compute[74821]: DEBUG nova.compute.manager [req-ec5cffa6-574e-4486-82f3-e10302c5de38 req-80155aad-6180-44c8-88b3-d72adffbe14c service nova] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Received event network-vif-unplugged-e1111ad3-3eff-4594-bbf4-37026e6059c9 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG nova.compute.manager [req-a923aa61-ae7a-4131-b911-12a740d0fd21 req-b11fa5ba-6c63-4da3-9a30-6a0f8133448c service nova] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Received event network-vif-plugged-2d631a76-0d6f-4132-a87b-c6baf800c911 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-a923aa61-ae7a-4131-b911-12a740d0fd21 req-b11fa5ba-6c63-4da3-9a30-6a0f8133448c service nova] Acquiring lock "f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-a923aa61-ae7a-4131-b911-12a740d0fd21 req-b11fa5ba-6c63-4da3-9a30-6a0f8133448c service nova] Lock "f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-a923aa61-ae7a-4131-b911-12a740d0fd21 req-b11fa5ba-6c63-4da3-9a30-6a0f8133448c service nova] Lock "f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG nova.compute.manager [req-a923aa61-ae7a-4131-b911-12a740d0fd21 req-b11fa5ba-6c63-4da3-9a30-6a0f8133448c service nova] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] No waiting events found dispatching network-vif-plugged-2d631a76-0d6f-4132-a87b-c6baf800c911 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:15:57 user nova-compute[74821]: WARNING nova.compute.manager [req-a923aa61-ae7a-4131-b911-12a740d0fd21 req-b11fa5ba-6c63-4da3-9a30-6a0f8133448c service nova] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Received unexpected event network-vif-plugged-2d631a76-0d6f-4132-a87b-c6baf800c911 for instance with vm_state building and task_state spawning.
Nov 06 13:15:57 user nova-compute[74821]: DEBUG nova.compute.manager [req-a923aa61-ae7a-4131-b911-12a740d0fd21 req-b11fa5ba-6c63-4da3-9a30-6a0f8133448c service nova] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Received event network-changed-364b4308-8730-4b11-90a1-48ea6ab3de60 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG nova.compute.manager [req-a923aa61-ae7a-4131-b911-12a740d0fd21 req-b11fa5ba-6c63-4da3-9a30-6a0f8133448c service nova] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Refreshing instance network info cache due to event network-changed-364b4308-8730-4b11-90a1-48ea6ab3de60. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-a923aa61-ae7a-4131-b911-12a740d0fd21 req-b11fa5ba-6c63-4da3-9a30-6a0f8133448c service nova] Acquiring lock "refresh_cache-2de346cb-9858-47b8-a86c-4fde720d6127" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-a923aa61-ae7a-4131-b911-12a740d0fd21 req-b11fa5ba-6c63-4da3-9a30-6a0f8133448c service nova] Acquired lock "refresh_cache-2de346cb-9858-47b8-a86c-4fde720d6127" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG nova.network.neutron [req-a923aa61-ae7a-4131-b911-12a740d0fd21 req-b11fa5ba-6c63-4da3-9a30-6a0f8133448c service nova] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Refreshing network info cache for port 364b4308-8730-4b11-90a1-48ea6ab3de60 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG nova.compute.manager [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG nova.network.neutron [req-a923aa61-ae7a-4131-b911-12a740d0fd21 req-b11fa5ba-6c63-4da3-9a30-6a0f8133448c service nova] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Updated VIF entry in instance network info cache for port 364b4308-8730-4b11-90a1-48ea6ab3de60. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG nova.network.neutron [req-a923aa61-ae7a-4131-b911-12a740d0fd21 req-b11fa5ba-6c63-4da3-9a30-6a0f8133448c service nova] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Updating instance_info_cache with network_info: [{"id": "364b4308-8730-4b11-90a1-48ea6ab3de60", "address": "fa:16:3e:48:8d:c6", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b4308-87", "ovs_interfaceid": "364b4308-8730-4b11-90a1-48ea6ab3de60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:15:57 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Instance spawned successfully.
Nov 06 13:15:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-a923aa61-ae7a-4131-b911-12a740d0fd21 req-b11fa5ba-6c63-4da3-9a30-6a0f8133448c service nova] Releasing lock "refresh_cache-2de346cb-9858-47b8-a86c-4fde720d6127" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:15:57 user nova-compute[74821]: INFO nova.compute.manager [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Took 8.07 seconds to spawn the instance on the hypervisor.
Nov 06 13:15:57 user nova-compute[74821]: DEBUG nova.compute.manager [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:57 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Instance destroyed successfully.
Nov 06 13:15:57 user nova-compute[74821]: DEBUG nova.objects.instance [None req-89ed4cd6-b4e7-4eab-b8b2-0b98ad7845b3 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Lazy-loading 'resources' on Instance uuid c47906a7-93b9-4527-9318-ed4df54afff6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:15:57 user nova-compute[74821]: INFO nova.compute.manager [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Took 9.02 seconds to build instance.
Nov 06 13:15:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-89ed4cd6-b4e7-4eab-b8b2-0b98ad7845b3 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:11:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1705737860',display_name='tempest-TestVolumeSwap-server-1705737860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1705737860',id=8,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwzIGQkiaBcOabZ1GuF11VSMTDR75I4d2JH8P9U+CgjRKP9VtCotLgyifGIp6KTUCcmnIZXx3CUh8O3hgxsEsuBACwGyp9yUiVCl5ib2Mz5WaxyP/GfEY3jbYyzLOr5dQ==',key_name='tempest-keypair-1160391700',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:11:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1004b6aba94b461cb1a149c3c8f6fa4f',ramdisk_id='',reservation_id='r-6243a8ve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-529794034',owner_user_name='tempest-TestVolumeSwap-529794034-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:11:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f087e77432243e09a35d81a7842450e',uuid=c47906a7-93b9-4527-9318-ed4df54afff6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1111ad3-3eff-4594-bbf4-37026e6059c9", "address": "fa:16:3e:16:c8:6f", "network": {"id": "26d82cf9-953f-492e-94b7-ecb500ddaaff", "bridge": "br-int", "label": "tempest-TestVolumeSwap-378439802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1004b6aba94b461cb1a149c3c8f6fa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1111ad3-3e", "ovs_interfaceid": "e1111ad3-3eff-4594-bbf4-37026e6059c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-89ed4cd6-b4e7-4eab-b8b2-0b98ad7845b3 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Converting VIF {"id": "e1111ad3-3eff-4594-bbf4-37026e6059c9", "address": "fa:16:3e:16:c8:6f", "network": {"id": "26d82cf9-953f-492e-94b7-ecb500ddaaff", "bridge": "br-int", "label": "tempest-TestVolumeSwap-378439802-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1004b6aba94b461cb1a149c3c8f6fa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1111ad3-3e", "ovs_interfaceid": "e1111ad3-3eff-4594-bbf4-37026e6059c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-89ed4cd6-b4e7-4eab-b8b2-0b98ad7845b3 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:c8:6f,bridge_name='br-int',has_traffic_filtering=True,id=e1111ad3-3eff-4594-bbf4-37026e6059c9,network=Network(26d82cf9-953f-492e-94b7-ecb500ddaaff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1111ad3-3e') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG os_vif [None req-89ed4cd6-b4e7-4eab-b8b2-0b98ad7845b3 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:c8:6f,bridge_name='br-int',has_traffic_filtering=True,id=e1111ad3-3eff-4594-bbf4-37026e6059c9,network=Network(26d82cf9-953f-492e-94b7-ecb500ddaaff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1111ad3-3e') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1111ad3-3e, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-39eeb195-2544-482f-91b9-a294c01328ad tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Lock "f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.134s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=84b35ea7-35f0-4956-8bbb-f9ec98d083cd) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:57 user nova-compute[74821]: INFO os_vif [None req-89ed4cd6-b4e7-4eab-b8b2-0b98ad7845b3 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:c8:6f,bridge_name='br-int',has_traffic_filtering=True,id=e1111ad3-3eff-4594-bbf4-37026e6059c9,network=Network(26d82cf9-953f-492e-94b7-ecb500ddaaff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1111ad3-3e')
Nov 06 13:15:57 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-89ed4cd6-b4e7-4eab-b8b2-0b98ad7845b3 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Deleting instance files /opt/stack/data/nova/instances/c47906a7-93b9-4527-9318-ed4df54afff6_del
Nov 06 13:15:57 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-89ed4cd6-b4e7-4eab-b8b2-0b98ad7845b3 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Deletion of /opt/stack/data/nova/instances/c47906a7-93b9-4527-9318-ed4df54afff6_del complete
Nov 06 13:15:57 user nova-compute[74821]: INFO nova.compute.manager [None req-89ed4cd6-b4e7-4eab-b8b2-0b98ad7845b3 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Took 1.46 seconds to destroy the instance on the hypervisor.
Nov 06 13:15:57 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-89ed4cd6-b4e7-4eab-b8b2-0b98ad7845b3 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:15:57 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:15:58 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:58 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:58 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:58 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:15:59 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Took 1.03 seconds to deallocate network for instance.
Nov 06 13:15:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-5427ce09-05e9-4dca-b428-ea5560ba79c9 req-cf11042b-2d96-4e80-a5f9-68c5735f71f1 service nova] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Received event network-vif-plugged-e1111ad3-3eff-4594-bbf4-37026e6059c9 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:15:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5427ce09-05e9-4dca-b428-ea5560ba79c9 req-cf11042b-2d96-4e80-a5f9-68c5735f71f1 service nova] Acquiring lock "c47906a7-93b9-4527-9318-ed4df54afff6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5427ce09-05e9-4dca-b428-ea5560ba79c9 req-cf11042b-2d96-4e80-a5f9-68c5735f71f1 service nova] Lock "c47906a7-93b9-4527-9318-ed4df54afff6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5427ce09-05e9-4dca-b428-ea5560ba79c9 req-cf11042b-2d96-4e80-a5f9-68c5735f71f1 service nova] Lock "c47906a7-93b9-4527-9318-ed4df54afff6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-5427ce09-05e9-4dca-b428-ea5560ba79c9 req-cf11042b-2d96-4e80-a5f9-68c5735f71f1 service nova] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] No waiting events found dispatching network-vif-plugged-e1111ad3-3eff-4594-bbf4-37026e6059c9 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:15:59 user nova-compute[74821]: WARNING nova.compute.manager [req-5427ce09-05e9-4dca-b428-ea5560ba79c9 req-cf11042b-2d96-4e80-a5f9-68c5735f71f1 service nova] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Received unexpected event network-vif-plugged-e1111ad3-3eff-4594-bbf4-37026e6059c9 for instance with vm_state active and task_state deleting.
Nov 06 13:15:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-5427ce09-05e9-4dca-b428-ea5560ba79c9 req-cf11042b-2d96-4e80-a5f9-68c5735f71f1 service nova] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Received event network-vif-plugged-364b4308-8730-4b11-90a1-48ea6ab3de60 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:15:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5427ce09-05e9-4dca-b428-ea5560ba79c9 req-cf11042b-2d96-4e80-a5f9-68c5735f71f1 service nova] Acquiring lock "2de346cb-9858-47b8-a86c-4fde720d6127-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5427ce09-05e9-4dca-b428-ea5560ba79c9 req-cf11042b-2d96-4e80-a5f9-68c5735f71f1 service nova] Lock "2de346cb-9858-47b8-a86c-4fde720d6127-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5427ce09-05e9-4dca-b428-ea5560ba79c9 req-cf11042b-2d96-4e80-a5f9-68c5735f71f1 service nova] Lock "2de346cb-9858-47b8-a86c-4fde720d6127-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-5427ce09-05e9-4dca-b428-ea5560ba79c9 req-cf11042b-2d96-4e80-a5f9-68c5735f71f1 service nova] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] No waiting events found dispatching network-vif-plugged-364b4308-8730-4b11-90a1-48ea6ab3de60 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:15:59 user nova-compute[74821]: WARNING nova.compute.manager [req-5427ce09-05e9-4dca-b428-ea5560ba79c9 req-cf11042b-2d96-4e80-a5f9-68c5735f71f1 service nova] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Received unexpected event network-vif-plugged-364b4308-8730-4b11-90a1-48ea6ab3de60 for instance with vm_state building and task_state spawning.
Nov 06 13:15:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-5427ce09-05e9-4dca-b428-ea5560ba79c9 req-cf11042b-2d96-4e80-a5f9-68c5735f71f1 service nova] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Received event network-vif-plugged-364b4308-8730-4b11-90a1-48ea6ab3de60 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:15:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5427ce09-05e9-4dca-b428-ea5560ba79c9 req-cf11042b-2d96-4e80-a5f9-68c5735f71f1 service nova] Acquiring lock "2de346cb-9858-47b8-a86c-4fde720d6127-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5427ce09-05e9-4dca-b428-ea5560ba79c9 req-cf11042b-2d96-4e80-a5f9-68c5735f71f1 service nova] Lock "2de346cb-9858-47b8-a86c-4fde720d6127-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5427ce09-05e9-4dca-b428-ea5560ba79c9 req-cf11042b-2d96-4e80-a5f9-68c5735f71f1 service nova] Lock "2de346cb-9858-47b8-a86c-4fde720d6127-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-5427ce09-05e9-4dca-b428-ea5560ba79c9 req-cf11042b-2d96-4e80-a5f9-68c5735f71f1 service nova] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] No waiting events found dispatching network-vif-plugged-364b4308-8730-4b11-90a1-48ea6ab3de60 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:15:59 user nova-compute[74821]: WARNING nova.compute.manager [req-5427ce09-05e9-4dca-b428-ea5560ba79c9 req-cf11042b-2d96-4e80-a5f9-68c5735f71f1 service nova] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Received unexpected event network-vif-plugged-364b4308-8730-4b11-90a1-48ea6ab3de60 for instance with vm_state building and task_state spawning.
Nov 06 13:15:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-89ed4cd6-b4e7-4eab-b8b2-0b98ad7845b3 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:15:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-89ed4cd6-b4e7-4eab-b8b2-0b98ad7845b3 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:15:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-e688020b-f091-4a5d-ab8c-201f0a16d546 req-098706b7-2bee-4fa6-8564-43fbc5d3910c service nova] [instance: c47906a7-93b9-4527-9318-ed4df54afff6] Received event network-vif-deleted-e1111ad3-3eff-4594-bbf4-37026e6059c9 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:15:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:15:59 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-89ed4cd6-b4e7-4eab-b8b2-0b98ad7845b3 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:15:59 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-89ed4cd6-b4e7-4eab-b8b2-0b98ad7845b3 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:15:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-89ed4cd6-b4e7-4eab-b8b2-0b98ad7845b3 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.452s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:15:59 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-89ed4cd6-b4e7-4eab-b8b2-0b98ad7845b3 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Deleted allocations for instance c47906a7-93b9-4527-9318-ed4df54afff6
Nov 06 13:15:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-89ed4cd6-b4e7-4eab-b8b2-0b98ad7845b3 tempest-TestVolumeSwap-529794034 tempest-TestVolumeSwap-529794034-project-member] Lock "c47906a7-93b9-4527-9318-ed4df54afff6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.216s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:16:00 user nova-compute[74821]: DEBUG nova.compute.manager [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:16:00 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:16:00 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Instance spawned successfully.
Nov 06 13:16:00 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:16:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:16:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:16:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:16:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:16:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:16:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:16:01 user nova-compute[74821]: INFO nova.compute.manager [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Took 7.92 seconds to spawn the instance on the hypervisor.
Nov 06 13:16:01 user nova-compute[74821]: DEBUG nova.compute.manager [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:16:01 user nova-compute[74821]: INFO nova.compute.manager [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Took 8.75 seconds to build instance.
Nov 06 13:16:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-42e8dc22-d00d-414b-b0ba-ce4be1aa699d tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "2de346cb-9858-47b8-a86c-4fde720d6127" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.896s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:16:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:16:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Acquiring lock "129b2a08-6e71-4385-b700-9988b9b737fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:16:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Lock "129b2a08-6e71-4385-b700-9988b9b737fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:16:19 user nova-compute[74821]: DEBUG nova.compute.manager [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:16:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:16:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:16:19 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:16:19 user nova-compute[74821]: INFO nova.compute.claims [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Claim successful on node user
Nov 06 13:16:20 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:16:20 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:16:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:16:20 user nova-compute[74821]: DEBUG nova.compute.manager [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:16:20 user nova-compute[74821]: DEBUG nova.compute.manager [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:16:20 user nova-compute[74821]: DEBUG nova.network.neutron [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:16:20 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:16:20 user nova-compute[74821]: DEBUG nova.compute.manager [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:16:20 user nova-compute[74821]: INFO nova.virt.block_device [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Booting with volume c01ef409-4527-4e30-936c-f700c7b2643e at /dev/vda
Nov 06 13:16:20 user nova-compute[74821]: DEBUG nova.policy [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '068bc256c4cb4a83ab0b008039eaf8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deb2a4a908ee45a9a105374c4220433c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:16:20 user nova-compute[74821]: DEBUG os_brick.utils [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:16:20 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:20 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:20 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[101da3d2-a28d-484f-b2bb-7bf8119f37b1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:16:20 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:20 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:20 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3304ce-c4e0-4013-bccd-84e586b085d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:16:20 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:20 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:20 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[799793c5-707e-4bfa-9934-f76b11b7ca81]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:16:20 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2e43fb-4908-4135-a4d9-8a7141590726]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:16:20 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:20 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:16:20 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:16:20 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:20 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:16:20 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:16:20 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[df946c28-88ef-42bc-a864-f5117109476c]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:16:20 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:16:20 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:16:20 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:16:20 user nova-compute[74821]: DEBUG os_brick.utils [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:16:20 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Updating existing volume attachment record: 5d9443eb-89bd-4985-8c95-e0b50205d7ca {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:16:21 user nova-compute[74821]: DEBUG nova.network.neutron [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Successfully created port: b9af4bc1-4ebd-46e7-a573-1630eef79d5c {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:16:21 user nova-compute[74821]: DEBUG nova.network.neutron [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Successfully created port: ae8e42c0-a0ba-41ac-9a5c-5a8c791f9a1f {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:16:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "5a715806-ff8b-4502-8435-c5de3e3c688a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:16:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "5a715806-ff8b-4502-8435-c5de3e3c688a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:16:22 user nova-compute[74821]: INFO nova.compute.manager [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Detaching volume 5b3cce57-c905-4474-bb23-b3927ad008f3
Nov 06 13:16:22 user nova-compute[74821]: INFO nova.virt.block_device [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Attempting to driver detach volume 5b3cce57-c905-4474-bb23-b3927ad008f3 from mountpoint /dev/vdc
Nov 06 13:16:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Attempting to detach device vdc from instance 5a715806-ff8b-4502-8435-c5de3e3c688a from the persistent domain config. {{(pid=74821) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 13:16:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:16:22 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:16:22 user nova-compute[74821]:   <source dev="/dev/sdf"/>
Nov 06 13:16:22 user nova-compute[74821]:   <target dev="vdc" bus="virtio"/>
Nov 06 13:16:22 user nova-compute[74821]:   <serial>5b3cce57-c905-4474-bb23-b3927ad008f3</serial>
Nov 06 13:16:22 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 06 13:16:22 user nova-compute[74821]: </disk>
Nov 06 13:16:22 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:16:22 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Successfully detached device vdc from instance 5a715806-ff8b-4502-8435-c5de3e3c688a from the persistent domain config.
Nov 06 13:16:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 5a715806-ff8b-4502-8435-c5de3e3c688a from the live domain config. {{(pid=74821) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 13:16:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:16:22 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:16:22 user nova-compute[74821]:   <source dev="/dev/sdf"/>
Nov 06 13:16:22 user nova-compute[74821]:   <target dev="vdc" bus="virtio"/>
Nov 06 13:16:22 user nova-compute[74821]:   <serial>5b3cce57-c905-4474-bb23-b3927ad008f3</serial>
Nov 06 13:16:22 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 06 13:16:22 user nova-compute[74821]: </disk>
Nov 06 13:16:22 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:16:22 user nova-compute[74821]: DEBUG nova.network.neutron [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Successfully created port: 3e5dacb4-e83b-4b50-89c3-4a3d2359f819 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:16:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 5a715806-ff8b-4502-8435-c5de3e3c688a {{(pid=74821) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 13:16:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:23 user nova-compute[74821]: DEBUG nova.network.neutron [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Successfully created port: e4944b6c-81c9-4d2d-8fff-d3d389c3a251 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:16:23 user nova-compute[74821]: DEBUG nova.network.neutron [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Successfully created port: a4a8aaff-5aaf-42ea-874f-ad49ba098d87 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:16:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:24 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:16:25 user nova-compute[74821]: DEBUG nova.network.neutron [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Successfully updated port: b9af4bc1-4ebd-46e7-a573-1630eef79d5c {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:16:25 user nova-compute[74821]: DEBUG nova.compute.manager [req-a5f253fe-19a9-466b-aa7d-0a7eaad24833 req-fe45bfec-a519-4bf1-b6df-a316f535e5ab service nova] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Received event network-changed-b9af4bc1-4ebd-46e7-a573-1630eef79d5c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:16:25 user nova-compute[74821]: DEBUG nova.compute.manager [req-a5f253fe-19a9-466b-aa7d-0a7eaad24833 req-fe45bfec-a519-4bf1-b6df-a316f535e5ab service nova] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Refreshing instance network info cache due to event network-changed-b9af4bc1-4ebd-46e7-a573-1630eef79d5c. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:16:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-a5f253fe-19a9-466b-aa7d-0a7eaad24833 req-fe45bfec-a519-4bf1-b6df-a316f535e5ab service nova] Acquiring lock "refresh_cache-129b2a08-6e71-4385-b700-9988b9b737fa" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:16:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-a5f253fe-19a9-466b-aa7d-0a7eaad24833 req-fe45bfec-a519-4bf1-b6df-a316f535e5ab service nova] Acquired lock "refresh_cache-129b2a08-6e71-4385-b700-9988b9b737fa" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:16:25 user nova-compute[74821]: DEBUG nova.network.neutron [req-a5f253fe-19a9-466b-aa7d-0a7eaad24833 req-fe45bfec-a519-4bf1-b6df-a316f535e5ab service nova] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Refreshing network info cache for port b9af4bc1-4ebd-46e7-a573-1630eef79d5c {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:16:25 user nova-compute[74821]: DEBUG nova.network.neutron [req-a5f253fe-19a9-466b-aa7d-0a7eaad24833 req-fe45bfec-a519-4bf1-b6df-a316f535e5ab service nova] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:16:25 user nova-compute[74821]: DEBUG nova.network.neutron [req-a5f253fe-19a9-466b-aa7d-0a7eaad24833 req-fe45bfec-a519-4bf1-b6df-a316f535e5ab service nova] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:16:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-a5f253fe-19a9-466b-aa7d-0a7eaad24833 req-fe45bfec-a519-4bf1-b6df-a316f535e5ab service nova] Releasing lock "refresh_cache-129b2a08-6e71-4385-b700-9988b9b737fa" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:16:25 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:16:25 user nova-compute[74821]: DEBUG nova.network.neutron [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Successfully updated port: 951bf67b-ccde-4bd6-b40f-3a2a4d7c2dee {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:16:25 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:16:26 user nova-compute[74821]: DEBUG nova.network.neutron [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Successfully updated port: c780cd18-a22e-4516-8628-042d7b5baa2a {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:16:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:27 user nova-compute[74821]: DEBUG nova.compute.manager [req-8b258538-2904-4705-a89a-c92b6902c7bf req-89f0bbe2-5dcc-4316-a671-af5cac6277ce service nova] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Received event network-changed-951bf67b-ccde-4bd6-b40f-3a2a4d7c2dee {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:16:27 user nova-compute[74821]: DEBUG nova.compute.manager [req-8b258538-2904-4705-a89a-c92b6902c7bf req-89f0bbe2-5dcc-4316-a671-af5cac6277ce service nova] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Refreshing instance network info cache due to event network-changed-951bf67b-ccde-4bd6-b40f-3a2a4d7c2dee. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:16:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8b258538-2904-4705-a89a-c92b6902c7bf req-89f0bbe2-5dcc-4316-a671-af5cac6277ce service nova] Acquiring lock "refresh_cache-129b2a08-6e71-4385-b700-9988b9b737fa" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:16:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8b258538-2904-4705-a89a-c92b6902c7bf req-89f0bbe2-5dcc-4316-a671-af5cac6277ce service nova] Acquired lock "refresh_cache-129b2a08-6e71-4385-b700-9988b9b737fa" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:16:27 user nova-compute[74821]: DEBUG nova.network.neutron [req-8b258538-2904-4705-a89a-c92b6902c7bf req-89f0bbe2-5dcc-4316-a671-af5cac6277ce service nova] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Refreshing network info cache for port 951bf67b-ccde-4bd6-b40f-3a2a4d7c2dee {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:16:27 user nova-compute[74821]: DEBUG nova.network.neutron [req-8b258538-2904-4705-a89a-c92b6902c7bf req-89f0bbe2-5dcc-4316-a671-af5cac6277ce service nova] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:16:27 user nova-compute[74821]: DEBUG nova.network.neutron [req-8b258538-2904-4705-a89a-c92b6902c7bf req-89f0bbe2-5dcc-4316-a671-af5cac6277ce service nova] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:16:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8b258538-2904-4705-a89a-c92b6902c7bf req-89f0bbe2-5dcc-4316-a671-af5cac6277ce service nova] Releasing lock "refresh_cache-129b2a08-6e71-4385-b700-9988b9b737fa" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:16:27 user nova-compute[74821]: DEBUG nova.compute.manager [req-8b258538-2904-4705-a89a-c92b6902c7bf req-89f0bbe2-5dcc-4316-a671-af5cac6277ce service nova] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Received event network-changed-c780cd18-a22e-4516-8628-042d7b5baa2a {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:16:27 user nova-compute[74821]: DEBUG nova.compute.manager [req-8b258538-2904-4705-a89a-c92b6902c7bf req-89f0bbe2-5dcc-4316-a671-af5cac6277ce service nova] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Refreshing instance network info cache due to event network-changed-c780cd18-a22e-4516-8628-042d7b5baa2a. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:16:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8b258538-2904-4705-a89a-c92b6902c7bf req-89f0bbe2-5dcc-4316-a671-af5cac6277ce service nova] Acquiring lock "refresh_cache-129b2a08-6e71-4385-b700-9988b9b737fa" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:16:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8b258538-2904-4705-a89a-c92b6902c7bf req-89f0bbe2-5dcc-4316-a671-af5cac6277ce service nova] Acquired lock "refresh_cache-129b2a08-6e71-4385-b700-9988b9b737fa" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:16:27 user nova-compute[74821]: DEBUG nova.network.neutron [req-8b258538-2904-4705-a89a-c92b6902c7bf req-89f0bbe2-5dcc-4316-a671-af5cac6277ce service nova] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Refreshing network info cache for port c780cd18-a22e-4516-8628-042d7b5baa2a {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:16:27 user nova-compute[74821]: DEBUG nova.network.neutron [req-8b258538-2904-4705-a89a-c92b6902c7bf req-89f0bbe2-5dcc-4316-a671-af5cac6277ce service nova] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:16:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:27 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:16:27 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:16:27 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:16:27 user nova-compute[74821]: DEBUG nova.network.neutron [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Successfully updated port: ae8e42c0-a0ba-41ac-9a5c-5a8c791f9a1f {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:16:28 user nova-compute[74821]: DEBUG nova.network.neutron [req-8b258538-2904-4705-a89a-c92b6902c7bf req-89f0bbe2-5dcc-4316-a671-af5cac6277ce service nova] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:16:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-311817c5-7b08-4da9-98eb-c685f37e6fd3" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:16:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-311817c5-7b08-4da9-98eb-c685f37e6fd3" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:16:28 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:16:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8b258538-2904-4705-a89a-c92b6902c7bf req-89f0bbe2-5dcc-4316-a671-af5cac6277ce service nova] Releasing lock "refresh_cache-129b2a08-6e71-4385-b700-9988b9b737fa" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:16:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:28 user nova-compute[74821]: DEBUG nova.network.neutron [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Successfully updated port: 3e5dacb4-e83b-4b50-89c3-4a3d2359f819 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:16:29 user nova-compute[74821]: DEBUG nova.compute.manager [req-98154067-123b-4471-a56d-d0558a05f54f req-9535cb87-bf49-49b9-b1af-591407e09463 service nova] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Received event network-changed-3e5dacb4-e83b-4b50-89c3-4a3d2359f819 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:16:29 user nova-compute[74821]: DEBUG nova.compute.manager [req-98154067-123b-4471-a56d-d0558a05f54f req-9535cb87-bf49-49b9-b1af-591407e09463 service nova] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Refreshing instance network info cache due to event network-changed-3e5dacb4-e83b-4b50-89c3-4a3d2359f819. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:16:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-98154067-123b-4471-a56d-d0558a05f54f req-9535cb87-bf49-49b9-b1af-591407e09463 service nova] Acquiring lock "refresh_cache-129b2a08-6e71-4385-b700-9988b9b737fa" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:16:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-98154067-123b-4471-a56d-d0558a05f54f req-9535cb87-bf49-49b9-b1af-591407e09463 service nova] Acquired lock "refresh_cache-129b2a08-6e71-4385-b700-9988b9b737fa" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:16:29 user nova-compute[74821]: DEBUG nova.network.neutron [req-98154067-123b-4471-a56d-d0558a05f54f req-9535cb87-bf49-49b9-b1af-591407e09463 service nova] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Refreshing network info cache for port 3e5dacb4-e83b-4b50-89c3-4a3d2359f819 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:16:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:29 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Updating instance_info_cache with network_info: [{"id": "be99c620-c497-4810-8aac-8793f2b2baa7", "address": "fa:16:3e:2e:e6:6b", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe99c620-c4", "ovs_interfaceid": "be99c620-c497-4810-8aac-8793f2b2baa7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:16:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-311817c5-7b08-4da9-98eb-c685f37e6fd3" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:16:29 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:16:29 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:16:29 user nova-compute[74821]: DEBUG nova.network.neutron [req-98154067-123b-4471-a56d-d0558a05f54f req-9535cb87-bf49-49b9-b1af-591407e09463 service nova] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:16:29 user nova-compute[74821]: DEBUG nova.compute.manager [req-e2a49cf1-e3a7-4f38-ba47-d7b426c337c5 req-4f8c6829-8851-487c-a120-e4c72d846f1c service nova] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Received event network-changed-ae8e42c0-a0ba-41ac-9a5c-5a8c791f9a1f {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:16:29 user nova-compute[74821]: DEBUG nova.compute.manager [req-e2a49cf1-e3a7-4f38-ba47-d7b426c337c5 req-4f8c6829-8851-487c-a120-e4c72d846f1c service nova] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Refreshing instance network info cache due to event network-changed-ae8e42c0-a0ba-41ac-9a5c-5a8c791f9a1f. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:16:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e2a49cf1-e3a7-4f38-ba47-d7b426c337c5 req-4f8c6829-8851-487c-a120-e4c72d846f1c service nova] Acquiring lock "refresh_cache-129b2a08-6e71-4385-b700-9988b9b737fa" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:16:29 user nova-compute[74821]: DEBUG nova.network.neutron [req-98154067-123b-4471-a56d-d0558a05f54f req-9535cb87-bf49-49b9-b1af-591407e09463 service nova] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:16:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-98154067-123b-4471-a56d-d0558a05f54f req-9535cb87-bf49-49b9-b1af-591407e09463 service nova] Releasing lock "refresh_cache-129b2a08-6e71-4385-b700-9988b9b737fa" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:16:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e2a49cf1-e3a7-4f38-ba47-d7b426c337c5 req-4f8c6829-8851-487c-a120-e4c72d846f1c service nova] Acquired lock "refresh_cache-129b2a08-6e71-4385-b700-9988b9b737fa" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:16:29 user nova-compute[74821]: DEBUG nova.network.neutron [req-e2a49cf1-e3a7-4f38-ba47-d7b426c337c5 req-4f8c6829-8851-487c-a120-e4c72d846f1c service nova] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Refreshing network info cache for port ae8e42c0-a0ba-41ac-9a5c-5a8c791f9a1f {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:16:29 user nova-compute[74821]: DEBUG nova.network.neutron [req-e2a49cf1-e3a7-4f38-ba47-d7b426c337c5 req-4f8c6829-8851-487c-a120-e4c72d846f1c service nova] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:16:29 user nova-compute[74821]: DEBUG nova.network.neutron [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Successfully updated port: e4944b6c-81c9-4d2d-8fff-d3d389c3a251 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:16:29 user nova-compute[74821]: DEBUG nova.network.neutron [req-e2a49cf1-e3a7-4f38-ba47-d7b426c337c5 req-4f8c6829-8851-487c-a120-e4c72d846f1c service nova] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:16:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e2a49cf1-e3a7-4f38-ba47-d7b426c337c5 req-4f8c6829-8851-487c-a120-e4c72d846f1c service nova] Releasing lock "refresh_cache-129b2a08-6e71-4385-b700-9988b9b737fa" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:16:29 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:16:29 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:16:29 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:16:29 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:16:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:16:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:16:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:16:29 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:16:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:30 user nova-compute[74821]: DEBUG nova.network.neutron [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Successfully updated port: a4a8aaff-5aaf-42ea-874f-ad49ba098d87 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:16:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Acquiring lock "refresh_cache-129b2a08-6e71-4385-b700-9988b9b737fa" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:16:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Acquired lock "refresh_cache-129b2a08-6e71-4385-b700-9988b9b737fa" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:16:30 user nova-compute[74821]: DEBUG nova.network.neutron [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:16:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:30 user nova-compute[74821]: DEBUG nova.network.neutron [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:16:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:31 user nova-compute[74821]: DEBUG nova.compute.manager [req-d93fef66-3d39-4902-a785-d569b011f972 req-7fb01a6c-4aeb-4f1e-92d3-5ac054baa416 service nova] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Received event network-changed-e4944b6c-81c9-4d2d-8fff-d3d389c3a251 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:16:31 user nova-compute[74821]: DEBUG nova.compute.manager [req-d93fef66-3d39-4902-a785-d569b011f972 req-7fb01a6c-4aeb-4f1e-92d3-5ac054baa416 service nova] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Refreshing instance network info cache due to event network-changed-e4944b6c-81c9-4d2d-8fff-d3d389c3a251. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:16:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d93fef66-3d39-4902-a785-d569b011f972 req-7fb01a6c-4aeb-4f1e-92d3-5ac054baa416 service nova] Acquiring lock "refresh_cache-129b2a08-6e71-4385-b700-9988b9b737fa" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:16:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk.rescue --force-share --output=json" returned: 0 in 0.225s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:16:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:16:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:16:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:33 user nova-compute[74821]: DEBUG nova.network.neutron [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Updating instance_info_cache with network_info: [{"id": "b9af4bc1-4ebd-46e7-a573-1630eef79d5c", "address": "fa:16:3e:1b:19:75", "network": {"id": "deb9725b-a62e-4cb4-b6db-297ff4695d35", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1344158242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9af4bc1-4e", "ovs_interfaceid": "b9af4bc1-4ebd-46e7-a573-1630eef79d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "951bf67b-ccde-4bd6-b40f-3a2a4d7c2dee", "address": "fa:16:3e:1a:4e:5b", "network": {"id": "c1d19f2a-0571-4144-bedb-4f2d9ca7fd7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-861526093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951bf67b-cc", "ovs_interfaceid": "951bf67b-ccde-4bd6-b40f-3a2a4d7c2dee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c780cd18-a22e-4516-8628-042d7b5baa2a", "address": "fa:16:3e:37:47:2a", "network": {"id": "c1d19f2a-0571-4144-bedb-4f2d9ca7fd7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-861526093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc780cd18-a2", "ovs_interfaceid": "c780cd18-a22e-4516-8628-042d7b5baa2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ae8e42c0-a0ba-41ac-9a5c-5a8c791f9a1f", "address": "fa:16:3e:47:79:eb", "network": {"id": "c1d19f2a-0571-4144-bedb-4f2d9ca7fd7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-861526093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8e42c0-a0", "ovs_interfaceid": "ae8e42c0-a0ba-41ac-9a5c-5a8c791f9a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3e5dacb4-e83b-4b50-89c3-4a3d2359f819", "address": "fa:16:3e:dc:26:fa", "network": {"id": "c1d19f2a-0571-4144-bedb-4f2d9ca7fd7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-861526093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e5dacb4-e8", "ovs_interfaceid": "3e5dacb4-e83b-4b50-89c3-4a3d2359f819", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4944b6c-81c9-4d2d-8fff-d3d389c3a251", "address": "fa:16:3e:00:98:fc", "network": {"id": "b9d4a482-bbdd-4647-bbb8-881cf9923eb3", "bridge": "br-int", "label": "tempest-device-tagging-net2-718261885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4944b6c-81", "ovs_interfaceid": "e4944b6c-81c9-4d2d-8fff-d3d389c3a251", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4a8aaff-5aaf-42ea-874f-ad49ba098d87", "address": "fa:16:3e:01:1b:21", "network": {"id": "b9d4a482-bbdd-4647-bbb8-881cf9923eb3", "bridge": "br-int", "label": "tempest-device-tagging-net2-718261885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a8aaff-5a", "ovs_interfaceid": "a4a8aaff-5aaf-42ea-874f-ad49ba098d87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:16:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Releasing lock "refresh_cache-129b2a08-6e71-4385-b700-9988b9b737fa" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:16:33 user nova-compute[74821]: DEBUG nova.compute.manager [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Instance network_info: |[{"id": "b9af4bc1-4ebd-46e7-a573-1630eef79d5c", "address": "fa:16:3e:1b:19:75", "network": {"id": "deb9725b-a62e-4cb4-b6db-297ff4695d35", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1344158242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9af4bc1-4e", "ovs_interfaceid": "b9af4bc1-4ebd-46e7-a573-1630eef79d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "951bf67b-ccde-4bd6-b40f-3a2a4d7c2dee", "address": "fa:16:3e:1a:4e:5b", "network": {"id": "c1d19f2a-0571-4144-bedb-4f2d9ca7fd7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-861526093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951bf67b-cc", "ovs_interfaceid": "951bf67b-ccde-4bd6-b40f-3a2a4d7c2dee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c780cd18-a22e-4516-8628-042d7b5baa2a", "address": "fa:16:3e:37:47:2a", "network": {"id": "c1d19f2a-0571-4144-bedb-4f2d9ca7fd7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-861526093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc780cd18-a2", "ovs_interfaceid": "c780cd18-a22e-4516-8628-042d7b5baa2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ae8e42c0-a0ba-41ac-9a5c-5a8c791f9a1f", "address": "fa:16:3e:47:79:eb", "network": {"id": "c1d19f2a-0571-4144-bedb-4f2d9ca7fd7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-861526093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8e42c0-a0", "ovs_interfaceid": "ae8e42c0-a0ba-41ac-9a5c-5a8c791f9a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3e5dacb4-e83b-4b50-89c3-4a3d2359f819", "address": "fa:16:3e:dc:26:fa", "network": {"id": "c1d19f2a-0571-4144-bedb-4f2d9ca7fd7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-861526093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e5dacb4-e8", "ovs_interfaceid": "3e5dacb4-e83b-4b50-89c3-4a3d2359f819", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4944b6c-81c9-4d2d-8fff-d3d389c3a251", "address": "fa:16:3e:00:98:fc", "network": {"id": "b9d4a482-bbdd-4647-bbb8-881cf9923eb3", "bridge": "br-int", "label": "tempest-device-tagging-net2-718261885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4944b6c-81", "ovs_interfaceid": "e4944b6c-81c9-4d2d-8fff-d3d389c3a251", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4a8aaff-5aaf-42ea-874f-ad49ba098d87", "address": "fa:16:3e:01:1b:21", "network": {"id": "b9d4a482-bbdd-4647-bbb8-881cf9923eb3", "bridge": "br-int", "label": "tempest-device-tagging-net2-718261885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a8aaff-5a", "ovs_interfaceid": "a4a8aaff-5aaf-42ea-874f-ad49ba098d87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:16:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d93fef66-3d39-4902-a785-d569b011f972 req-7fb01a6c-4aeb-4f1e-92d3-5ac054baa416 service nova] Acquired lock "refresh_cache-129b2a08-6e71-4385-b700-9988b9b737fa" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:16:33 user nova-compute[74821]: DEBUG nova.network.neutron [req-d93fef66-3d39-4902-a785-d569b011f972 req-7fb01a6c-4aeb-4f1e-92d3-5ac054baa416 service nova] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Refreshing network info cache for port e4944b6c-81c9-4d2d-8fff-d3d389c3a251 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:16:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:34 user nova-compute[74821]: DEBUG nova.network.neutron [req-d93fef66-3d39-4902-a785-d569b011f972 req-7fb01a6c-4aeb-4f1e-92d3-5ac054baa416 service nova] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Updated VIF entry in instance network info cache for port e4944b6c-81c9-4d2d-8fff-d3d389c3a251. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:16:34 user nova-compute[74821]: DEBUG nova.network.neutron [req-d93fef66-3d39-4902-a785-d569b011f972 req-7fb01a6c-4aeb-4f1e-92d3-5ac054baa416 service nova] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Updating instance_info_cache with network_info: [{"id": "b9af4bc1-4ebd-46e7-a573-1630eef79d5c", "address": "fa:16:3e:1b:19:75", "network": {"id": "deb9725b-a62e-4cb4-b6db-297ff4695d35", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1344158242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9af4bc1-4e", "ovs_interfaceid": "b9af4bc1-4ebd-46e7-a573-1630eef79d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "951bf67b-ccde-4bd6-b40f-3a2a4d7c2dee", "address": "fa:16:3e:1a:4e:5b", "network": {"id": "c1d19f2a-0571-4144-bedb-4f2d9ca7fd7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-861526093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951bf67b-cc", "ovs_interfaceid": "951bf67b-ccde-4bd6-b40f-3a2a4d7c2dee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c780cd18-a22e-4516-8628-042d7b5baa2a", "address": "fa:16:3e:37:47:2a", "network": {"id": "c1d19f2a-0571-4144-bedb-4f2d9ca7fd7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-861526093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc780cd18-a2", "ovs_interfaceid": "c780cd18-a22e-4516-8628-042d7b5baa2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ae8e42c0-a0ba-41ac-9a5c-5a8c791f9a1f", "address": "fa:16:3e:47:79:eb", "network": {"id": "c1d19f2a-0571-4144-bedb-4f2d9ca7fd7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-861526093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8e42c0-a0", "ovs_interfaceid": "ae8e42c0-a0ba-41ac-9a5c-5a8c791f9a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3e5dacb4-e83b-4b50-89c3-4a3d2359f819", "address": "fa:16:3e:dc:26:fa", "network": {"id": "c1d19f2a-0571-4144-bedb-4f2d9ca7fd7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-861526093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e5dacb4-e8", "ovs_interfaceid": "3e5dacb4-e83b-4b50-89c3-4a3d2359f819", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4944b6c-81c9-4d2d-8fff-d3d389c3a251", "address": "fa:16:3e:00:98:fc", "network": {"id": "b9d4a482-bbdd-4647-bbb8-881cf9923eb3", "bridge": "br-int", "label": "tempest-device-tagging-net2-718261885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4944b6c-81", "ovs_interfaceid": "e4944b6c-81c9-4d2d-8fff-d3d389c3a251", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4a8aaff-5aaf-42ea-874f-ad49ba098d87", "address": "fa:16:3e:01:1b:21", "network": {"id": "b9d4a482-bbdd-4647-bbb8-881cf9923eb3", "bridge": "br-int", "label": "tempest-device-tagging-net2-718261885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a8aaff-5a", "ovs_interfaceid": "a4a8aaff-5aaf-42ea-874f-ad49ba098d87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:16:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:34 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:16:34 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:16:34 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=7780MB free_disk=25.625011444091797GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:16:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:16:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:16:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d93fef66-3d39-4902-a785-d569b011f972 req-7fb01a6c-4aeb-4f1e-92d3-5ac054baa416 service nova] Releasing lock "refresh_cache-129b2a08-6e71-4385-b700-9988b9b737fa" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:16:34 user nova-compute[74821]: DEBUG nova.compute.manager [req-d93fef66-3d39-4902-a785-d569b011f972 req-7fb01a6c-4aeb-4f1e-92d3-5ac054baa416 service nova] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Received event network-changed-a4a8aaff-5aaf-42ea-874f-ad49ba098d87 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:16:34 user nova-compute[74821]: DEBUG nova.compute.manager [req-d93fef66-3d39-4902-a785-d569b011f972 req-7fb01a6c-4aeb-4f1e-92d3-5ac054baa416 service nova] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Refreshing instance network info cache due to event network-changed-a4a8aaff-5aaf-42ea-874f-ad49ba098d87. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:16:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d93fef66-3d39-4902-a785-d569b011f972 req-7fb01a6c-4aeb-4f1e-92d3-5ac054baa416 service nova] Acquiring lock "refresh_cache-129b2a08-6e71-4385-b700-9988b9b737fa" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:16:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d93fef66-3d39-4902-a785-d569b011f972 req-7fb01a6c-4aeb-4f1e-92d3-5ac054baa416 service nova] Acquired lock "refresh_cache-129b2a08-6e71-4385-b700-9988b9b737fa" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:16:34 user nova-compute[74821]: DEBUG nova.network.neutron [req-d93fef66-3d39-4902-a785-d569b011f972 req-7fb01a6c-4aeb-4f1e-92d3-5ac054baa416 service nova] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Refreshing network info cache for port a4a8aaff-5aaf-42ea-874f-ad49ba098d87 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:16:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:34 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 3e21d005-f190-478a-a911-e483e1235057 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:16:34 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 311817c5-7b08-4da9-98eb-c685f37e6fd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:16:34 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance f8c537c6-fa3e-4842-9471-7258a22c01f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:16:34 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance a33991ce-e911-460d-a6d9-ca738830ef2c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:16:34 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 5a715806-ff8b-4502-8435-c5de3e3c688a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:16:34 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:16:34 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 2de346cb-9858-47b8-a86c-4fde720d6127 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:16:34 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 129b2a08-6e71-4385-b700-9988b9b737fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:16:34 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:16:34 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:16:34 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Refreshing inventories for resource provider a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 13:16:34 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Updating ProviderTree inventory for provider a45ec519-15f5-48fe-877b-466db09f8afe from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 13:16:34 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Updating inventory in ProviderTree for provider a45ec519-15f5-48fe-877b-466db09f8afe with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 13:16:34 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Refreshing aggregate associations for resource provider a45ec519-15f5-48fe-877b-466db09f8afe, aggregates: None {{(pid=74821) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 13:16:34 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Refreshing trait associations for resource provider a45ec519-15f5-48fe-877b-466db09f8afe, traits: COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42 {{(pid=74821) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 13:16:34 user nova-compute[74821]: DEBUG nova.network.neutron [req-d93fef66-3d39-4902-a785-d569b011f972 req-7fb01a6c-4aeb-4f1e-92d3-5ac054baa416 service nova] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Updated VIF entry in instance network info cache for port a4a8aaff-5aaf-42ea-874f-ad49ba098d87. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:16:34 user nova-compute[74821]: DEBUG nova.network.neutron [req-d93fef66-3d39-4902-a785-d569b011f972 req-7fb01a6c-4aeb-4f1e-92d3-5ac054baa416 service nova] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Updating instance_info_cache with network_info: [{"id": "b9af4bc1-4ebd-46e7-a573-1630eef79d5c", "address": "fa:16:3e:1b:19:75", "network": {"id": "deb9725b-a62e-4cb4-b6db-297ff4695d35", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1344158242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9af4bc1-4e", "ovs_interfaceid": "b9af4bc1-4ebd-46e7-a573-1630eef79d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "951bf67b-ccde-4bd6-b40f-3a2a4d7c2dee", "address": "fa:16:3e:1a:4e:5b", "network": {"id": "c1d19f2a-0571-4144-bedb-4f2d9ca7fd7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-861526093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951bf67b-cc", "ovs_interfaceid": "951bf67b-ccde-4bd6-b40f-3a2a4d7c2dee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c780cd18-a22e-4516-8628-042d7b5baa2a", "address": "fa:16:3e:37:47:2a", "network": {"id": "c1d19f2a-0571-4144-bedb-4f2d9ca7fd7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-861526093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc780cd18-a2", "ovs_interfaceid": "c780cd18-a22e-4516-8628-042d7b5baa2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ae8e42c0-a0ba-41ac-9a5c-5a8c791f9a1f", "address": "fa:16:3e:47:79:eb", "network": {"id": "c1d19f2a-0571-4144-bedb-4f2d9ca7fd7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-861526093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8e42c0-a0", "ovs_interfaceid": "ae8e42c0-a0ba-41ac-9a5c-5a8c791f9a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3e5dacb4-e83b-4b50-89c3-4a3d2359f819", "address": "fa:16:3e:dc:26:fa", "network": {"id": "c1d19f2a-0571-4144-bedb-4f2d9ca7fd7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-861526093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e5dacb4-e8", "ovs_interfaceid": "3e5dacb4-e83b-4b50-89c3-4a3d2359f819", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4944b6c-81c9-4d2d-8fff-d3d389c3a251", "address": "fa:16:3e:00:98:fc", "network": {"id": "b9d4a482-bbdd-4647-bbb8-881cf9923eb3", "bridge": "br-int", "label": "tempest-device-tagging-net2-718261885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4944b6c-81", "ovs_interfaceid": "e4944b6c-81c9-4d2d-8fff-d3d389c3a251", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4a8aaff-5aaf-42ea-874f-ad49ba098d87", "address": "fa:16:3e:01:1b:21", "network": {"id": "b9d4a482-bbdd-4647-bbb8-881cf9923eb3", "bridge": "br-int", "label": "tempest-device-tagging-net2-718261885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a8aaff-5a", "ovs_interfaceid": "a4a8aaff-5aaf-42ea-874f-ad49ba098d87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:16:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d93fef66-3d39-4902-a785-d569b011f972 req-7fb01a6c-4aeb-4f1e-92d3-5ac054baa416 service nova] Releasing lock "refresh_cache-129b2a08-6e71-4385-b700-9988b9b737fa" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:16:35 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:16:35 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:16:35 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:16:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.851s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:16:35 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:16:35 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Cleaning up deleted instances {{(pid=74821) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 13:16:35 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] There are 0 instances to clean {{(pid=74821) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 13:16:35 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:16:35 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Cleaning up deleted instances with incomplete migration  {{(pid=74821) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 13:16:35 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:16:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:37 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:16:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "49c65aca-8392-46ba-8fa3-b47ff2416cb9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:16:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "49c65aca-8392-46ba-8fa3-b47ff2416cb9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:16:38 user nova-compute[74821]: DEBUG nova.compute.manager [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:16:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:16:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:16:38 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:16:38 user nova-compute[74821]: INFO nova.compute.claims [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Claim successful on node user
Nov 06 13:16:38 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:16:38 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:16:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.385s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:16:38 user nova-compute[74821]: DEBUG nova.compute.manager [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:16:38 user nova-compute[74821]: DEBUG nova.compute.manager [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:16:38 user nova-compute[74821]: DEBUG nova.network.neutron [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:16:38 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:16:38 user nova-compute[74821]: DEBUG nova.compute.manager [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:16:38 user nova-compute[74821]: DEBUG nova.policy [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '133932d1063241078d84731624e89216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745a322931e4150b12d139bfb17b94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:16:39 user nova-compute[74821]: DEBUG nova.compute.manager [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:16:39 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:16:39 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Creating image(s)
Nov 06 13:16:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "/opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:16:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "/opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:16:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "/opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:16:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.193s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:16:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:16:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.194s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:39 user nova-compute[74821]: DEBUG nova.network.neutron [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Successfully created port: 2000e5c8-e30c-44d9-b79c-fac8a9039c49 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:16:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk 1073741824" returned: 0 in 0.052s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:16:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.300s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:39 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Checking if we can resize image /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:16:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Cannot resize image /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Ensure instance console log exists: /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.network.neutron [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Successfully updated port: 2000e5c8-e30c-44d9-b79c-fac8a9039c49 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "refresh_cache-49c65aca-8392-46ba-8fa3-b47ff2416cb9" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquired lock "refresh_cache-49c65aca-8392-46ba-8fa3-b47ff2416cb9" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.network.neutron [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.compute.manager [req-607b7782-dd84-44c1-afb6-d30eb65b5f03 req-0cb9511d-fd70-4985-adfb-704df50b3755 service nova] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Received event network-changed-2000e5c8-e30c-44d9-b79c-fac8a9039c49 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.compute.manager [req-607b7782-dd84-44c1-afb6-d30eb65b5f03 req-0cb9511d-fd70-4985-adfb-704df50b3755 service nova] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Refreshing instance network info cache due to event network-changed-2000e5c8-e30c-44d9-b79c-fac8a9039c49. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-607b7782-dd84-44c1-afb6-d30eb65b5f03 req-0cb9511d-fd70-4985-adfb-704df50b3755 service nova] Acquiring lock "refresh_cache-49c65aca-8392-46ba-8fa3-b47ff2416cb9" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.network.neutron [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.network.neutron [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Updating instance_info_cache with network_info: [{"id": "2000e5c8-e30c-44d9-b79c-fac8a9039c49", "address": "fa:16:3e:06:9f:52", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2000e5c8-e3", "ovs_interfaceid": "2000e5c8-e30c-44d9-b79c-fac8a9039c49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Releasing lock "refresh_cache-49c65aca-8392-46ba-8fa3-b47ff2416cb9" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.compute.manager [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Instance network_info: |[{"id": "2000e5c8-e30c-44d9-b79c-fac8a9039c49", "address": "fa:16:3e:06:9f:52", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2000e5c8-e3", "ovs_interfaceid": "2000e5c8-e30c-44d9-b79c-fac8a9039c49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-607b7782-dd84-44c1-afb6-d30eb65b5f03 req-0cb9511d-fd70-4985-adfb-704df50b3755 service nova] Acquired lock "refresh_cache-49c65aca-8392-46ba-8fa3-b47ff2416cb9" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.network.neutron [req-607b7782-dd84-44c1-afb6-d30eb65b5f03 req-0cb9511d-fd70-4985-adfb-704df50b3755 service nova] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Refreshing network info cache for port 2000e5c8-e30c-44d9-b79c-fac8a9039c49 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Start _get_guest_xml network_info=[{"id": "2000e5c8-e30c-44d9-b79c-fac8a9039c49", "address": "fa:16:3e:06:9f:52", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2000e5c8-e3", "ovs_interfaceid": "2000e5c8-e30c-44d9-b79c-fac8a9039c49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:16:40 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:16:40 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:16:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1651102471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1651102471',id=16,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f745a322931e4150b12d139bfb17b94c',ramdisk_id='',reservation_id='r-3r89gq7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1064633830',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:16:39Z,user_data=None,user_id='133932d1063241078d84731624e89216',uuid=49c65aca-8392-46ba-8fa3-b47ff2416cb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2000e5c8-e30c-44d9-b79c-fac8a9039c49", "address": "fa:16:3e:06:9f:52", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2000e5c8-e3", "ovs_interfaceid": "2000e5c8-e30c-44d9-b79c-fac8a9039c49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Converting VIF {"id": "2000e5c8-e30c-44d9-b79c-fac8a9039c49", "address": "fa:16:3e:06:9f:52", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2000e5c8-e3", "ovs_interfaceid": "2000e5c8-e30c-44d9-b79c-fac8a9039c49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:9f:52,bridge_name='br-int',has_traffic_filtering=True,id=2000e5c8-e30c-44d9-b79c-fac8a9039c49,network=Network(354bf335-0cac-46d9-acb8-5095411f5db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2000e5c8-e3') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.objects.instance [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lazy-loading 'pci_devices' on Instance uuid 49c65aca-8392-46ba-8fa3-b47ff2416cb9 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:16:40 user nova-compute[74821]:   <uuid>49c65aca-8392-46ba-8fa3-b47ff2416cb9</uuid>
Nov 06 13:16:40 user nova-compute[74821]:   <name>instance-00000010</name>
Nov 06 13:16:40 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:16:40 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:16:40 user nova-compute[74821]:   <metadata>
Nov 06 13:16:40 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:16:40 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:16:40 user nova-compute[74821]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1651102471</nova:name>
Nov 06 13:16:40 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:16:40</nova:creationTime>
Nov 06 13:16:40 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:16:40 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:16:40 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:16:40 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:16:40 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:16:40 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:16:40 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:16:40 user nova-compute[74821]:       <nova:owner>
Nov 06 13:16:40 user nova-compute[74821]:         <nova:user uuid="133932d1063241078d84731624e89216">tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member</nova:user>
Nov 06 13:16:40 user nova-compute[74821]:         <nova:project uuid="f745a322931e4150b12d139bfb17b94c">tempest-ServerBootFromVolumeStableRescueTest-1064633830</nova:project>
Nov 06 13:16:40 user nova-compute[74821]:       </nova:owner>
Nov 06 13:16:40 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:16:40 user nova-compute[74821]:       <nova:ports>
Nov 06 13:16:40 user nova-compute[74821]:         <nova:port uuid="2000e5c8-e30c-44d9-b79c-fac8a9039c49">
Nov 06 13:16:40 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 06 13:16:40 user nova-compute[74821]:         </nova:port>
Nov 06 13:16:40 user nova-compute[74821]:       </nova:ports>
Nov 06 13:16:40 user nova-compute[74821]:     </nova:instance>
Nov 06 13:16:40 user nova-compute[74821]:   </metadata>
Nov 06 13:16:40 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:16:40 user nova-compute[74821]:     <system>
Nov 06 13:16:40 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:16:40 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:16:40 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:16:40 user nova-compute[74821]:       <entry name="serial">49c65aca-8392-46ba-8fa3-b47ff2416cb9</entry>
Nov 06 13:16:40 user nova-compute[74821]:       <entry name="uuid">49c65aca-8392-46ba-8fa3-b47ff2416cb9</entry>
Nov 06 13:16:40 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:16:40 user nova-compute[74821]:     </system>
Nov 06 13:16:40 user nova-compute[74821]:   </sysinfo>
Nov 06 13:16:40 user nova-compute[74821]:   <os>
Nov 06 13:16:40 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:16:40 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:16:40 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:16:40 user nova-compute[74821]:   </os>
Nov 06 13:16:40 user nova-compute[74821]:   <features>
Nov 06 13:16:40 user nova-compute[74821]:     <acpi/>
Nov 06 13:16:40 user nova-compute[74821]:     <apic/>
Nov 06 13:16:40 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:16:40 user nova-compute[74821]:   </features>
Nov 06 13:16:40 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:16:40 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:16:40 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:16:40 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:16:40 user nova-compute[74821]:   </clock>
Nov 06 13:16:40 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:16:40 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:16:40 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:16:40 user nova-compute[74821]:   </cpu>
Nov 06 13:16:40 user nova-compute[74821]:   <devices>
Nov 06 13:16:40 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:16:40 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:16:40 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk"/>
Nov 06 13:16:40 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:16:40 user nova-compute[74821]:     </disk>
Nov 06 13:16:40 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:16:40 user nova-compute[74821]:       <mac address="fa:16:3e:06:9f:52"/>
Nov 06 13:16:40 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:16:40 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:16:40 user nova-compute[74821]:       <target dev="tap2000e5c8-e3"/>
Nov 06 13:16:40 user nova-compute[74821]:     </interface>
Nov 06 13:16:40 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:16:40 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/console.log" append="off"/>
Nov 06 13:16:40 user nova-compute[74821]:     </serial>
Nov 06 13:16:40 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:16:40 user nova-compute[74821]:     <video>
Nov 06 13:16:40 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:16:40 user nova-compute[74821]:     </video>
Nov 06 13:16:40 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:16:40 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:16:40 user nova-compute[74821]:     </rng>
Nov 06 13:16:40 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:16:40 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:16:40 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:16:40 user nova-compute[74821]:     </memballoon>
Nov 06 13:16:40 user nova-compute[74821]:   </devices>
Nov 06 13:16:40 user nova-compute[74821]: </domain>
Nov 06 13:16:40 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:16:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1651102471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1651102471',id=16,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f745a322931e4150b12d139bfb17b94c',ramdisk_id='',reservation_id='r-3r89gq7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1064633830',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:16:39Z,user_data=None,user_id='133932d1063241078d84731624e89216',uuid=49c65aca-8392-46ba-8fa3-b47ff2416cb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2000e5c8-e30c-44d9-b79c-fac8a9039c49", "address": "fa:16:3e:06:9f:52", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2000e5c8-e3", "ovs_interfaceid": "2000e5c8-e30c-44d9-b79c-fac8a9039c49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Converting VIF {"id": "2000e5c8-e30c-44d9-b79c-fac8a9039c49", "address": "fa:16:3e:06:9f:52", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2000e5c8-e3", "ovs_interfaceid": "2000e5c8-e30c-44d9-b79c-fac8a9039c49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:9f:52,bridge_name='br-int',has_traffic_filtering=True,id=2000e5c8-e30c-44d9-b79c-fac8a9039c49,network=Network(354bf335-0cac-46d9-acb8-5095411f5db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2000e5c8-e3') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG os_vif [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:9f:52,bridge_name='br-int',has_traffic_filtering=True,id=2000e5c8-e30c-44d9-b79c-fac8a9039c49,network=Network(354bf335-0cac-46d9-acb8-5095411f5db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2000e5c8-e3') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e0361456-17a2-5b9c-93b8-4c7d022fde63', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2000e5c8-e3, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2000e5c8-e3, col_values=(('qos', UUID('f12123f4-5eea-46d6-a7b2-f20cec842d6b')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2000e5c8-e3, col_values=(('external_ids', {'iface-id': '2000e5c8-e30c-44d9-b79c-fac8a9039c49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:9f:52', 'vm-uuid': '49c65aca-8392-46ba-8fa3-b47ff2416cb9'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:40 user nova-compute[74821]: INFO os_vif [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:9f:52,bridge_name='br-int',has_traffic_filtering=True,id=2000e5c8-e30c-44d9-b79c-fac8a9039c49,network=Network(354bf335-0cac-46d9-acb8-5095411f5db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2000e5c8-e3')
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:16:40 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] No VIF found with MAC fa:16:3e:06:9f:52, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:16:41 user nova-compute[74821]: DEBUG nova.network.neutron [req-607b7782-dd84-44c1-afb6-d30eb65b5f03 req-0cb9511d-fd70-4985-adfb-704df50b3755 service nova] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Updated VIF entry in instance network info cache for port 2000e5c8-e30c-44d9-b79c-fac8a9039c49. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:16:41 user nova-compute[74821]: DEBUG nova.network.neutron [req-607b7782-dd84-44c1-afb6-d30eb65b5f03 req-0cb9511d-fd70-4985-adfb-704df50b3755 service nova] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Updating instance_info_cache with network_info: [{"id": "2000e5c8-e30c-44d9-b79c-fac8a9039c49", "address": "fa:16:3e:06:9f:52", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2000e5c8-e3", "ovs_interfaceid": "2000e5c8-e30c-44d9-b79c-fac8a9039c49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:16:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-607b7782-dd84-44c1-afb6-d30eb65b5f03 req-0cb9511d-fd70-4985-adfb-704df50b3755 service nova] Releasing lock "refresh_cache-49c65aca-8392-46ba-8fa3-b47ff2416cb9" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG nova.compute.manager [req-310fd17e-812f-43cd-a6e1-05c385c178c3 req-8d9d2ad5-ece8-4667-9a04-ec92588ca47e service nova] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Received event network-vif-plugged-2000e5c8-e30c-44d9-b79c-fac8a9039c49 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-310fd17e-812f-43cd-a6e1-05c385c178c3 req-8d9d2ad5-ece8-4667-9a04-ec92588ca47e service nova] Acquiring lock "49c65aca-8392-46ba-8fa3-b47ff2416cb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-310fd17e-812f-43cd-a6e1-05c385c178c3 req-8d9d2ad5-ece8-4667-9a04-ec92588ca47e service nova] Lock "49c65aca-8392-46ba-8fa3-b47ff2416cb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-310fd17e-812f-43cd-a6e1-05c385c178c3 req-8d9d2ad5-ece8-4667-9a04-ec92588ca47e service nova] Lock "49c65aca-8392-46ba-8fa3-b47ff2416cb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG nova.compute.manager [req-310fd17e-812f-43cd-a6e1-05c385c178c3 req-8d9d2ad5-ece8-4667-9a04-ec92588ca47e service nova] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] No waiting events found dispatching network-vif-plugged-2000e5c8-e30c-44d9-b79c-fac8a9039c49 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:16:42 user nova-compute[74821]: WARNING nova.compute.manager [req-310fd17e-812f-43cd-a6e1-05c385c178c3 req-8d9d2ad5-ece8-4667-9a04-ec92588ca47e service nova] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Received unexpected event network-vif-plugged-2000e5c8-e30c-44d9-b79c-fac8a9039c49 for instance with vm_state building and task_state spawning.
Nov 06 13:16:42 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 5a715806-ff8b-4502-8435-c5de3e3c688a is timed out.
Nov 06 13:16:42 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Successfully detached device vdc from instance 5a715806-ff8b-4502-8435-c5de3e3c688a from the live domain config.
Nov 06 13:16:42 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UJCMvTfy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:16:42 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:16:42 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d4b171-eedc-42d4-9fa7-a25ecb82e767]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:16:42 user nova-compute[74821]: No targets found.
Nov 06 13:16:42 user nova-compute[74821]: iSNS:
Nov 06 13:16:42 user nova-compute[74821]: No targets found.
Nov 06 13:16:42 user nova-compute[74821]: STATIC:
Nov 06 13:16:42 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89
Nov 06 13:16:42 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:16:42 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:16:42 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b
Nov 06 13:16:42 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:16:42 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:16:42 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3
Nov 06 13:16:42 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:16:42 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:16:42 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e
Nov 06 13:16:42 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:16:42 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:16:42 user nova-compute[74821]: FIRMWARE:
Nov 06 13:16:42 user nova-compute[74821]: No targets found.
Nov 06 13:16:42 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:16:42 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:16:42 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ccaa89-6fcf-4b86-9b2f-6177290bc772]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[099c18be-ef95-421b-a6ff-263958725b9a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 (non-flash)
Nov 06 13:16:42 user nova-compute[74821]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b (non-flash)
Nov 06 13:16:42 user nova-compute[74821]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e (non-flash)
Nov 06 13:16:42 user nova-compute[74821]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3 (non-flash)
Nov 06 13:16:42 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 (non-flash)
Nov 06 13:16:42 user nova-compute[74821]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b (non-flash)
Nov 06 13:16:42 user nova-compute[74821]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e (non-flash)
Nov 06 13:16:42 user nova-compute[74821]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3 (non-flash)
Nov 06 13:16:42 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e5863e680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3'): ({'sdf'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Removing single pathed devices sdf {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea911d2-143b-4b73-9dac-a8aa1fccd79d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[268af69d-3de1-41a1-a3c1-c90d23da9768]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Flushing IO for device /dev/sdf {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b67e92b-f199-45a8-b86f-f03fd5b79c04]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.060s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e938b12e-9309-49f8-b324-f9e564ac2064]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] SCSI volumes sdf have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:43 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e439f0b-1bac-4ca6-8bfe-0364fa6310bc]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:16:43 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:16:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:43 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe2e503-7c1d-406c-8702-5902d44ec605]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:16:43 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3, portal: 172.16.0.220,3260]
Nov 06 13:16:43 user nova-compute[74821]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3, portal: 172.16.0.220,3260] successful.
Nov 06 13:16:43 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:16:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:43 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:43 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b3cce57-c905-4474-bb23-b3927ad008f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:43 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[75305a0d-f142-40a2-870c-d3851b38decd]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:16:43 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:16:43 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:16:43 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] <== disconnect_volume: return (394ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:16:43 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:16:43 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Acquiring lock "bd32c388-aa78-43ef-ae93-8230b8eba8af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:16:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lock "bd32c388-aa78-43ef-ae93-8230b8eba8af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:16:43 user nova-compute[74821]: DEBUG nova.compute.manager [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:16:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:16:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:16:44 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:16:44 user nova-compute[74821]: INFO nova.compute.claims [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Claim successful on node user
Nov 06 13:16:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:44 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:16:44 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:16:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.568s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:16:44 user nova-compute[74821]: DEBUG nova.compute.manager [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:16:44 user nova-compute[74821]: DEBUG nova.compute.manager [req-d7814092-4da6-4476-9074-f3d92bb645e8 req-5ab92447-7b01-4d66-8c43-86fa594a449a service nova] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Received event network-vif-plugged-2000e5c8-e30c-44d9-b79c-fac8a9039c49 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:16:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d7814092-4da6-4476-9074-f3d92bb645e8 req-5ab92447-7b01-4d66-8c43-86fa594a449a service nova] Acquiring lock "49c65aca-8392-46ba-8fa3-b47ff2416cb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:16:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d7814092-4da6-4476-9074-f3d92bb645e8 req-5ab92447-7b01-4d66-8c43-86fa594a449a service nova] Lock "49c65aca-8392-46ba-8fa3-b47ff2416cb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:16:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d7814092-4da6-4476-9074-f3d92bb645e8 req-5ab92447-7b01-4d66-8c43-86fa594a449a service nova] Lock "49c65aca-8392-46ba-8fa3-b47ff2416cb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:16:44 user nova-compute[74821]: DEBUG nova.compute.manager [req-d7814092-4da6-4476-9074-f3d92bb645e8 req-5ab92447-7b01-4d66-8c43-86fa594a449a service nova] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] No waiting events found dispatching network-vif-plugged-2000e5c8-e30c-44d9-b79c-fac8a9039c49 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:16:44 user nova-compute[74821]: WARNING nova.compute.manager [req-d7814092-4da6-4476-9074-f3d92bb645e8 req-5ab92447-7b01-4d66-8c43-86fa594a449a service nova] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Received unexpected event network-vif-plugged-2000e5c8-e30c-44d9-b79c-fac8a9039c49 for instance with vm_state building and task_state spawning.
Nov 06 13:16:44 user nova-compute[74821]: DEBUG nova.compute.manager [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:16:44 user nova-compute[74821]: DEBUG nova.network.neutron [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:16:44 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:16:44 user nova-compute[74821]: DEBUG nova.compute.manager [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:16:44 user nova-compute[74821]: DEBUG nova.policy [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '63d66293fbbb4460a5e181687fc31fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4287a7d278844ade94c8b38f8f76087e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:16:44 user nova-compute[74821]: DEBUG nova.compute.manager [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:16:44 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:16:44 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Creating image(s)
Nov 06 13:16:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:16:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lock "/opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:16:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lock "/opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:16:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:45 user nova-compute[74821]: DEBUG nova.compute.manager [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:16:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:16:45 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Instance spawned successfully.
Nov 06 13:16:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:16:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:16:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:16:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:16:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:16:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:16:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:16:45 user nova-compute[74821]: INFO nova.compute.manager [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Took 6.10 seconds to spawn the instance on the hypervisor.
Nov 06 13:16:45 user nova-compute[74821]: DEBUG nova.compute.manager [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:16:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.202s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:16:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:16:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:45 user nova-compute[74821]: INFO nova.compute.manager [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Took 6.89 seconds to build instance.
Nov 06 13:16:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9219f4f5-42dd-47ee-8a07-e69122d24cf6 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "49c65aca-8392-46ba-8fa3-b47ff2416cb9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.083s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:16:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.254s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/disk 1073741824" returned: 0 in 0.056s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.315s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:16:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.209s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:45 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:16:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:45 user nova-compute[74821]: DEBUG nova.network.neutron [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Successfully created port: 054bfb88-19a2-4241-ae8d-0eded559c233 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:16:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:45 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Cannot resize image /opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:16:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:16:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Ensure instance console log exists: /opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:16:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:16:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:16:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:16:46 user nova-compute[74821]: INFO nova.virt.block_device [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Booting with volume 1c9e538c-20ba-45f3-a5cc-162f8315a1bc at /dev/vdb
Nov 06 13:16:46 user nova-compute[74821]: DEBUG os_brick.utils [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:16:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:46 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8037982a-00ff-426b-a316-a9e12c6347a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:16:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:46 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a851f14-d971-4fd2-9b84-8c22a1de0db0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:16:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:46 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8660d53-c255-42e2-a5c9-00a2256563a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:16:46 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bc0ce7-a810-49b2-9d2b-4a09f18eb341]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:16:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:16:46 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:16:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:16:46 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:16:46 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15efb2d-444a-436f-889a-303f08c7b044]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:16:46 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:16:46 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:16:46 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:16:46 user nova-compute[74821]: DEBUG os_brick.utils [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:16:46 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Updating existing volume attachment record: bf39f1ce-f662-4a6a-914d-8c1adbe1f0c7 {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:16:46 user nova-compute[74821]: DEBUG nova.network.neutron [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Successfully updated port: 054bfb88-19a2-4241-ae8d-0eded559c233 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:16:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Acquiring lock "refresh_cache-bd32c388-aa78-43ef-ae93-8230b8eba8af" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:16:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Acquired lock "refresh_cache-bd32c388-aa78-43ef-ae93-8230b8eba8af" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:16:46 user nova-compute[74821]: DEBUG nova.network.neutron [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:16:46 user nova-compute[74821]: DEBUG nova.compute.manager [req-ead60815-1529-4e9c-9dcb-3169efaa83f7 req-9e94373a-675c-4ed1-9610-2c114026a668 service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Received event network-changed-054bfb88-19a2-4241-ae8d-0eded559c233 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:16:46 user nova-compute[74821]: DEBUG nova.compute.manager [req-ead60815-1529-4e9c-9dcb-3169efaa83f7 req-9e94373a-675c-4ed1-9610-2c114026a668 service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Refreshing instance network info cache due to event network-changed-054bfb88-19a2-4241-ae8d-0eded559c233. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:16:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ead60815-1529-4e9c-9dcb-3169efaa83f7 req-9e94373a-675c-4ed1-9610-2c114026a668 service nova] Acquiring lock "refresh_cache-bd32c388-aa78-43ef-ae93-8230b8eba8af" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:16:46 user nova-compute[74821]: DEBUG nova.network.neutron [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG nova.network.neutron [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Updating instance_info_cache with network_info: [{"id": "054bfb88-19a2-4241-ae8d-0eded559c233", "address": "fa:16:3e:7e:2a:2d", "network": {"id": "f5b630ec-39d9-4d50-b25a-3d90038e8b32", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-950408673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4287a7d278844ade94c8b38f8f76087e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054bfb88-19", "ovs_interfaceid": "054bfb88-19a2-4241-ae8d-0eded559c233", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Releasing lock "refresh_cache-bd32c388-aa78-43ef-ae93-8230b8eba8af" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG nova.compute.manager [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Instance network_info: |[{"id": "054bfb88-19a2-4241-ae8d-0eded559c233", "address": "fa:16:3e:7e:2a:2d", "network": {"id": "f5b630ec-39d9-4d50-b25a-3d90038e8b32", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-950408673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4287a7d278844ade94c8b38f8f76087e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054bfb88-19", "ovs_interfaceid": "054bfb88-19a2-4241-ae8d-0eded559c233", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ead60815-1529-4e9c-9dcb-3169efaa83f7 req-9e94373a-675c-4ed1-9610-2c114026a668 service nova] Acquired lock "refresh_cache-bd32c388-aa78-43ef-ae93-8230b8eba8af" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG nova.network.neutron [req-ead60815-1529-4e9c-9dcb-3169efaa83f7 req-9e94373a-675c-4ed1-9610-2c114026a668 service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Refreshing network info cache for port 054bfb88-19a2-4241-ae8d-0eded559c233 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Start _get_guest_xml network_info=[{"id": "054bfb88-19a2-4241-ae8d-0eded559c233", "address": "fa:16:3e:7e:2a:2d", "network": {"id": "f5b630ec-39d9-4d50-b25a-3d90038e8b32", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-950408673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4287a7d278844ade94c8b38f8f76087e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054bfb88-19", "ovs_interfaceid": "054bfb88-19a2-4241-ae8d-0eded559c233", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:16:47 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:16:47 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:16:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:16:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-63051430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-63051430',id=17,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTKqcTwYkCQENDzProvGIMFtMqaS+G/n1Hbl3a5LzTI2xbz3a2W94HTVkp4RevkFUNv1QjLjHpnVGJBeVEJild17QwHehxxe7AL3LQT4P27u7Ru79l65cMDiX2/YAksMA==',key_name='tempest-keypair-1412532163',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4287a7d278844ade94c8b38f8f76087e',ramdisk_id='',reservation_id='r-fuumtn90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1737511361',owner_user_name='tempest-TaggedAttachmentsTest-1737511361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:16:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63d66293fbbb4460a5e181687fc31fe7',uuid=bd32c388-aa78-43ef-ae93-8230b8eba8af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "054bfb88-19a2-4241-ae8d-0eded559c233", "address": "fa:16:3e:7e:2a:2d", "network": {"id": "f5b630ec-39d9-4d50-b25a-3d90038e8b32", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-950408673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4287a7d278844ade94c8b38f8f76087e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054bfb88-19", "ovs_interfaceid": "054bfb88-19a2-4241-ae8d-0eded559c233", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Converting VIF {"id": "054bfb88-19a2-4241-ae8d-0eded559c233", "address": "fa:16:3e:7e:2a:2d", "network": {"id": "f5b630ec-39d9-4d50-b25a-3d90038e8b32", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-950408673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4287a7d278844ade94c8b38f8f76087e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054bfb88-19", "ovs_interfaceid": "054bfb88-19a2-4241-ae8d-0eded559c233", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:2a:2d,bridge_name='br-int',has_traffic_filtering=True,id=054bfb88-19a2-4241-ae8d-0eded559c233,network=Network(f5b630ec-39d9-4d50-b25a-3d90038e8b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap054bfb88-19') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG nova.objects.instance [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lazy-loading 'pci_devices' on Instance uuid bd32c388-aa78-43ef-ae93-8230b8eba8af {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:16:47 user nova-compute[74821]:   <uuid>bd32c388-aa78-43ef-ae93-8230b8eba8af</uuid>
Nov 06 13:16:47 user nova-compute[74821]:   <name>instance-00000011</name>
Nov 06 13:16:47 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:16:47 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:16:47 user nova-compute[74821]:   <metadata>
Nov 06 13:16:47 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:16:47 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:16:47 user nova-compute[74821]:       <nova:name>tempest-device-tagging-server-63051430</nova:name>
Nov 06 13:16:47 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:16:47</nova:creationTime>
Nov 06 13:16:47 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:16:47 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:16:47 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:16:47 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:16:47 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:16:47 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:16:47 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:16:47 user nova-compute[74821]:       <nova:owner>
Nov 06 13:16:47 user nova-compute[74821]:         <nova:user uuid="63d66293fbbb4460a5e181687fc31fe7">tempest-TaggedAttachmentsTest-1737511361-project-member</nova:user>
Nov 06 13:16:47 user nova-compute[74821]:         <nova:project uuid="4287a7d278844ade94c8b38f8f76087e">tempest-TaggedAttachmentsTest-1737511361</nova:project>
Nov 06 13:16:47 user nova-compute[74821]:       </nova:owner>
Nov 06 13:16:47 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:16:47 user nova-compute[74821]:       <nova:ports>
Nov 06 13:16:47 user nova-compute[74821]:         <nova:port uuid="054bfb88-19a2-4241-ae8d-0eded559c233">
Nov 06 13:16:47 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 13:16:47 user nova-compute[74821]:         </nova:port>
Nov 06 13:16:47 user nova-compute[74821]:       </nova:ports>
Nov 06 13:16:47 user nova-compute[74821]:     </nova:instance>
Nov 06 13:16:47 user nova-compute[74821]:   </metadata>
Nov 06 13:16:47 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:16:47 user nova-compute[74821]:     <system>
Nov 06 13:16:47 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:16:47 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:16:47 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:16:47 user nova-compute[74821]:       <entry name="serial">bd32c388-aa78-43ef-ae93-8230b8eba8af</entry>
Nov 06 13:16:47 user nova-compute[74821]:       <entry name="uuid">bd32c388-aa78-43ef-ae93-8230b8eba8af</entry>
Nov 06 13:16:47 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:16:47 user nova-compute[74821]:     </system>
Nov 06 13:16:47 user nova-compute[74821]:   </sysinfo>
Nov 06 13:16:47 user nova-compute[74821]:   <os>
Nov 06 13:16:47 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:16:47 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:16:47 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:16:47 user nova-compute[74821]:   </os>
Nov 06 13:16:47 user nova-compute[74821]:   <features>
Nov 06 13:16:47 user nova-compute[74821]:     <acpi/>
Nov 06 13:16:47 user nova-compute[74821]:     <apic/>
Nov 06 13:16:47 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:16:47 user nova-compute[74821]:   </features>
Nov 06 13:16:47 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:16:47 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:16:47 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:16:47 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:16:47 user nova-compute[74821]:   </clock>
Nov 06 13:16:47 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:16:47 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:16:47 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:16:47 user nova-compute[74821]:   </cpu>
Nov 06 13:16:47 user nova-compute[74821]:   <devices>
Nov 06 13:16:47 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:16:47 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:16:47 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/disk"/>
Nov 06 13:16:47 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:16:47 user nova-compute[74821]:     </disk>
Nov 06 13:16:47 user nova-compute[74821]:     <disk type="file" device="cdrom">
Nov 06 13:16:47 user nova-compute[74821]:       <driver name="qemu" type="raw" cache="none"/>
Nov 06 13:16:47 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/disk.config"/>
Nov 06 13:16:47 user nova-compute[74821]:       <target dev="hda" bus="ide"/>
Nov 06 13:16:47 user nova-compute[74821]:     </disk>
Nov 06 13:16:47 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:16:47 user nova-compute[74821]:       <mac address="fa:16:3e:7e:2a:2d"/>
Nov 06 13:16:47 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:16:47 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:16:47 user nova-compute[74821]:       <target dev="tap054bfb88-19"/>
Nov 06 13:16:47 user nova-compute[74821]:     </interface>
Nov 06 13:16:47 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:16:47 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/console.log" append="off"/>
Nov 06 13:16:47 user nova-compute[74821]:     </serial>
Nov 06 13:16:47 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:16:47 user nova-compute[74821]:     <video>
Nov 06 13:16:47 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:16:47 user nova-compute[74821]:     </video>
Nov 06 13:16:47 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:16:47 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:16:47 user nova-compute[74821]:     </rng>
Nov 06 13:16:47 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:16:47 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:16:47 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:16:47 user nova-compute[74821]:     </memballoon>
Nov 06 13:16:47 user nova-compute[74821]:   </devices>
Nov 06 13:16:47 user nova-compute[74821]: </domain>
Nov 06 13:16:47 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:16:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-63051430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-63051430',id=17,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTKqcTwYkCQENDzProvGIMFtMqaS+G/n1Hbl3a5LzTI2xbz3a2W94HTVkp4RevkFUNv1QjLjHpnVGJBeVEJild17QwHehxxe7AL3LQT4P27u7Ru79l65cMDiX2/YAksMA==',key_name='tempest-keypair-1412532163',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4287a7d278844ade94c8b38f8f76087e',ramdisk_id='',reservation_id='r-fuumtn90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1737511361',owner_user_name='tempest-TaggedAttachmentsTest-1737511361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:16:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63d66293fbbb4460a5e181687fc31fe7',uuid=bd32c388-aa78-43ef-ae93-8230b8eba8af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "054bfb88-19a2-4241-ae8d-0eded559c233", "address": "fa:16:3e:7e:2a:2d", "network": {"id": "f5b630ec-39d9-4d50-b25a-3d90038e8b32", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-950408673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4287a7d278844ade94c8b38f8f76087e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054bfb88-19", "ovs_interfaceid": "054bfb88-19a2-4241-ae8d-0eded559c233", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Converting VIF {"id": "054bfb88-19a2-4241-ae8d-0eded559c233", "address": "fa:16:3e:7e:2a:2d", "network": {"id": "f5b630ec-39d9-4d50-b25a-3d90038e8b32", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-950408673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4287a7d278844ade94c8b38f8f76087e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054bfb88-19", "ovs_interfaceid": "054bfb88-19a2-4241-ae8d-0eded559c233", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:2a:2d,bridge_name='br-int',has_traffic_filtering=True,id=054bfb88-19a2-4241-ae8d-0eded559c233,network=Network(f5b630ec-39d9-4d50-b25a-3d90038e8b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap054bfb88-19') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG os_vif [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:2a:2d,bridge_name='br-int',has_traffic_filtering=True,id=054bfb88-19a2-4241-ae8d-0eded559c233,network=Network(f5b630ec-39d9-4d50-b25a-3d90038e8b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap054bfb88-19') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '058a8ddf-f892-565c-a477-635ddb508abb', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap054bfb88-19, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap054bfb88-19, col_values=(('qos', UUID('9a420d35-a360-47aa-ab9f-ab00354402c3')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap054bfb88-19, col_values=(('external_ids', {'iface-id': '054bfb88-19a2-4241-ae8d-0eded559c233', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:2a:2d', 'vm-uuid': 'bd32c388-aa78-43ef-ae93-8230b8eba8af'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:47 user nova-compute[74821]: INFO os_vif [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:2a:2d,bridge_name='br-int',has_traffic_filtering=True,id=054bfb88-19a2-4241-ae8d-0eded559c233,network=Network(f5b630ec-39d9-4d50-b25a-3d90038e8b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap054bfb88-19')
Nov 06 13:16:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] No BDM found with device name hda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] No VIF found with MAC fa:16:3e:7e:2a:2d, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:16:47 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Using config drive
Nov 06 13:16:47 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Creating config drive at /opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/disk.config
Nov 06 13:16:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdaz73e2b {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG nova.network.neutron [req-ead60815-1529-4e9c-9dcb-3169efaa83f7 req-9e94373a-675c-4ed1-9610-2c114026a668 service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Updated VIF entry in instance network info cache for port 054bfb88-19a2-4241-ae8d-0eded559c233. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG nova.network.neutron [req-ead60815-1529-4e9c-9dcb-3169efaa83f7 req-9e94373a-675c-4ed1-9610-2c114026a668 service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Updating instance_info_cache with network_info: [{"id": "054bfb88-19a2-4241-ae8d-0eded559c233", "address": "fa:16:3e:7e:2a:2d", "network": {"id": "f5b630ec-39d9-4d50-b25a-3d90038e8b32", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-950408673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4287a7d278844ade94c8b38f8f76087e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054bfb88-19", "ovs_interfaceid": "054bfb88-19a2-4241-ae8d-0eded559c233", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ead60815-1529-4e9c-9dcb-3169efaa83f7 req-9e94373a-675c-4ed1-9610-2c114026a668 service nova] Releasing lock "refresh_cache-bd32c388-aa78-43ef-ae93-8230b8eba8af" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:16:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdaz73e2b" returned: 0 in 0.091s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:16:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:50 user nova-compute[74821]: DEBUG nova.compute.manager [req-1f97302d-c0d5-434a-bd66-729262521451 req-5745e803-152e-4703-a24a-85aa94eef2a3 service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Received event network-vif-plugged-054bfb88-19a2-4241-ae8d-0eded559c233 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:16:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1f97302d-c0d5-434a-bd66-729262521451 req-5745e803-152e-4703-a24a-85aa94eef2a3 service nova] Acquiring lock "bd32c388-aa78-43ef-ae93-8230b8eba8af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:16:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1f97302d-c0d5-434a-bd66-729262521451 req-5745e803-152e-4703-a24a-85aa94eef2a3 service nova] Lock "bd32c388-aa78-43ef-ae93-8230b8eba8af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:16:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1f97302d-c0d5-434a-bd66-729262521451 req-5745e803-152e-4703-a24a-85aa94eef2a3 service nova] Lock "bd32c388-aa78-43ef-ae93-8230b8eba8af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:16:50 user nova-compute[74821]: DEBUG nova.compute.manager [req-1f97302d-c0d5-434a-bd66-729262521451 req-5745e803-152e-4703-a24a-85aa94eef2a3 service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] No waiting events found dispatching network-vif-plugged-054bfb88-19a2-4241-ae8d-0eded559c233 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:16:50 user nova-compute[74821]: WARNING nova.compute.manager [req-1f97302d-c0d5-434a-bd66-729262521451 req-5745e803-152e-4703-a24a-85aa94eef2a3 service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Received unexpected event network-vif-plugged-054bfb88-19a2-4241-ae8d-0eded559c233 for instance with vm_state building and task_state spawning.
Nov 06 13:16:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-fed57ff4-4285-457a-8a2c-cecbfa1d9857 req-39333da8-1dc1-4291-89c9-fc27587fa2b4 service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Received event network-vif-plugged-054bfb88-19a2-4241-ae8d-0eded559c233 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:16:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fed57ff4-4285-457a-8a2c-cecbfa1d9857 req-39333da8-1dc1-4291-89c9-fc27587fa2b4 service nova] Acquiring lock "bd32c388-aa78-43ef-ae93-8230b8eba8af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:16:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fed57ff4-4285-457a-8a2c-cecbfa1d9857 req-39333da8-1dc1-4291-89c9-fc27587fa2b4 service nova] Lock "bd32c388-aa78-43ef-ae93-8230b8eba8af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:16:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fed57ff4-4285-457a-8a2c-cecbfa1d9857 req-39333da8-1dc1-4291-89c9-fc27587fa2b4 service nova] Lock "bd32c388-aa78-43ef-ae93-8230b8eba8af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:16:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-fed57ff4-4285-457a-8a2c-cecbfa1d9857 req-39333da8-1dc1-4291-89c9-fc27587fa2b4 service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] No waiting events found dispatching network-vif-plugged-054bfb88-19a2-4241-ae8d-0eded559c233 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:16:52 user nova-compute[74821]: WARNING nova.compute.manager [req-fed57ff4-4285-457a-8a2c-cecbfa1d9857 req-39333da8-1dc1-4291-89c9-fc27587fa2b4 service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Received unexpected event network-vif-plugged-054bfb88-19a2-4241-ae8d-0eded559c233 for instance with vm_state building and task_state spawning.
Nov 06 13:16:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:52 user nova-compute[74821]: DEBUG nova.compute.manager [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:16:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:16:52 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Instance spawned successfully.
Nov 06 13:16:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:16:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:16:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:16:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:16:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:16:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:16:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:16:52 user nova-compute[74821]: INFO nova.compute.manager [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Took 7.82 seconds to spawn the instance on the hypervisor.
Nov 06 13:16:52 user nova-compute[74821]: DEBUG nova.compute.manager [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:16:52 user nova-compute[74821]: INFO nova.compute.manager [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Took 8.89 seconds to build instance.
Nov 06 13:16:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c51f02e5-29f9-4de8-9a0f-51bcf4e66d82 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lock "bd32c388-aa78-43ef-ae93-8230b8eba8af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.007s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:16:54 user nova-compute[74821]: DEBUG nova.objects.instance [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lazy-loading 'flavor' on Instance uuid 5a715806-ff8b-4502-8435-c5de3e3c688a {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:16:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e7c256f-32b3-4501-8b85-88f5c75970b5 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "5a715806-ff8b-4502-8435-c5de3e3c688a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 32.134s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:16:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:58 user nova-compute[74821]: DEBUG nova.compute.manager [req-63ec2e9d-90c6-4376-a0bb-4155e8d4ca0f req-6a585009-cb25-4434-bc21-cac271411e84 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-changed-8b30affb-e2f5-4151-8fee-fb7edcaf5ae2 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:16:58 user nova-compute[74821]: DEBUG nova.compute.manager [req-63ec2e9d-90c6-4376-a0bb-4155e8d4ca0f req-6a585009-cb25-4434-bc21-cac271411e84 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Refreshing instance network info cache due to event network-changed-8b30affb-e2f5-4151-8fee-fb7edcaf5ae2. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:16:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-63ec2e9d-90c6-4376-a0bb-4155e8d4ca0f req-6a585009-cb25-4434-bc21-cac271411e84 service nova] Acquiring lock "refresh_cache-a33991ce-e911-460d-a6d9-ca738830ef2c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:16:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-63ec2e9d-90c6-4376-a0bb-4155e8d4ca0f req-6a585009-cb25-4434-bc21-cac271411e84 service nova] Acquired lock "refresh_cache-a33991ce-e911-460d-a6d9-ca738830ef2c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:16:58 user nova-compute[74821]: DEBUG nova.network.neutron [req-63ec2e9d-90c6-4376-a0bb-4155e8d4ca0f req-6a585009-cb25-4434-bc21-cac271411e84 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Refreshing network info cache for port 8b30affb-e2f5-4151-8fee-fb7edcaf5ae2 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:16:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:16:59 user nova-compute[74821]: DEBUG nova.network.neutron [req-63ec2e9d-90c6-4376-a0bb-4155e8d4ca0f req-6a585009-cb25-4434-bc21-cac271411e84 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Updated VIF entry in instance network info cache for port 8b30affb-e2f5-4151-8fee-fb7edcaf5ae2. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:16:59 user nova-compute[74821]: DEBUG nova.network.neutron [req-63ec2e9d-90c6-4376-a0bb-4155e8d4ca0f req-6a585009-cb25-4434-bc21-cac271411e84 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Updating instance_info_cache with network_info: [{"id": "8b30affb-e2f5-4151-8fee-fb7edcaf5ae2", "address": "fa:16:3e:6f:35:3a", "network": {"id": "e3826bc5-7316-4738-b8b1-27551cd142ca", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1941910960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b30affb-e2", "ovs_interfaceid": "8b30affb-e2f5-4151-8fee-fb7edcaf5ae2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "66a37a87-3aa3-44cb-977f-eef4c8ab4e59", "address": "fa:16:3e:74:5e:90", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a37a87-3a", "ovs_interfaceid": "66a37a87-3aa3-44cb-977f-eef4c8ab4e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd", "address": "fa:16:3e:51:39:be", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa9ef4f-04", "ovs_interfaceid": "6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "03c0a994-073b-4b58-8775-0ce28b2f404d", "address": "fa:16:3e:55:e6:a3", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03c0a994-07", "ovs_interfaceid": "03c0a994-073b-4b58-8775-0ce28b2f404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3d9f17a-c9d8-4aaf-8015-dc9825335a25", "address": "fa:16:3e:e8:a8:6c", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d9f17a-c9", "ovs_interfaceid": "d3d9f17a-c9d8-4aaf-8015-dc9825335a25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f523111f-21f0-49ad-8e55-7515ebcfecff", "address": "fa:16:3e:87:21:4b", "network": {"id": "b92087b6-80a8-444b-8732-c31c6e17d4f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-584352862", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf523111f-21", "ovs_interfaceid": "f523111f-21f0-49ad-8e55-7515ebcfecff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "027b08d1-100c-4dc6-9e51-a435642f25f9", "address": "fa:16:3e:9a:3b:d1", "network": {"id": "b92087b6-80a8-444b-8732-c31c6e17d4f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-584352862", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027b08d1-10", "ovs_interfaceid": "027b08d1-100c-4dc6-9e51-a435642f25f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:16:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-63ec2e9d-90c6-4376-a0bb-4155e8d4ca0f req-6a585009-cb25-4434-bc21-cac271411e84 service nova] Releasing lock "refresh_cache-a33991ce-e911-460d-a6d9-ca738830ef2c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:17:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Acquiring lock "a33991ce-e911-460d-a6d9-ca738830ef2c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Acquiring lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:01 user nova-compute[74821]: INFO nova.compute.manager [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Terminating instance
Nov 06 13:17:01 user nova-compute[74821]: DEBUG nova.compute.manager [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:17:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:01 user nova-compute[74821]: DEBUG nova.compute.manager [req-49850a6a-69a0-4d23-a496-58ba93b68d62 req-2eb23486-0f2c-40b4-8b9a-428e17ba8440 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-unplugged-8b30affb-e2f5-4151-8fee-fb7edcaf5ae2 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:17:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-49850a6a-69a0-4d23-a496-58ba93b68d62 req-2eb23486-0f2c-40b4-8b9a-428e17ba8440 service nova] Acquiring lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-49850a6a-69a0-4d23-a496-58ba93b68d62 req-2eb23486-0f2c-40b4-8b9a-428e17ba8440 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-49850a6a-69a0-4d23-a496-58ba93b68d62 req-2eb23486-0f2c-40b4-8b9a-428e17ba8440 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:01 user nova-compute[74821]: DEBUG nova.compute.manager [req-49850a6a-69a0-4d23-a496-58ba93b68d62 req-2eb23486-0f2c-40b4-8b9a-428e17ba8440 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] No waiting events found dispatching network-vif-unplugged-8b30affb-e2f5-4151-8fee-fb7edcaf5ae2 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:17:01 user nova-compute[74821]: DEBUG nova.compute.manager [req-49850a6a-69a0-4d23-a496-58ba93b68d62 req-2eb23486-0f2c-40b4-8b9a-428e17ba8440 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-unplugged-8b30affb-e2f5-4151-8fee-fb7edcaf5ae2 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:17:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:01 user nova-compute[74821]: DEBUG nova.compute.manager [req-3e847039-b2ad-4e53-b2d2-276e11e21590 req-195a9672-3c84-4a18-8453-25fb4c2c22c2 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-unplugged-66a37a87-3aa3-44cb-977f-eef4c8ab4e59 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:17:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3e847039-b2ad-4e53-b2d2-276e11e21590 req-195a9672-3c84-4a18-8453-25fb4c2c22c2 service nova] Acquiring lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3e847039-b2ad-4e53-b2d2-276e11e21590 req-195a9672-3c84-4a18-8453-25fb4c2c22c2 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3e847039-b2ad-4e53-b2d2-276e11e21590 req-195a9672-3c84-4a18-8453-25fb4c2c22c2 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:02 user nova-compute[74821]: DEBUG nova.compute.manager [req-3e847039-b2ad-4e53-b2d2-276e11e21590 req-195a9672-3c84-4a18-8453-25fb4c2c22c2 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] No waiting events found dispatching network-vif-unplugged-66a37a87-3aa3-44cb-977f-eef4c8ab4e59 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:17:02 user nova-compute[74821]: DEBUG nova.compute.manager [req-3e847039-b2ad-4e53-b2d2-276e11e21590 req-195a9672-3c84-4a18-8453-25fb4c2c22c2 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-unplugged-66a37a87-3aa3-44cb-977f-eef4c8ab4e59 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:17:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:03 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Instance destroyed successfully.
Nov 06 13:17:03 user nova-compute[74821]: DEBUG nova.objects.instance [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Lazy-loading 'resources' on Instance uuid a33991ce-e911-460d-a6d9-ca738830ef2c {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:12:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1297022969',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1297022969',id=11,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLP/ji3FuPVI791mpvMNdCzayazy8E548yQX5rI/xbqwI/SkIu1OHU0CVIktacWjY+dJT8FzcO0PTuiUa7nivbZYVA2TTHzX3sUyOkOFTFMBhTPYrB59reXAlb/+yF52pA==',key_name='tempest-keypair-721011422',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:15:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5313e0306714b299bd860177c36f07f',ramdisk_id='',reservation_id='r-q6i6afm1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-244135857',owner_user_name='tempest-TaggedBootDevicesTest-244135857-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:15:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55407d95268147d4a75654afebe43631',uuid=a33991ce-e911-460d-a6d9-ca738830ef2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b30affb-e2f5-4151-8fee-fb7edcaf5ae2", "address": "fa:16:3e:6f:35:3a", "network": {"id": "e3826bc5-7316-4738-b8b1-27551cd142ca", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1941910960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b30affb-e2", "ovs_interfaceid": "8b30affb-e2f5-4151-8fee-fb7edcaf5ae2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converting VIF {"id": "8b30affb-e2f5-4151-8fee-fb7edcaf5ae2", "address": "fa:16:3e:6f:35:3a", "network": {"id": "e3826bc5-7316-4738-b8b1-27551cd142ca", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1941910960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b30affb-e2", "ovs_interfaceid": "8b30affb-e2f5-4151-8fee-fb7edcaf5ae2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:35:3a,bridge_name='br-int',has_traffic_filtering=True,id=8b30affb-e2f5-4151-8fee-fb7edcaf5ae2,network=Network(e3826bc5-7316-4738-b8b1-27551cd142ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b30affb-e2') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG os_vif [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:35:3a,bridge_name='br-int',has_traffic_filtering=True,id=8b30affb-e2f5-4151-8fee-fb7edcaf5ae2,network=Network(e3826bc5-7316-4738-b8b1-27551cd142ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b30affb-e2') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b30affb-e2, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2e105baa-1ef0-4387-ae0b-c88779c1983d) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:03 user nova-compute[74821]: INFO os_vif [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:35:3a,bridge_name='br-int',has_traffic_filtering=True,id=8b30affb-e2f5-4151-8fee-fb7edcaf5ae2,network=Network(e3826bc5-7316-4738-b8b1-27551cd142ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b30affb-e2')
Nov 06 13:17:03 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:12:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1297022969',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1297022969',id=11,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLP/ji3FuPVI791mpvMNdCzayazy8E548yQX5rI/xbqwI/SkIu1OHU0CVIktacWjY+dJT8FzcO0PTuiUa7nivbZYVA2TTHzX3sUyOkOFTFMBhTPYrB59reXAlb/+yF52pA==',key_name='tempest-keypair-721011422',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:15:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5313e0306714b299bd860177c36f07f',ramdisk_id='',reservation_id='r-q6i6afm1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-244135857',owner_user_name='tempest-TaggedBootDevicesTest-244135857-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:15:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55407d95268147d4a75654afebe43631',uuid=a33991ce-e911-460d-a6d9-ca738830ef2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66a37a87-3aa3-44cb-977f-eef4c8ab4e59", "address": "fa:16:3e:74:5e:90", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a37a87-3a", "ovs_interfaceid": "66a37a87-3aa3-44cb-977f-eef4c8ab4e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converting VIF {"id": "66a37a87-3aa3-44cb-977f-eef4c8ab4e59", "address": "fa:16:3e:74:5e:90", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a37a87-3a", "ovs_interfaceid": "66a37a87-3aa3-44cb-977f-eef4c8ab4e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:5e:90,bridge_name='br-int',has_traffic_filtering=True,id=66a37a87-3aa3-44cb-977f-eef4c8ab4e59,network=Network(ae5d06b7-0ae1-411c-8f84-b2145c78f042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap66a37a87-3a') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG os_vif [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:5e:90,bridge_name='br-int',has_traffic_filtering=True,id=66a37a87-3aa3-44cb-977f-eef4c8ab4e59,network=Network(ae5d06b7-0ae1-411c-8f84-b2145c78f042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap66a37a87-3a') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66a37a87-3a, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c287b489-06d0-42ef-8010-0c6b738bea32) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:03 user nova-compute[74821]: INFO os_vif [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:5e:90,bridge_name='br-int',has_traffic_filtering=True,id=66a37a87-3aa3-44cb-977f-eef4c8ab4e59,network=Network(ae5d06b7-0ae1-411c-8f84-b2145c78f042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap66a37a87-3a')
Nov 06 13:17:03 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:12:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1297022969',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1297022969',id=11,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLP/ji3FuPVI791mpvMNdCzayazy8E548yQX5rI/xbqwI/SkIu1OHU0CVIktacWjY+dJT8FzcO0PTuiUa7nivbZYVA2TTHzX3sUyOkOFTFMBhTPYrB59reXAlb/+yF52pA==',key_name='tempest-keypair-721011422',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:15:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5313e0306714b299bd860177c36f07f',ramdisk_id='',reservation_id='r-q6i6afm1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-244135857',owner_user_name='tempest-TaggedBootDevicesTest-244135857-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:15:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55407d95268147d4a75654afebe43631',uuid=a33991ce-e911-460d-a6d9-ca738830ef2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd", "address": "fa:16:3e:51:39:be", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa9ef4f-04", "ovs_interfaceid": "6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converting VIF {"id": "6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd", "address": "fa:16:3e:51:39:be", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa9ef4f-04", "ovs_interfaceid": "6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:39:be,bridge_name='br-int',has_traffic_filtering=True,id=6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd,network=Network(ae5d06b7-0ae1-411c-8f84-b2145c78f042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6aa9ef4f-04') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG os_vif [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:39:be,bridge_name='br-int',has_traffic_filtering=True,id=6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd,network=Network(ae5d06b7-0ae1-411c-8f84-b2145c78f042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6aa9ef4f-04') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6aa9ef4f-04, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a29c24d-8591-46e1-845e-9292630e87ca) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:03 user nova-compute[74821]: INFO os_vif [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:39:be,bridge_name='br-int',has_traffic_filtering=True,id=6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd,network=Network(ae5d06b7-0ae1-411c-8f84-b2145c78f042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6aa9ef4f-04')
Nov 06 13:17:03 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:12:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1297022969',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1297022969',id=11,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLP/ji3FuPVI791mpvMNdCzayazy8E548yQX5rI/xbqwI/SkIu1OHU0CVIktacWjY+dJT8FzcO0PTuiUa7nivbZYVA2TTHzX3sUyOkOFTFMBhTPYrB59reXAlb/+yF52pA==',key_name='tempest-keypair-721011422',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:15:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5313e0306714b299bd860177c36f07f',ramdisk_id='',reservation_id='r-q6i6afm1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-244135857',owner_user_name='tempest-TaggedBootDevicesTest-244135857-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:15:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55407d95268147d4a75654afebe43631',uuid=a33991ce-e911-460d-a6d9-ca738830ef2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03c0a994-073b-4b58-8775-0ce28b2f404d", "address": "fa:16:3e:55:e6:a3", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03c0a994-07", "ovs_interfaceid": "03c0a994-073b-4b58-8775-0ce28b2f404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converting VIF {"id": "03c0a994-073b-4b58-8775-0ce28b2f404d", "address": "fa:16:3e:55:e6:a3", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03c0a994-07", "ovs_interfaceid": "03c0a994-073b-4b58-8775-0ce28b2f404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:e6:a3,bridge_name='br-int',has_traffic_filtering=True,id=03c0a994-073b-4b58-8775-0ce28b2f404d,network=Network(ae5d06b7-0ae1-411c-8f84-b2145c78f042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03c0a994-07') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG os_vif [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:e6:a3,bridge_name='br-int',has_traffic_filtering=True,id=03c0a994-073b-4b58-8775-0ce28b2f404d,network=Network(ae5d06b7-0ae1-411c-8f84-b2145c78f042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03c0a994-07') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03c0a994-07, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ad87b25-dccf-425a-bd18-5370ff9ccc40) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG nova.compute.manager [req-7a1d2599-b060-4f47-b4d4-bda7917be47e req-d9d7b929-44fd-4eed-831c-fa584a7f2b44 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-plugged-8b30affb-e2f5-4151-8fee-fb7edcaf5ae2 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-7a1d2599-b060-4f47-b4d4-bda7917be47e req-d9d7b929-44fd-4eed-831c-fa584a7f2b44 service nova] Acquiring lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-7a1d2599-b060-4f47-b4d4-bda7917be47e req-d9d7b929-44fd-4eed-831c-fa584a7f2b44 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-7a1d2599-b060-4f47-b4d4-bda7917be47e req-d9d7b929-44fd-4eed-831c-fa584a7f2b44 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG nova.compute.manager [req-7a1d2599-b060-4f47-b4d4-bda7917be47e req-d9d7b929-44fd-4eed-831c-fa584a7f2b44 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] No waiting events found dispatching network-vif-plugged-8b30affb-e2f5-4151-8fee-fb7edcaf5ae2 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:17:03 user nova-compute[74821]: WARNING nova.compute.manager [req-7a1d2599-b060-4f47-b4d4-bda7917be47e req-d9d7b929-44fd-4eed-831c-fa584a7f2b44 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received unexpected event network-vif-plugged-8b30affb-e2f5-4151-8fee-fb7edcaf5ae2 for instance with vm_state active and task_state deleting.
Nov 06 13:17:03 user nova-compute[74821]: DEBUG nova.compute.manager [req-7a1d2599-b060-4f47-b4d4-bda7917be47e req-d9d7b929-44fd-4eed-831c-fa584a7f2b44 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-unplugged-03c0a994-073b-4b58-8775-0ce28b2f404d {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-7a1d2599-b060-4f47-b4d4-bda7917be47e req-d9d7b929-44fd-4eed-831c-fa584a7f2b44 service nova] Acquiring lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-7a1d2599-b060-4f47-b4d4-bda7917be47e req-d9d7b929-44fd-4eed-831c-fa584a7f2b44 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-7a1d2599-b060-4f47-b4d4-bda7917be47e req-d9d7b929-44fd-4eed-831c-fa584a7f2b44 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG nova.compute.manager [req-7a1d2599-b060-4f47-b4d4-bda7917be47e req-d9d7b929-44fd-4eed-831c-fa584a7f2b44 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] No waiting events found dispatching network-vif-unplugged-03c0a994-073b-4b58-8775-0ce28b2f404d {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG nova.compute.manager [req-7a1d2599-b060-4f47-b4d4-bda7917be47e req-d9d7b929-44fd-4eed-831c-fa584a7f2b44 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-unplugged-03c0a994-073b-4b58-8775-0ce28b2f404d for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG nova.compute.manager [req-7a1d2599-b060-4f47-b4d4-bda7917be47e req-d9d7b929-44fd-4eed-831c-fa584a7f2b44 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-plugged-03c0a994-073b-4b58-8775-0ce28b2f404d {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-7a1d2599-b060-4f47-b4d4-bda7917be47e req-d9d7b929-44fd-4eed-831c-fa584a7f2b44 service nova] Acquiring lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-7a1d2599-b060-4f47-b4d4-bda7917be47e req-d9d7b929-44fd-4eed-831c-fa584a7f2b44 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-7a1d2599-b060-4f47-b4d4-bda7917be47e req-d9d7b929-44fd-4eed-831c-fa584a7f2b44 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG nova.compute.manager [req-7a1d2599-b060-4f47-b4d4-bda7917be47e req-d9d7b929-44fd-4eed-831c-fa584a7f2b44 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] No waiting events found dispatching network-vif-plugged-03c0a994-073b-4b58-8775-0ce28b2f404d {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:17:03 user nova-compute[74821]: WARNING nova.compute.manager [req-7a1d2599-b060-4f47-b4d4-bda7917be47e req-d9d7b929-44fd-4eed-831c-fa584a7f2b44 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received unexpected event network-vif-plugged-03c0a994-073b-4b58-8775-0ce28b2f404d for instance with vm_state active and task_state deleting.
Nov 06 13:17:03 user nova-compute[74821]: DEBUG nova.compute.manager [req-7a1d2599-b060-4f47-b4d4-bda7917be47e req-d9d7b929-44fd-4eed-831c-fa584a7f2b44 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-unplugged-d3d9f17a-c9d8-4aaf-8015-dc9825335a25 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-7a1d2599-b060-4f47-b4d4-bda7917be47e req-d9d7b929-44fd-4eed-831c-fa584a7f2b44 service nova] Acquiring lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-7a1d2599-b060-4f47-b4d4-bda7917be47e req-d9d7b929-44fd-4eed-831c-fa584a7f2b44 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-7a1d2599-b060-4f47-b4d4-bda7917be47e req-d9d7b929-44fd-4eed-831c-fa584a7f2b44 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG nova.compute.manager [req-7a1d2599-b060-4f47-b4d4-bda7917be47e req-d9d7b929-44fd-4eed-831c-fa584a7f2b44 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] No waiting events found dispatching network-vif-unplugged-d3d9f17a-c9d8-4aaf-8015-dc9825335a25 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG nova.compute.manager [req-7a1d2599-b060-4f47-b4d4-bda7917be47e req-d9d7b929-44fd-4eed-831c-fa584a7f2b44 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-unplugged-d3d9f17a-c9d8-4aaf-8015-dc9825335a25 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG nova.compute.manager [req-7a1d2599-b060-4f47-b4d4-bda7917be47e req-d9d7b929-44fd-4eed-831c-fa584a7f2b44 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-plugged-d3d9f17a-c9d8-4aaf-8015-dc9825335a25 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-7a1d2599-b060-4f47-b4d4-bda7917be47e req-d9d7b929-44fd-4eed-831c-fa584a7f2b44 service nova] Acquiring lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-7a1d2599-b060-4f47-b4d4-bda7917be47e req-d9d7b929-44fd-4eed-831c-fa584a7f2b44 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-7a1d2599-b060-4f47-b4d4-bda7917be47e req-d9d7b929-44fd-4eed-831c-fa584a7f2b44 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG nova.compute.manager [req-7a1d2599-b060-4f47-b4d4-bda7917be47e req-d9d7b929-44fd-4eed-831c-fa584a7f2b44 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] No waiting events found dispatching network-vif-plugged-d3d9f17a-c9d8-4aaf-8015-dc9825335a25 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:17:03 user nova-compute[74821]: WARNING nova.compute.manager [req-7a1d2599-b060-4f47-b4d4-bda7917be47e req-d9d7b929-44fd-4eed-831c-fa584a7f2b44 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received unexpected event network-vif-plugged-d3d9f17a-c9d8-4aaf-8015-dc9825335a25 for instance with vm_state active and task_state deleting.
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:03 user nova-compute[74821]: INFO os_vif [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:e6:a3,bridge_name='br-int',has_traffic_filtering=True,id=03c0a994-073b-4b58-8775-0ce28b2f404d,network=Network(ae5d06b7-0ae1-411c-8f84-b2145c78f042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03c0a994-07')
Nov 06 13:17:03 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:12:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1297022969',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1297022969',id=11,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLP/ji3FuPVI791mpvMNdCzayazy8E548yQX5rI/xbqwI/SkIu1OHU0CVIktacWjY+dJT8FzcO0PTuiUa7nivbZYVA2TTHzX3sUyOkOFTFMBhTPYrB59reXAlb/+yF52pA==',key_name='tempest-keypair-721011422',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:15:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5313e0306714b299bd860177c36f07f',ramdisk_id='',reservation_id='r-q6i6afm1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-244135857',owner_user_name='tempest-TaggedBootDevicesTest-244135857-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:15:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55407d95268147d4a75654afebe43631',uuid=a33991ce-e911-460d-a6d9-ca738830ef2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3d9f17a-c9d8-4aaf-8015-dc9825335a25", "address": "fa:16:3e:e8:a8:6c", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d9f17a-c9", "ovs_interfaceid": "d3d9f17a-c9d8-4aaf-8015-dc9825335a25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converting VIF {"id": "d3d9f17a-c9d8-4aaf-8015-dc9825335a25", "address": "fa:16:3e:e8:a8:6c", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d9f17a-c9", "ovs_interfaceid": "d3d9f17a-c9d8-4aaf-8015-dc9825335a25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:a8:6c,bridge_name='br-int',has_traffic_filtering=True,id=d3d9f17a-c9d8-4aaf-8015-dc9825335a25,network=Network(ae5d06b7-0ae1-411c-8f84-b2145c78f042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d9f17a-c9') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG os_vif [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:a8:6c,bridge_name='br-int',has_traffic_filtering=True,id=d3d9f17a-c9d8-4aaf-8015-dc9825335a25,network=Network(ae5d06b7-0ae1-411c-8f84-b2145c78f042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d9f17a-c9') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3d9f17a-c9, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=290bd458-6b4e-4f4d-a064-f2bd9f66b758) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:03 user nova-compute[74821]: INFO os_vif [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:a8:6c,bridge_name='br-int',has_traffic_filtering=True,id=d3d9f17a-c9d8-4aaf-8015-dc9825335a25,network=Network(ae5d06b7-0ae1-411c-8f84-b2145c78f042),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d9f17a-c9')
Nov 06 13:17:03 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:12:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1297022969',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1297022969',id=11,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLP/ji3FuPVI791mpvMNdCzayazy8E548yQX5rI/xbqwI/SkIu1OHU0CVIktacWjY+dJT8FzcO0PTuiUa7nivbZYVA2TTHzX3sUyOkOFTFMBhTPYrB59reXAlb/+yF52pA==',key_name='tempest-keypair-721011422',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:15:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5313e0306714b299bd860177c36f07f',ramdisk_id='',reservation_id='r-q6i6afm1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-244135857',owner_user_name='tempest-TaggedBootDevicesTest-244135857-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:15:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55407d95268147d4a75654afebe43631',uuid=a33991ce-e911-460d-a6d9-ca738830ef2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f523111f-21f0-49ad-8e55-7515ebcfecff", "address": "fa:16:3e:87:21:4b", "network": {"id": "b92087b6-80a8-444b-8732-c31c6e17d4f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-584352862", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf523111f-21", "ovs_interfaceid": "f523111f-21f0-49ad-8e55-7515ebcfecff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converting VIF {"id": "f523111f-21f0-49ad-8e55-7515ebcfecff", "address": "fa:16:3e:87:21:4b", "network": {"id": "b92087b6-80a8-444b-8732-c31c6e17d4f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-584352862", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf523111f-21", "ovs_interfaceid": "f523111f-21f0-49ad-8e55-7515ebcfecff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:21:4b,bridge_name='br-int',has_traffic_filtering=True,id=f523111f-21f0-49ad-8e55-7515ebcfecff,network=Network(b92087b6-80a8-444b-8732-c31c6e17d4f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf523111f-21') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG os_vif [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:21:4b,bridge_name='br-int',has_traffic_filtering=True,id=f523111f-21f0-49ad-8e55-7515ebcfecff,network=Network(b92087b6-80a8-444b-8732-c31c6e17d4f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf523111f-21') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf523111f-21, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c26df62-0c8f-4e50-a717-2b7b0a51cd5b) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:04 user nova-compute[74821]: INFO os_vif [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:21:4b,bridge_name='br-int',has_traffic_filtering=True,id=f523111f-21f0-49ad-8e55-7515ebcfecff,network=Network(b92087b6-80a8-444b-8732-c31c6e17d4f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf523111f-21')
Nov 06 13:17:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:12:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1297022969',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1297022969',id=11,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLP/ji3FuPVI791mpvMNdCzayazy8E548yQX5rI/xbqwI/SkIu1OHU0CVIktacWjY+dJT8FzcO0PTuiUa7nivbZYVA2TTHzX3sUyOkOFTFMBhTPYrB59reXAlb/+yF52pA==',key_name='tempest-keypair-721011422',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:15:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5313e0306714b299bd860177c36f07f',ramdisk_id='',reservation_id='r-q6i6afm1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-244135857',owner_user_name='tempest-TaggedBootDevicesTest-244135857-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:15:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55407d95268147d4a75654afebe43631',uuid=a33991ce-e911-460d-a6d9-ca738830ef2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "027b08d1-100c-4dc6-9e51-a435642f25f9", "address": "fa:16:3e:9a:3b:d1", "network": {"id": "b92087b6-80a8-444b-8732-c31c6e17d4f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-584352862", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027b08d1-10", "ovs_interfaceid": "027b08d1-100c-4dc6-9e51-a435642f25f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converting VIF {"id": "027b08d1-100c-4dc6-9e51-a435642f25f9", "address": "fa:16:3e:9a:3b:d1", "network": {"id": "b92087b6-80a8-444b-8732-c31c6e17d4f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-584352862", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027b08d1-10", "ovs_interfaceid": "027b08d1-100c-4dc6-9e51-a435642f25f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:3b:d1,bridge_name='br-int',has_traffic_filtering=True,id=027b08d1-100c-4dc6-9e51-a435642f25f9,network=Network(b92087b6-80a8-444b-8732-c31c6e17d4f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027b08d1-10') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_vif [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:3b:d1,bridge_name='br-int',has_traffic_filtering=True,id=027b08d1-100c-4dc6-9e51-a435642f25f9,network=Network(b92087b6-80a8-444b-8732-c31c6e17d4f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027b08d1-10') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG nova.compute.manager [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-plugged-66a37a87-3aa3-44cb-977f-eef4c8ab4e59 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] Acquiring lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG nova.compute.manager [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] No waiting events found dispatching network-vif-plugged-66a37a87-3aa3-44cb-977f-eef4c8ab4e59 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:17:04 user nova-compute[74821]: WARNING nova.compute.manager [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received unexpected event network-vif-plugged-66a37a87-3aa3-44cb-977f-eef4c8ab4e59 for instance with vm_state active and task_state deleting.
Nov 06 13:17:04 user nova-compute[74821]: DEBUG nova.compute.manager [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-unplugged-6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] Acquiring lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG nova.compute.manager [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] No waiting events found dispatching network-vif-unplugged-6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG nova.compute.manager [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-unplugged-6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG nova.compute.manager [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-plugged-6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] Acquiring lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG nova.compute.manager [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] No waiting events found dispatching network-vif-plugged-6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:17:04 user nova-compute[74821]: WARNING nova.compute.manager [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received unexpected event network-vif-plugged-6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd for instance with vm_state active and task_state deleting.
Nov 06 13:17:04 user nova-compute[74821]: DEBUG nova.compute.manager [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-unplugged-f523111f-21f0-49ad-8e55-7515ebcfecff {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] Acquiring lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG nova.compute.manager [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] No waiting events found dispatching network-vif-unplugged-f523111f-21f0-49ad-8e55-7515ebcfecff {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG nova.compute.manager [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-unplugged-f523111f-21f0-49ad-8e55-7515ebcfecff for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG nova.compute.manager [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-plugged-f523111f-21f0-49ad-8e55-7515ebcfecff {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] Acquiring lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG nova.compute.manager [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] No waiting events found dispatching network-vif-plugged-f523111f-21f0-49ad-8e55-7515ebcfecff {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:17:04 user nova-compute[74821]: WARNING nova.compute.manager [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received unexpected event network-vif-plugged-f523111f-21f0-49ad-8e55-7515ebcfecff for instance with vm_state active and task_state deleting.
Nov 06 13:17:04 user nova-compute[74821]: DEBUG nova.compute.manager [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-unplugged-027b08d1-100c-4dc6-9e51-a435642f25f9 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] Acquiring lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG nova.compute.manager [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] No waiting events found dispatching network-vif-unplugged-027b08d1-100c-4dc6-9e51-a435642f25f9 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG nova.compute.manager [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-unplugged-027b08d1-100c-4dc6-9e51-a435642f25f9 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG nova.compute.manager [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-plugged-027b08d1-100c-4dc6-9e51-a435642f25f9 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] Acquiring lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG nova.compute.manager [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] No waiting events found dispatching network-vif-plugged-027b08d1-100c-4dc6-9e51-a435642f25f9 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:17:04 user nova-compute[74821]: WARNING nova.compute.manager [req-e27f136a-2629-4589-962d-683a8aa3c69c req-101b6153-0660-4c4c-ae2e-559bbe228415 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received unexpected event network-vif-plugged-027b08d1-100c-4dc6-9e51-a435642f25f9 for instance with vm_state active and task_state deleting.
Nov 06 13:17:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap027b08d1-10, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=804804c2-0145-4090-aaeb-98c817e77197) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:04 user nova-compute[74821]: INFO os_vif [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:3b:d1,bridge_name='br-int',has_traffic_filtering=True,id=027b08d1-100c-4dc6-9e51-a435642f25f9,network=Network(b92087b6-80a8-444b-8732-c31c6e17d4f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027b08d1-10')
Nov 06 13:17:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UAgKsmlj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:17:04 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd569fd-d9d2-4c6a-bb98-3f0811860455]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:17:04 user nova-compute[74821]: No targets found.
Nov 06 13:17:04 user nova-compute[74821]: iSNS:
Nov 06 13:17:04 user nova-compute[74821]: No targets found.
Nov 06 13:17:04 user nova-compute[74821]: STATIC:
Nov 06 13:17:04 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89
Nov 06 13:17:04 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:17:04 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:17:04 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b
Nov 06 13:17:04 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:17:04 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:17:04 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e
Nov 06 13:17:04 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:17:04 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:17:04 user nova-compute[74821]: FIRMWARE:
Nov 06 13:17:04 user nova-compute[74821]: No targets found.
Nov 06 13:17:04 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:17:04 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:17:04 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c33b26d-147c-45d1-b31d-240b4c2e743a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e37677-6221-47d8-b545-fe7e1e40b3ac]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 (non-flash)
Nov 06 13:17:04 user nova-compute[74821]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b (non-flash)
Nov 06 13:17:04 user nova-compute[74821]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e (non-flash)
Nov 06 13:17:04 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 (non-flash)
Nov 06 13:17:04 user nova-compute[74821]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b (non-flash)
Nov 06 13:17:04 user nova-compute[74821]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e (non-flash)
Nov 06 13:17:04 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e40631d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e'): ({'sde'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Removing single pathed devices sde {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d92df33-89f9-4a4b-a756-7222d873afb4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6384599f-cba8-4bee-b4f0-95bad531d457]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Flushing IO for device /dev/sde {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[08df1d26-be06-4d14-9f95-f84f6db3cfaa]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.070s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9fd2f1-19d5-4ec2-bfe8-56b2bd01dbb6]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] SCSI volumes sde have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc21830-5b58-42a6-8697-cae7a8e2e9c6]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3719d0-1d22-4a27-a22a-571bb2561302]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e, portal: 172.16.0.220,3260]
Nov 06 13:17:04 user nova-compute[74821]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e, portal: 172.16.0.220,3260] successful.
Nov 06 13:17:04 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:424fd083-b856-43b1-8c8f-945fe811aa4e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea492f1-5fd6-478c-994a-09e564ae037f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] <== disconnect_volume: return (336ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XxPWnkCZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:17:04 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[973ea576-d851-428e-ac7a-c34f4caa526a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:17:04 user nova-compute[74821]: No targets found.
Nov 06 13:17:04 user nova-compute[74821]: iSNS:
Nov 06 13:17:04 user nova-compute[74821]: No targets found.
Nov 06 13:17:04 user nova-compute[74821]: STATIC:
Nov 06 13:17:04 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89
Nov 06 13:17:04 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:17:04 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:17:04 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b
Nov 06 13:17:04 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:17:04 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:17:04 user nova-compute[74821]: FIRMWARE:
Nov 06 13:17:04 user nova-compute[74821]: No targets found.
Nov 06 13:17:04 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:17:04 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:17:04 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb62076-9063-4931-8877-840c0714c3ba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bb4f02-6269-4592-b128-9afc62e7e070]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 (non-flash)
Nov 06 13:17:04 user nova-compute[74821]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b (non-flash)
Nov 06 13:17:04 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 (non-flash)
Nov 06 13:17:04 user nova-compute[74821]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b (non-flash)
Nov 06 13:17:04 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e40631d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89'): ({'sdb'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Removing single pathed devices sdb {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[544481c4-94ef-400b-9e55-45e31973824c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[886f962b-eb7d-42d3-a3b5-843ef59e2b4e]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Flushing IO for device /dev/sdb {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1a6a24-6022-414e-81fe-619165471fdb]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24a9e19-499d-42c8-a994-e9112bf4a161]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] SCSI volumes sdb have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1fe0ce-ae84-4865-8cef-41500dd2ad06]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0b80a4-7c61-4d66-b693-21943659c99b]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89, portal: 172.16.0.220,3260]
Nov 06 13:17:04 user nova-compute[74821]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89, portal: 172.16.0.220,3260] successful.
Nov 06 13:17:04 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5dff38fc-6556-4029-b400-b624265adb89 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ff137f-3247-4382-a959-6c11d5db541e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] <== disconnect_volume: return (301ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oKXGetJh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:17:04 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e948456-5919-4418-9def-92e2a93af2c4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:17:04 user nova-compute[74821]: No targets found.
Nov 06 13:17:04 user nova-compute[74821]: iSNS:
Nov 06 13:17:04 user nova-compute[74821]: No targets found.
Nov 06 13:17:04 user nova-compute[74821]: STATIC:
Nov 06 13:17:04 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b
Nov 06 13:17:04 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:17:04 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:17:04 user nova-compute[74821]: FIRMWARE:
Nov 06 13:17:04 user nova-compute[74821]: No targets found.
Nov 06 13:17:04 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:17:04 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:17:04 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[655bfa20-ba02-4140-acac-ad33bcf2cdf1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa817e8d-e48c-442c-81ce-ec5158f6333d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b (non-flash)
Nov 06 13:17:04 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b (non-flash)
Nov 06 13:17:04 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e405f1480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b'): ({'sdd'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Removing single pathed devices sdd {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[30adf8ef-eb83-4bf0-8961-ac1b073f1313]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2de2402-15de-4b53-bcda-2906f63b4ad9]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Flushing IO for device /dev/sdd {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1518948b-189f-4cc5-886b-65374021f405]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fca1bd7-077e-440a-99fc-73af3e2581e8]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] SCSI volumes sdd have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[577ad960-d462-490f-b6c5-65adcd79f4ef]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[645ee86e-2e7f-406c-87c9-45e549dece8f]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b, portal: 172.16.0.220,3260]
Nov 06 13:17:04 user nova-compute[74821]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b, portal: 172.16.0.220,3260] successful.
Nov 06 13:17:04 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22edf35-5a12-4d6f-b128-d22ed98a282b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d73611-0dae-43bd-8cf5-85244e016405]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] <== disconnect_volume: return (272ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:17:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:17:04 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Deleting instance files /opt/stack/data/nova/instances/a33991ce-e911-460d-a6d9-ca738830ef2c_del
Nov 06 13:17:05 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Deletion of /opt/stack/data/nova/instances/a33991ce-e911-460d-a6d9-ca738830ef2c_del complete
Nov 06 13:17:05 user nova-compute[74821]: INFO nova.compute.manager [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Took 3.60 seconds to destroy the instance on the hypervisor.
Nov 06 13:17:05 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:17:05 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:17:05 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:17:06 user nova-compute[74821]: DEBUG nova.compute.manager [req-79305485-414e-48b6-af5b-4fad87046896 req-45f0d7a5-dcbb-4a7d-a07d-d92c6707c8f7 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-deleted-027b08d1-100c-4dc6-9e51-a435642f25f9 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:17:06 user nova-compute[74821]: INFO nova.compute.manager [req-79305485-414e-48b6-af5b-4fad87046896 req-45f0d7a5-dcbb-4a7d-a07d-d92c6707c8f7 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Neutron deleted interface 027b08d1-100c-4dc6-9e51-a435642f25f9; detaching it from the instance and deleting it from the info cache
Nov 06 13:17:06 user nova-compute[74821]: DEBUG nova.network.neutron [req-79305485-414e-48b6-af5b-4fad87046896 req-45f0d7a5-dcbb-4a7d-a07d-d92c6707c8f7 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Updating instance_info_cache with network_info: [{"id": "8b30affb-e2f5-4151-8fee-fb7edcaf5ae2", "address": "fa:16:3e:6f:35:3a", "network": {"id": "e3826bc5-7316-4738-b8b1-27551cd142ca", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1941910960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b30affb-e2", "ovs_interfaceid": "8b30affb-e2f5-4151-8fee-fb7edcaf5ae2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "66a37a87-3aa3-44cb-977f-eef4c8ab4e59", "address": "fa:16:3e:74:5e:90", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a37a87-3a", "ovs_interfaceid": "66a37a87-3aa3-44cb-977f-eef4c8ab4e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd", "address": "fa:16:3e:51:39:be", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa9ef4f-04", "ovs_interfaceid": "6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "03c0a994-073b-4b58-8775-0ce28b2f404d", "address": "fa:16:3e:55:e6:a3", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03c0a994-07", "ovs_interfaceid": "03c0a994-073b-4b58-8775-0ce28b2f404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3d9f17a-c9d8-4aaf-8015-dc9825335a25", "address": "fa:16:3e:e8:a8:6c", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d9f17a-c9", "ovs_interfaceid": "d3d9f17a-c9d8-4aaf-8015-dc9825335a25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f523111f-21f0-49ad-8e55-7515ebcfecff", "address": "fa:16:3e:87:21:4b", "network": {"id": "b92087b6-80a8-444b-8732-c31c6e17d4f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-584352862", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf523111f-21", "ovs_interfaceid": "f523111f-21f0-49ad-8e55-7515ebcfecff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:17:06 user nova-compute[74821]: DEBUG nova.compute.manager [req-79305485-414e-48b6-af5b-4fad87046896 req-45f0d7a5-dcbb-4a7d-a07d-d92c6707c8f7 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Detach interface failed, port_id=027b08d1-100c-4dc6-9e51-a435642f25f9, reason: Instance a33991ce-e911-460d-a6d9-ca738830ef2c could not be found. {{(pid=74821) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 13:17:07 user nova-compute[74821]: INFO nova.compute.manager [None req-cd5df473-f544-4717-a658-6dd02d56998f tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Unrescuing
Nov 06 13:17:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cd5df473-f544-4717-a658-6dd02d56998f tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "refresh_cache-3e21d005-f190-478a-a911-e483e1235057" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:17:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cd5df473-f544-4717-a658-6dd02d56998f tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquired lock "refresh_cache-3e21d005-f190-478a-a911-e483e1235057" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:17:07 user nova-compute[74821]: DEBUG nova.network.neutron [None req-cd5df473-f544-4717-a658-6dd02d56998f tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:17:08 user nova-compute[74821]: DEBUG nova.network.neutron [None req-cd5df473-f544-4717-a658-6dd02d56998f tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Updating instance_info_cache with network_info: [{"id": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "address": "fa:16:3e:e0:fc:40", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6fb684-24", "ovs_interfaceid": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:17:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cd5df473-f544-4717-a658-6dd02d56998f tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Releasing lock "refresh_cache-3e21d005-f190-478a-a911-e483e1235057" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:17:08 user nova-compute[74821]: DEBUG nova.objects.instance [None req-cd5df473-f544-4717-a658-6dd02d56998f tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lazy-loading 'flavor' on Instance uuid 3e21d005-f190-478a-a911-e483e1235057 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:17:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:08 user nova-compute[74821]: DEBUG nova.compute.manager [req-cd006cd3-0252-4177-9817-4b58e211c9a6 req-e254c72d-f940-470e-9239-2e184df43936 service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] Received event network-vif-unplugged-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:17:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-cd006cd3-0252-4177-9817-4b58e211c9a6 req-e254c72d-f940-470e-9239-2e184df43936 service nova] Acquiring lock "3e21d005-f190-478a-a911-e483e1235057-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-cd006cd3-0252-4177-9817-4b58e211c9a6 req-e254c72d-f940-470e-9239-2e184df43936 service nova] Lock "3e21d005-f190-478a-a911-e483e1235057-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-cd006cd3-0252-4177-9817-4b58e211c9a6 req-e254c72d-f940-470e-9239-2e184df43936 service nova] Lock "3e21d005-f190-478a-a911-e483e1235057-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:08 user nova-compute[74821]: DEBUG nova.compute.manager [req-cd006cd3-0252-4177-9817-4b58e211c9a6 req-e254c72d-f940-470e-9239-2e184df43936 service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] No waiting events found dispatching network-vif-unplugged-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:17:08 user nova-compute[74821]: WARNING nova.compute.manager [req-cd006cd3-0252-4177-9817-4b58e211c9a6 req-e254c72d-f940-470e-9239-2e184df43936 service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] Received unexpected event network-vif-unplugged-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 for instance with vm_state rescued and task_state unrescuing.
Nov 06 13:17:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:09 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 3e21d005-f190-478a-a911-e483e1235057] Instance destroyed successfully.
Nov 06 13:17:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:09 user nova-compute[74821]: DEBUG nova.compute.manager [req-692b1fc7-d476-492a-acd8-7c38c11fe8a9 req-b2a01e64-a44f-4d12-944d-f99676270cfa service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-deleted-8b30affb-e2f5-4151-8fee-fb7edcaf5ae2 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:17:09 user nova-compute[74821]: INFO nova.compute.manager [req-692b1fc7-d476-492a-acd8-7c38c11fe8a9 req-b2a01e64-a44f-4d12-944d-f99676270cfa service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Neutron deleted interface 8b30affb-e2f5-4151-8fee-fb7edcaf5ae2; detaching it from the instance and deleting it from the info cache
Nov 06 13:17:09 user nova-compute[74821]: DEBUG nova.network.neutron [req-692b1fc7-d476-492a-acd8-7c38c11fe8a9 req-b2a01e64-a44f-4d12-944d-f99676270cfa service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Updating instance_info_cache with network_info: [{"id": "66a37a87-3aa3-44cb-977f-eef4c8ab4e59", "address": "fa:16:3e:74:5e:90", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a37a87-3a", "ovs_interfaceid": "66a37a87-3aa3-44cb-977f-eef4c8ab4e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd", "address": "fa:16:3e:51:39:be", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa9ef4f-04", "ovs_interfaceid": "6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "03c0a994-073b-4b58-8775-0ce28b2f404d", "address": "fa:16:3e:55:e6:a3", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03c0a994-07", "ovs_interfaceid": "03c0a994-073b-4b58-8775-0ce28b2f404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3d9f17a-c9d8-4aaf-8015-dc9825335a25", "address": "fa:16:3e:e8:a8:6c", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d9f17a-c9", "ovs_interfaceid": "d3d9f17a-c9d8-4aaf-8015-dc9825335a25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f523111f-21f0-49ad-8e55-7515ebcfecff", "address": "fa:16:3e:87:21:4b", "network": {"id": "b92087b6-80a8-444b-8732-c31c6e17d4f2", "bridge": "br-int", "label": "tempest-device-tagging-net2-584352862", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf523111f-21", "ovs_interfaceid": "f523111f-21f0-49ad-8e55-7515ebcfecff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:17:09 user nova-compute[74821]: DEBUG nova.compute.manager [req-692b1fc7-d476-492a-acd8-7c38c11fe8a9 req-b2a01e64-a44f-4d12-944d-f99676270cfa service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Detach interface failed, port_id=8b30affb-e2f5-4151-8fee-fb7edcaf5ae2, reason: Instance a33991ce-e911-460d-a6d9-ca738830ef2c could not be found. {{(pid=74821) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 13:17:09 user nova-compute[74821]: DEBUG nova.compute.manager [req-692b1fc7-d476-492a-acd8-7c38c11fe8a9 req-b2a01e64-a44f-4d12-944d-f99676270cfa service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-deleted-f523111f-21f0-49ad-8e55-7515ebcfecff {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:17:09 user nova-compute[74821]: INFO nova.compute.manager [req-692b1fc7-d476-492a-acd8-7c38c11fe8a9 req-b2a01e64-a44f-4d12-944d-f99676270cfa service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Neutron deleted interface f523111f-21f0-49ad-8e55-7515ebcfecff; detaching it from the instance and deleting it from the info cache
Nov 06 13:17:09 user nova-compute[74821]: DEBUG nova.network.neutron [req-692b1fc7-d476-492a-acd8-7c38c11fe8a9 req-b2a01e64-a44f-4d12-944d-f99676270cfa service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Updating instance_info_cache with network_info: [{"id": "66a37a87-3aa3-44cb-977f-eef4c8ab4e59", "address": "fa:16:3e:74:5e:90", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a37a87-3a", "ovs_interfaceid": "66a37a87-3aa3-44cb-977f-eef4c8ab4e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd", "address": "fa:16:3e:51:39:be", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa9ef4f-04", "ovs_interfaceid": "6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "03c0a994-073b-4b58-8775-0ce28b2f404d", "address": "fa:16:3e:55:e6:a3", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03c0a994-07", "ovs_interfaceid": "03c0a994-073b-4b58-8775-0ce28b2f404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3d9f17a-c9d8-4aaf-8015-dc9825335a25", "address": "fa:16:3e:e8:a8:6c", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d9f17a-c9", "ovs_interfaceid": "d3d9f17a-c9d8-4aaf-8015-dc9825335a25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:17:09 user nova-compute[74821]: DEBUG nova.compute.manager [req-692b1fc7-d476-492a-acd8-7c38c11fe8a9 req-b2a01e64-a44f-4d12-944d-f99676270cfa service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Detach interface failed, port_id=f523111f-21f0-49ad-8e55-7515ebcfecff, reason: Instance a33991ce-e911-460d-a6d9-ca738830ef2c could not be found. {{(pid=74821) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 13:17:09 user nova-compute[74821]: DEBUG nova.compute.manager [req-692b1fc7-d476-492a-acd8-7c38c11fe8a9 req-b2a01e64-a44f-4d12-944d-f99676270cfa service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-deleted-03c0a994-073b-4b58-8775-0ce28b2f404d {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:17:09 user nova-compute[74821]: INFO nova.compute.manager [req-692b1fc7-d476-492a-acd8-7c38c11fe8a9 req-b2a01e64-a44f-4d12-944d-f99676270cfa service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Neutron deleted interface 03c0a994-073b-4b58-8775-0ce28b2f404d; detaching it from the instance and deleting it from the info cache
Nov 06 13:17:09 user nova-compute[74821]: DEBUG nova.network.neutron [req-692b1fc7-d476-492a-acd8-7c38c11fe8a9 req-b2a01e64-a44f-4d12-944d-f99676270cfa service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Updating instance_info_cache with network_info: [{"id": "66a37a87-3aa3-44cb-977f-eef4c8ab4e59", "address": "fa:16:3e:74:5e:90", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a37a87-3a", "ovs_interfaceid": "66a37a87-3aa3-44cb-977f-eef4c8ab4e59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd", "address": "fa:16:3e:51:39:be", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6aa9ef4f-04", "ovs_interfaceid": "6aa9ef4f-04e2-4488-9dfa-de143bf0cbcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d3d9f17a-c9d8-4aaf-8015-dc9825335a25", "address": "fa:16:3e:e8:a8:6c", "network": {"id": "ae5d06b7-0ae1-411c-8f84-b2145c78f042", "bridge": "br-int", "label": "tempest-device-tagging-net1-2018665310", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5313e0306714b299bd860177c36f07f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d9f17a-c9", "ovs_interfaceid": "d3d9f17a-c9d8-4aaf-8015-dc9825335a25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:17:09 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:17:09 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Took 4.23 seconds to deallocate network for instance.
Nov 06 13:17:09 user nova-compute[74821]: DEBUG nova.compute.manager [req-692b1fc7-d476-492a-acd8-7c38c11fe8a9 req-b2a01e64-a44f-4d12-944d-f99676270cfa service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Detach interface failed, port_id=03c0a994-073b-4b58-8775-0ce28b2f404d, reason: Instance a33991ce-e911-460d-a6d9-ca738830ef2c could not be found. {{(pid=74821) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 13:17:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:10 user nova-compute[74821]: DEBUG nova.compute.manager [req-55c3ee6a-87ce-433f-8c41-8d9fa68205e2 req-fcd40de2-5b1b-4481-970b-4d063c6c6eea service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] Received event network-vif-plugged-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:17:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-55c3ee6a-87ce-433f-8c41-8d9fa68205e2 req-fcd40de2-5b1b-4481-970b-4d063c6c6eea service nova] Acquiring lock "3e21d005-f190-478a-a911-e483e1235057-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-55c3ee6a-87ce-433f-8c41-8d9fa68205e2 req-fcd40de2-5b1b-4481-970b-4d063c6c6eea service nova] Lock "3e21d005-f190-478a-a911-e483e1235057-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-55c3ee6a-87ce-433f-8c41-8d9fa68205e2 req-fcd40de2-5b1b-4481-970b-4d063c6c6eea service nova] Lock "3e21d005-f190-478a-a911-e483e1235057-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:10 user nova-compute[74821]: DEBUG nova.compute.manager [req-55c3ee6a-87ce-433f-8c41-8d9fa68205e2 req-fcd40de2-5b1b-4481-970b-4d063c6c6eea service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] No waiting events found dispatching network-vif-plugged-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:17:10 user nova-compute[74821]: WARNING nova.compute.manager [req-55c3ee6a-87ce-433f-8c41-8d9fa68205e2 req-fcd40de2-5b1b-4481-970b-4d063c6c6eea service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] Received unexpected event network-vif-plugged-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 for instance with vm_state rescued and task_state unrescuing.
Nov 06 13:17:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:11 user nova-compute[74821]: DEBUG nova.compute.manager [req-70a06b6c-f11c-4a73-9c25-0fe22661ee2a req-4ff229f8-e7df-4c79-afb3-8092e45b0546 service nova] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Received event network-vif-deleted-d3d9f17a-c9d8-4aaf-8015-dc9825335a25 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:17:12 user nova-compute[74821]: INFO nova.compute.manager [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] [instance: a33991ce-e911-460d-a6d9-ca738830ef2c] Took 3.09 seconds to detach 3 volumes for instance.
Nov 06 13:17:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3d490adc-40d5-4f03-9000-45459414f182 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "5a715806-ff8b-4502-8435-c5de3e3c688a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3d490adc-40d5-4f03-9000-45459414f182 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "5a715806-ff8b-4502-8435-c5de3e3c688a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3d490adc-40d5-4f03-9000-45459414f182 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "5a715806-ff8b-4502-8435-c5de3e3c688a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3d490adc-40d5-4f03-9000-45459414f182 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "5a715806-ff8b-4502-8435-c5de3e3c688a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3d490adc-40d5-4f03-9000-45459414f182 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "5a715806-ff8b-4502-8435-c5de3e3c688a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:12 user nova-compute[74821]: INFO nova.compute.manager [None req-3d490adc-40d5-4f03-9000-45459414f182 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Terminating instance
Nov 06 13:17:12 user nova-compute[74821]: DEBUG nova.compute.manager [None req-3d490adc-40d5-4f03-9000-45459414f182 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:17:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-c1d39269-2cac-4c00-b91d-6e0c1cd8e193 req-7b99ed05-e965-488c-aa31-f38144c40791 service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] Received event network-vif-plugged-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:17:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c1d39269-2cac-4c00-b91d-6e0c1cd8e193 req-7b99ed05-e965-488c-aa31-f38144c40791 service nova] Acquiring lock "3e21d005-f190-478a-a911-e483e1235057-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c1d39269-2cac-4c00-b91d-6e0c1cd8e193 req-7b99ed05-e965-488c-aa31-f38144c40791 service nova] Lock "3e21d005-f190-478a-a911-e483e1235057-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c1d39269-2cac-4c00-b91d-6e0c1cd8e193 req-7b99ed05-e965-488c-aa31-f38144c40791 service nova] Lock "3e21d005-f190-478a-a911-e483e1235057-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-c1d39269-2cac-4c00-b91d-6e0c1cd8e193 req-7b99ed05-e965-488c-aa31-f38144c40791 service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] No waiting events found dispatching network-vif-plugged-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:17:12 user nova-compute[74821]: WARNING nova.compute.manager [req-c1d39269-2cac-4c00-b91d-6e0c1cd8e193 req-7b99ed05-e965-488c-aa31-f38144c40791 service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] Received unexpected event network-vif-plugged-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 for instance with vm_state rescued and task_state unrescuing.
Nov 06 13:17:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-c1d39269-2cac-4c00-b91d-6e0c1cd8e193 req-7b99ed05-e965-488c-aa31-f38144c40791 service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] Received event network-vif-plugged-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:17:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c1d39269-2cac-4c00-b91d-6e0c1cd8e193 req-7b99ed05-e965-488c-aa31-f38144c40791 service nova] Acquiring lock "3e21d005-f190-478a-a911-e483e1235057-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c1d39269-2cac-4c00-b91d-6e0c1cd8e193 req-7b99ed05-e965-488c-aa31-f38144c40791 service nova] Lock "3e21d005-f190-478a-a911-e483e1235057-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c1d39269-2cac-4c00-b91d-6e0c1cd8e193 req-7b99ed05-e965-488c-aa31-f38144c40791 service nova] Lock "3e21d005-f190-478a-a911-e483e1235057-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-c1d39269-2cac-4c00-b91d-6e0c1cd8e193 req-7b99ed05-e965-488c-aa31-f38144c40791 service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] No waiting events found dispatching network-vif-plugged-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:17:12 user nova-compute[74821]: WARNING nova.compute.manager [req-c1d39269-2cac-4c00-b91d-6e0c1cd8e193 req-7b99ed05-e965-488c-aa31-f38144c40791 service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] Received unexpected event network-vif-plugged-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 for instance with vm_state rescued and task_state unrescuing.
Nov 06 13:17:12 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:17:12 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:17:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.517s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:12 user nova-compute[74821]: DEBUG nova.compute.manager [None req-cd5df473-f544-4717-a658-6dd02d56998f tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:17:13 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Deleted allocations for instance a33991ce-e911-460d-a6d9-ca738830ef2c
Nov 06 13:17:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7b7f3711-9eb1-4157-8d05-faedd46b6d0e tempest-TaggedBootDevicesTest-244135857 tempest-TaggedBootDevicesTest-244135857-project-member] Lock "a33991ce-e911-460d-a6d9-ca738830ef2c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.688s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.volume.cinder [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Update attachment failed for attachment bf39f1ce-f662-4a6a-914d-8c1adbe1f0c7. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-569a1fda-856d-40a3-b269-cb11425f67b9) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-569a1fda-856d-40a3-b269-cb11425f67b9)
Nov 06 13:17:13 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Instance destroyed successfully.
Nov 06 13:17:13 user nova-compute[74821]: DEBUG nova.objects.instance [None req-3d490adc-40d5-4f03-9000-45459414f182 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lazy-loading 'resources' on Instance uuid 5a715806-ff8b-4502-8435-c5de3e3c688a {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-3d490adc-40d5-4f03-9000-45459414f182 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T13:10:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-618364180',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-618364180',id=5,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWZZ63YOurS3QQCnNbLxGOa0k9DS7+D4rT/d8IE1TCw1yktKSHhioYCsL5dOWBhVqUbiOYRyokgjKYeQc4mySnCoKy4j7QoOj+bJM6HYi7kjMQxkuBe6IfrmM0otAD68Q==',key_name='tempest-keypair-1555089865',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:15:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07250ce4ef1b429f8a5c3c7763866763',ramdisk_id='',reservation_id='r-ls92k48z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-374688010',owner_user_name='tempest-AttachVolumeShelveTestJSON-374688010-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:15:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c82a5e63234e40f6a8e63b3cb4dc97b3',uuid=5a715806-ff8b-4502-8435-c5de3e3c688a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "address": "fa:16:3e:e1:45:18", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69de9b4-53", "ovs_interfaceid": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-3d490adc-40d5-4f03-9000-45459414f182 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Converting VIF {"id": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "address": "fa:16:3e:e1:45:18", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69de9b4-53", "ovs_interfaceid": "d69de9b4-5366-4d42-b01d-e4ec468a5aa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-3d490adc-40d5-4f03-9000-45459414f182 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:45:18,bridge_name='br-int',has_traffic_filtering=True,id=d69de9b4-5366-4d42-b01d-e4ec468a5aa2,network=Network(5318228c-491a-4ea1-a2b2-49ea8e15dccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69de9b4-53') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG os_vif [None req-3d490adc-40d5-4f03-9000-45459414f182 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:45:18,bridge_name='br-int',has_traffic_filtering=True,id=d69de9b4-5366-4d42-b01d-e4ec468a5aa2,network=Network(5318228c-491a-4ea1-a2b2-49ea8e15dccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69de9b4-53') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-569a1fda-856d-40a3-b269-cb11425f67b9)
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Traceback (most recent call last):
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]     driver_block_device.attach_block_devices(
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]     _log_and_attach(device)
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]     bdm.attach(*attach_args, **attach_kwargs)
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]     ret_val = method(obj, context, *args, **kwargs)
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]     self._do_attach(context, instance, volume, volume_api,
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]     self._volume_attach(context, volume, connector, instance,
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]     connection_info = volume_api.attachment_update(
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]     res = method(self, ctx, *args, **kwargs)
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]     with excutils.save_and_reraise_exception():
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]     self.force_reraise()
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]     raise self.value
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]     context, '3.44', skip_version_check=True).attachments.update(
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]     return method.func(obj, *args, **kwargs)
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]     resp = self._update('/attachments/%s' % id, body)
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]     return self._cs_request(url, 'PUT', **kwargs)
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]     return self.request(url, method, **kwargs)
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa]     raise exceptions.from_response(resp, body)
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-569a1fda-856d-40a3-b269-cb11425f67b9)
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] 
Nov 06 13:17:13 user nova-compute[74821]: DEBUG nova.compute.claims [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Aborting claim: <nova.compute.claims.Claim object at 0x7f7e582496f0> {{(pid=74821) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd69de9b4-53, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6ae5dfab-a6d1-4bc6-88ae-4b1be0d8ed1d) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:17:13 user nova-compute[74821]: INFO os_vif [None req-3d490adc-40d5-4f03-9000-45459414f182 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:45:18,bridge_name='br-int',has_traffic_filtering=True,id=d69de9b4-5366-4d42-b01d-e4ec468a5aa2,network=Network(5318228c-491a-4ea1-a2b2-49ea8e15dccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69de9b4-53')
Nov 06 13:17:13 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-3d490adc-40d5-4f03-9000-45459414f182 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Deleting instance files /opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a_del
Nov 06 13:17:13 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-3d490adc-40d5-4f03-9000-45459414f182 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Deletion of /opt/stack/data/nova/instances/5a715806-ff8b-4502-8435-c5de3e3c688a_del complete
Nov 06 13:17:13 user nova-compute[74821]: INFO nova.compute.manager [None req-3d490adc-40d5-4f03-9000-45459414f182 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 06 13:17:13 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-3d490adc-40d5-4f03-9000-45459414f182 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.527s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG nova.compute.manager [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Build of instance 129b2a08-6e71-4385-b700-9988b9b737fa aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-569a1fda-856d-40a3-b269-cb11425f67b9) {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG nova.compute.utils [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Build of instance 129b2a08-6e71-4385-b700-9988b9b737fa aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=74821) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 06 13:17:13 user nova-compute[74821]: ERROR nova.compute.manager [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Build of instance 129b2a08-6e71-4385-b700-9988b9b737fa aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-569a1fda-856d-40a3-b269-cb11425f67b9): nova.exception.BuildAbortException: Build of instance 129b2a08-6e71-4385-b700-9988b9b737fa aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-569a1fda-856d-40a3-b269-cb11425f67b9)
Nov 06 13:17:13 user nova-compute[74821]: DEBUG nova.compute.manager [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Unplugging VIFs for instance {{(pid=74821) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:16:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500043253',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500043253',id=15,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqGSUGMR9RdTXN11MbGvztF5CmAR6AI0fWICfMIW681NmezPb8Vg8M222q+YPz/fHyU9FdJcontzW5x22bTFdEhjVFlQW+1R2xuk8Wxwz+lQScn4ijayqQpgyMguDgX7g==',key_name='tempest-keypair-2015583419',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='deb2a4a908ee45a9a105374c4220433c',ramdisk_id='',reservation_id='r-d803uefb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-43387291',owner_user_name='tempest-TaggedBootDevicesTest_v242-43387291-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:16:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='068bc256c4cb4a83ab0b008039eaf8c5',uuid=129b2a08-6e71-4385-b700-9988b9b737fa,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9af4bc1-4ebd-46e7-a573-1630eef79d5c", "address": "fa:16:3e:1b:19:75", "network": {"id": "deb9725b-a62e-4cb4-b6db-297ff4695d35", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1344158242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9af4bc1-4e", "ovs_interfaceid": "b9af4bc1-4ebd-46e7-a573-1630eef79d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Converting VIF {"id": "b9af4bc1-4ebd-46e7-a573-1630eef79d5c", "address": "fa:16:3e:1b:19:75", "network": {"id": "deb9725b-a62e-4cb4-b6db-297ff4695d35", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1344158242-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9af4bc1-4e", "ovs_interfaceid": "b9af4bc1-4ebd-46e7-a573-1630eef79d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:19:75,bridge_name='br-int',has_traffic_filtering=True,id=b9af4bc1-4ebd-46e7-a573-1630eef79d5c,network=Network(deb9725b-a62e-4cb4-b6db-297ff4695d35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9af4bc1-4e') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG os_vif [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:19:75,bridge_name='br-int',has_traffic_filtering=True,id=b9af4bc1-4ebd-46e7-a573-1630eef79d5c,network=Network(deb9725b-a62e-4cb4-b6db-297ff4695d35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9af4bc1-4e') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9af4bc1-4e, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:17:13 user nova-compute[74821]: INFO os_vif [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:19:75,bridge_name='br-int',has_traffic_filtering=True,id=b9af4bc1-4ebd-46e7-a573-1630eef79d5c,network=Network(deb9725b-a62e-4cb4-b6db-297ff4695d35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9af4bc1-4e')
Nov 06 13:17:13 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:16:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500043253',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500043253',id=15,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqGSUGMR9RdTXN11MbGvztF5CmAR6AI0fWICfMIW681NmezPb8Vg8M222q+YPz/fHyU9FdJcontzW5x22bTFdEhjVFlQW+1R2xuk8Wxwz+lQScn4ijayqQpgyMguDgX7g==',key_name='tempest-keypair-2015583419',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='deb2a4a908ee45a9a105374c4220433c',ramdisk_id='',reservation_id='r-d803uefb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-43387291',owner_user_name='tempest-TaggedBootDevicesTest_v242-43387291-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:16:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='068bc256c4cb4a83ab0b008039eaf8c5',uuid=129b2a08-6e71-4385-b700-9988b9b737fa,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "951bf67b-ccde-4bd6-b40f-3a2a4d7c2dee", "address": "fa:16:3e:1a:4e:5b", "network": {"id": "c1d19f2a-0571-4144-bedb-4f2d9ca7fd7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-861526093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951bf67b-cc", "ovs_interfaceid": "951bf67b-ccde-4bd6-b40f-3a2a4d7c2dee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Converting VIF {"id": "951bf67b-ccde-4bd6-b40f-3a2a4d7c2dee", "address": "fa:16:3e:1a:4e:5b", "network": {"id": "c1d19f2a-0571-4144-bedb-4f2d9ca7fd7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-861526093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951bf67b-cc", "ovs_interfaceid": "951bf67b-ccde-4bd6-b40f-3a2a4d7c2dee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:4e:5b,bridge_name='br-int',has_traffic_filtering=True,id=951bf67b-ccde-4bd6-b40f-3a2a4d7c2dee,network=Network(c1d19f2a-0571-4144-bedb-4f2d9ca7fd7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap951bf67b-cc') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG os_vif [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:4e:5b,bridge_name='br-int',has_traffic_filtering=True,id=951bf67b-ccde-4bd6-b40f-3a2a4d7c2dee,network=Network(c1d19f2a-0571-4144-bedb-4f2d9ca7fd7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap951bf67b-cc') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap951bf67b-cc, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:17:13 user nova-compute[74821]: INFO os_vif [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:4e:5b,bridge_name='br-int',has_traffic_filtering=True,id=951bf67b-ccde-4bd6-b40f-3a2a4d7c2dee,network=Network(c1d19f2a-0571-4144-bedb-4f2d9ca7fd7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap951bf67b-cc')
Nov 06 13:17:13 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:16:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500043253',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500043253',id=15,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqGSUGMR9RdTXN11MbGvztF5CmAR6AI0fWICfMIW681NmezPb8Vg8M222q+YPz/fHyU9FdJcontzW5x22bTFdEhjVFlQW+1R2xuk8Wxwz+lQScn4ijayqQpgyMguDgX7g==',key_name='tempest-keypair-2015583419',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='deb2a4a908ee45a9a105374c4220433c',ramdisk_id='',reservation_id='r-d803uefb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-43387291',owner_user_name='tempest-TaggedBootDevicesTest_v242-43387291-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:16:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='068bc256c4cb4a83ab0b008039eaf8c5',uuid=129b2a08-6e71-4385-b700-9988b9b737fa,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c780cd18-a22e-4516-8628-042d7b5baa2a", "address": "fa:16:3e:37:47:2a", "network": {"id": "c1d19f2a-0571-4144-bedb-4f2d9ca7fd7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-861526093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc780cd18-a2", "ovs_interfaceid": "c780cd18-a22e-4516-8628-042d7b5baa2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Converting VIF {"id": "c780cd18-a22e-4516-8628-042d7b5baa2a", "address": "fa:16:3e:37:47:2a", "network": {"id": "c1d19f2a-0571-4144-bedb-4f2d9ca7fd7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-861526093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc780cd18-a2", "ovs_interfaceid": "c780cd18-a22e-4516-8628-042d7b5baa2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:47:2a,bridge_name='br-int',has_traffic_filtering=True,id=c780cd18-a22e-4516-8628-042d7b5baa2a,network=Network(c1d19f2a-0571-4144-bedb-4f2d9ca7fd7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc780cd18-a2') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG os_vif [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:47:2a,bridge_name='br-int',has_traffic_filtering=True,id=c780cd18-a22e-4516-8628-042d7b5baa2a,network=Network(c1d19f2a-0571-4144-bedb-4f2d9ca7fd7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc780cd18-a2') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc780cd18-a2, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:17:13 user nova-compute[74821]: INFO os_vif [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:47:2a,bridge_name='br-int',has_traffic_filtering=True,id=c780cd18-a22e-4516-8628-042d7b5baa2a,network=Network(c1d19f2a-0571-4144-bedb-4f2d9ca7fd7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc780cd18-a2')
Nov 06 13:17:13 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:16:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500043253',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500043253',id=15,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqGSUGMR9RdTXN11MbGvztF5CmAR6AI0fWICfMIW681NmezPb8Vg8M222q+YPz/fHyU9FdJcontzW5x22bTFdEhjVFlQW+1R2xuk8Wxwz+lQScn4ijayqQpgyMguDgX7g==',key_name='tempest-keypair-2015583419',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='deb2a4a908ee45a9a105374c4220433c',ramdisk_id='',reservation_id='r-d803uefb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-43387291',owner_user_name='tempest-TaggedBootDevicesTest_v242-43387291-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:16:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='068bc256c4cb4a83ab0b008039eaf8c5',uuid=129b2a08-6e71-4385-b700-9988b9b737fa,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae8e42c0-a0ba-41ac-9a5c-5a8c791f9a1f", "address": "fa:16:3e:47:79:eb", "network": {"id": "c1d19f2a-0571-4144-bedb-4f2d9ca7fd7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-861526093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8e42c0-a0", "ovs_interfaceid": "ae8e42c0-a0ba-41ac-9a5c-5a8c791f9a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Converting VIF {"id": "ae8e42c0-a0ba-41ac-9a5c-5a8c791f9a1f", "address": "fa:16:3e:47:79:eb", "network": {"id": "c1d19f2a-0571-4144-bedb-4f2d9ca7fd7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-861526093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8e42c0-a0", "ovs_interfaceid": "ae8e42c0-a0ba-41ac-9a5c-5a8c791f9a1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:79:eb,bridge_name='br-int',has_traffic_filtering=True,id=ae8e42c0-a0ba-41ac-9a5c-5a8c791f9a1f,network=Network(c1d19f2a-0571-4144-bedb-4f2d9ca7fd7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8e42c0-a0') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG os_vif [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:79:eb,bridge_name='br-int',has_traffic_filtering=True,id=ae8e42c0-a0ba-41ac-9a5c-5a8c791f9a1f,network=Network(c1d19f2a-0571-4144-bedb-4f2d9ca7fd7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8e42c0-a0') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae8e42c0-a0, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:17:13 user nova-compute[74821]: INFO os_vif [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:79:eb,bridge_name='br-int',has_traffic_filtering=True,id=ae8e42c0-a0ba-41ac-9a5c-5a8c791f9a1f,network=Network(c1d19f2a-0571-4144-bedb-4f2d9ca7fd7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8e42c0-a0')
Nov 06 13:17:13 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:16:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500043253',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500043253',id=15,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqGSUGMR9RdTXN11MbGvztF5CmAR6AI0fWICfMIW681NmezPb8Vg8M222q+YPz/fHyU9FdJcontzW5x22bTFdEhjVFlQW+1R2xuk8Wxwz+lQScn4ijayqQpgyMguDgX7g==',key_name='tempest-keypair-2015583419',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='deb2a4a908ee45a9a105374c4220433c',ramdisk_id='',reservation_id='r-d803uefb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-43387291',owner_user_name='tempest-TaggedBootDevicesTest_v242-43387291-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:16:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='068bc256c4cb4a83ab0b008039eaf8c5',uuid=129b2a08-6e71-4385-b700-9988b9b737fa,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e5dacb4-e83b-4b50-89c3-4a3d2359f819", "address": "fa:16:3e:dc:26:fa", "network": {"id": "c1d19f2a-0571-4144-bedb-4f2d9ca7fd7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-861526093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e5dacb4-e8", "ovs_interfaceid": "3e5dacb4-e83b-4b50-89c3-4a3d2359f819", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Converting VIF {"id": "3e5dacb4-e83b-4b50-89c3-4a3d2359f819", "address": "fa:16:3e:dc:26:fa", "network": {"id": "c1d19f2a-0571-4144-bedb-4f2d9ca7fd7a", "bridge": "br-int", "label": "tempest-device-tagging-net1-861526093", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e5dacb4-e8", "ovs_interfaceid": "3e5dacb4-e83b-4b50-89c3-4a3d2359f819", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:26:fa,bridge_name='br-int',has_traffic_filtering=True,id=3e5dacb4-e83b-4b50-89c3-4a3d2359f819,network=Network(c1d19f2a-0571-4144-bedb-4f2d9ca7fd7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e5dacb4-e8') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG os_vif [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:26:fa,bridge_name='br-int',has_traffic_filtering=True,id=3e5dacb4-e83b-4b50-89c3-4a3d2359f819,network=Network(c1d19f2a-0571-4144-bedb-4f2d9ca7fd7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e5dacb4-e8') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e5dacb4-e8, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:17:13 user nova-compute[74821]: INFO os_vif [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:26:fa,bridge_name='br-int',has_traffic_filtering=True,id=3e5dacb4-e83b-4b50-89c3-4a3d2359f819,network=Network(c1d19f2a-0571-4144-bedb-4f2d9ca7fd7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e5dacb4-e8')
Nov 06 13:17:13 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:16:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500043253',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500043253',id=15,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqGSUGMR9RdTXN11MbGvztF5CmAR6AI0fWICfMIW681NmezPb8Vg8M222q+YPz/fHyU9FdJcontzW5x22bTFdEhjVFlQW+1R2xuk8Wxwz+lQScn4ijayqQpgyMguDgX7g==',key_name='tempest-keypair-2015583419',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='deb2a4a908ee45a9a105374c4220433c',ramdisk_id='',reservation_id='r-d803uefb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-43387291',owner_user_name='tempest-TaggedBootDevicesTest_v242-43387291-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:16:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='068bc256c4cb4a83ab0b008039eaf8c5',uuid=129b2a08-6e71-4385-b700-9988b9b737fa,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4944b6c-81c9-4d2d-8fff-d3d389c3a251", "address": "fa:16:3e:00:98:fc", "network": {"id": "b9d4a482-bbdd-4647-bbb8-881cf9923eb3", "bridge": "br-int", "label": "tempest-device-tagging-net2-718261885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4944b6c-81", "ovs_interfaceid": "e4944b6c-81c9-4d2d-8fff-d3d389c3a251", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Converting VIF {"id": "e4944b6c-81c9-4d2d-8fff-d3d389c3a251", "address": "fa:16:3e:00:98:fc", "network": {"id": "b9d4a482-bbdd-4647-bbb8-881cf9923eb3", "bridge": "br-int", "label": "tempest-device-tagging-net2-718261885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4944b6c-81", "ovs_interfaceid": "e4944b6c-81c9-4d2d-8fff-d3d389c3a251", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:98:fc,bridge_name='br-int',has_traffic_filtering=True,id=e4944b6c-81c9-4d2d-8fff-d3d389c3a251,network=Network(b9d4a482-bbdd-4647-bbb8-881cf9923eb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4944b6c-81') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG os_vif [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:98:fc,bridge_name='br-int',has_traffic_filtering=True,id=e4944b6c-81c9-4d2d-8fff-d3d389c3a251,network=Network(b9d4a482-bbdd-4647-bbb8-881cf9923eb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4944b6c-81') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4944b6c-81, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:17:13 user nova-compute[74821]: INFO os_vif [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:98:fc,bridge_name='br-int',has_traffic_filtering=True,id=e4944b6c-81c9-4d2d-8fff-d3d389c3a251,network=Network(b9d4a482-bbdd-4647-bbb8-881cf9923eb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4944b6c-81')
Nov 06 13:17:13 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:16:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-500043253',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-500043253',id=15,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqGSUGMR9RdTXN11MbGvztF5CmAR6AI0fWICfMIW681NmezPb8Vg8M222q+YPz/fHyU9FdJcontzW5x22bTFdEhjVFlQW+1R2xuk8Wxwz+lQScn4ijayqQpgyMguDgX7g==',key_name='tempest-keypair-2015583419',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='deb2a4a908ee45a9a105374c4220433c',ramdisk_id='',reservation_id='r-d803uefb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-43387291',owner_user_name='tempest-TaggedBootDevicesTest_v242-43387291-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:16:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='068bc256c4cb4a83ab0b008039eaf8c5',uuid=129b2a08-6e71-4385-b700-9988b9b737fa,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4a8aaff-5aaf-42ea-874f-ad49ba098d87", "address": "fa:16:3e:01:1b:21", "network": {"id": "b9d4a482-bbdd-4647-bbb8-881cf9923eb3", "bridge": "br-int", "label": "tempest-device-tagging-net2-718261885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a8aaff-5a", "ovs_interfaceid": "a4a8aaff-5aaf-42ea-874f-ad49ba098d87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Converting VIF {"id": "a4a8aaff-5aaf-42ea-874f-ad49ba098d87", "address": "fa:16:3e:01:1b:21", "network": {"id": "b9d4a482-bbdd-4647-bbb8-881cf9923eb3", "bridge": "br-int", "label": "tempest-device-tagging-net2-718261885", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "deb2a4a908ee45a9a105374c4220433c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a8aaff-5a", "ovs_interfaceid": "a4a8aaff-5aaf-42ea-874f-ad49ba098d87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:1b:21,bridge_name='br-int',has_traffic_filtering=True,id=a4a8aaff-5aaf-42ea-874f-ad49ba098d87,network=Network(b9d4a482-bbdd-4647-bbb8-881cf9923eb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4a8aaff-5a') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG os_vif [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:1b:21,bridge_name='br-int',has_traffic_filtering=True,id=a4a8aaff-5aaf-42ea-874f-ad49ba098d87,network=Network(b9d4a482-bbdd-4647-bbb8-881cf9923eb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4a8aaff-5a') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4a8aaff-5a, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:17:13 user nova-compute[74821]: INFO os_vif [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:1b:21,bridge_name='br-int',has_traffic_filtering=True,id=a4a8aaff-5aaf-42ea-874f-ad49ba098d87,network=Network(b9d4a482-bbdd-4647-bbb8-881cf9923eb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4a8aaff-5a')
Nov 06 13:17:13 user nova-compute[74821]: DEBUG nova.compute.manager [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Unplugged VIFs for instance {{(pid=74821) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG nova.compute.manager [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:17:13 user nova-compute[74821]: DEBUG nova.network.neutron [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:17:14 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:14 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:17:14 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Took 0.84 seconds to deallocate network for instance.
Nov 06 13:17:14 user nova-compute[74821]: DEBUG nova.compute.manager [req-0225a7e6-1f8c-4677-888d-11fac3915809 req-f45dc41e-3708-4dca-8734-47aadab278bd service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Received event network-vif-deleted-d69de9b4-5366-4d42-b01d-e4ec468a5aa2 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:17:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3d490adc-40d5-4f03-9000-45459414f182 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3d490adc-40d5-4f03-9000-45459414f182 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:14 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-3d490adc-40d5-4f03-9000-45459414f182 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:17:14 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-3d490adc-40d5-4f03-9000-45459414f182 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:17:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3d490adc-40d5-4f03-9000-45459414f182 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:14 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-3d490adc-40d5-4f03-9000-45459414f182 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Deleted allocations for instance 5a715806-ff8b-4502-8435-c5de3e3c688a
Nov 06 13:17:14 user nova-compute[74821]: DEBUG nova.compute.manager [req-640c2dee-64cd-4337-a9b1-9f975839bb58 req-3c819418-4913-4d6e-83a5-1b86a045a386 service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Received event network-vif-unplugged-d69de9b4-5366-4d42-b01d-e4ec468a5aa2 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:17:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-640c2dee-64cd-4337-a9b1-9f975839bb58 req-3c819418-4913-4d6e-83a5-1b86a045a386 service nova] Acquiring lock "5a715806-ff8b-4502-8435-c5de3e3c688a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-640c2dee-64cd-4337-a9b1-9f975839bb58 req-3c819418-4913-4d6e-83a5-1b86a045a386 service nova] Lock "5a715806-ff8b-4502-8435-c5de3e3c688a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-640c2dee-64cd-4337-a9b1-9f975839bb58 req-3c819418-4913-4d6e-83a5-1b86a045a386 service nova] Lock "5a715806-ff8b-4502-8435-c5de3e3c688a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:14 user nova-compute[74821]: DEBUG nova.compute.manager [req-640c2dee-64cd-4337-a9b1-9f975839bb58 req-3c819418-4913-4d6e-83a5-1b86a045a386 service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] No waiting events found dispatching network-vif-unplugged-d69de9b4-5366-4d42-b01d-e4ec468a5aa2 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:17:14 user nova-compute[74821]: WARNING nova.compute.manager [req-640c2dee-64cd-4337-a9b1-9f975839bb58 req-3c819418-4913-4d6e-83a5-1b86a045a386 service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Received unexpected event network-vif-unplugged-d69de9b4-5366-4d42-b01d-e4ec468a5aa2 for instance with vm_state deleted and task_state None.
Nov 06 13:17:14 user nova-compute[74821]: DEBUG nova.compute.manager [req-640c2dee-64cd-4337-a9b1-9f975839bb58 req-3c819418-4913-4d6e-83a5-1b86a045a386 service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Received event network-vif-plugged-d69de9b4-5366-4d42-b01d-e4ec468a5aa2 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:17:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-640c2dee-64cd-4337-a9b1-9f975839bb58 req-3c819418-4913-4d6e-83a5-1b86a045a386 service nova] Acquiring lock "5a715806-ff8b-4502-8435-c5de3e3c688a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-640c2dee-64cd-4337-a9b1-9f975839bb58 req-3c819418-4913-4d6e-83a5-1b86a045a386 service nova] Lock "5a715806-ff8b-4502-8435-c5de3e3c688a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-640c2dee-64cd-4337-a9b1-9f975839bb58 req-3c819418-4913-4d6e-83a5-1b86a045a386 service nova] Lock "5a715806-ff8b-4502-8435-c5de3e3c688a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:14 user nova-compute[74821]: DEBUG nova.compute.manager [req-640c2dee-64cd-4337-a9b1-9f975839bb58 req-3c819418-4913-4d6e-83a5-1b86a045a386 service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] No waiting events found dispatching network-vif-plugged-d69de9b4-5366-4d42-b01d-e4ec468a5aa2 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:17:14 user nova-compute[74821]: WARNING nova.compute.manager [req-640c2dee-64cd-4337-a9b1-9f975839bb58 req-3c819418-4913-4d6e-83a5-1b86a045a386 service nova] [instance: 5a715806-ff8b-4502-8435-c5de3e3c688a] Received unexpected event network-vif-plugged-d69de9b4-5366-4d42-b01d-e4ec468a5aa2 for instance with vm_state deleted and task_state None.
Nov 06 13:17:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3d490adc-40d5-4f03-9000-45459414f182 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "5a715806-ff8b-4502-8435-c5de3e3c688a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.464s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:19 user nova-compute[74821]: DEBUG nova.network.neutron [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:17:19 user nova-compute[74821]: INFO nova.compute.manager [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Took 5.46 seconds to deallocate network for instance.
Nov 06 13:17:19 user nova-compute[74821]: DEBUG nova.compute.manager [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Detaching volume: c01ef409-4527-4e30-936c-f700c7b2643e {{(pid=74821) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 06 13:17:19 user nova-compute[74821]: INFO nova.compute.manager [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Detaching volume c01ef409-4527-4e30-936c-f700c7b2643e
Nov 06 13:17:19 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Skipping driver_detach during remote rebuild. {{(pid=74821) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 06 13:17:20 user nova-compute[74821]: WARNING nova.compute.manager [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Failed to detach volume: c01ef409-4527-4e30-936c-f700c7b2643e due to 'NoneType' object has no attribute 'devices'
Nov 06 13:17:20 user nova-compute[74821]: DEBUG nova.compute.manager [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Detaching volume: 1c9e538c-20ba-45f3-a5cc-162f8315a1bc {{(pid=74821) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 06 13:17:20 user nova-compute[74821]: INFO nova.compute.manager [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Detaching volume 1c9e538c-20ba-45f3-a5cc-162f8315a1bc
Nov 06 13:17:20 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Skipping driver_detach during remote rebuild. {{(pid=74821) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 06 13:17:20 user nova-compute[74821]: WARNING nova.compute.manager [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Failed to detach volume: 1c9e538c-20ba-45f3-a5cc-162f8315a1bc due to 'NoneType' object has no attribute 'devices'
Nov 06 13:17:20 user nova-compute[74821]: DEBUG nova.compute.manager [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Detaching volume: ca00f9b8-ef2f-40cc-93c4-2602c015d8c7 {{(pid=74821) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 06 13:17:20 user nova-compute[74821]: INFO nova.compute.manager [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Detaching volume ca00f9b8-ef2f-40cc-93c4-2602c015d8c7
Nov 06 13:17:20 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] [instance: 129b2a08-6e71-4385-b700-9988b9b737fa] Skipping driver_detach during remote rebuild. {{(pid=74821) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 06 13:17:21 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Deleted allocations for instance 129b2a08-6e71-4385-b700-9988b9b737fa
Nov 06 13:17:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3331ea3b-cbad-4ba2-b5c7-17e24c4f05a2 tempest-TaggedBootDevicesTest_v242-43387291 tempest-TaggedBootDevicesTest_v242-43387291-project-member] Lock "129b2a08-6e71-4385-b700-9988b9b737fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 61.460s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:21 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:24 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._sync_power_states {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:17:24 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Triggering sync for uuid 3e21d005-f190-478a-a911-e483e1235057 {{(pid=74821) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 13:17:24 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Triggering sync for uuid 311817c5-7b08-4da9-98eb-c685f37e6fd3 {{(pid=74821) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 13:17:24 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Triggering sync for uuid f8c537c6-fa3e-4842-9471-7258a22c01f9 {{(pid=74821) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 13:17:24 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Triggering sync for uuid f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf {{(pid=74821) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 13:17:24 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Triggering sync for uuid 2de346cb-9858-47b8-a86c-4fde720d6127 {{(pid=74821) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 13:17:24 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Triggering sync for uuid 49c65aca-8392-46ba-8fa3-b47ff2416cb9 {{(pid=74821) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 13:17:24 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Triggering sync for uuid bd32c388-aa78-43ef-ae93-8230b8eba8af {{(pid=74821) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 13:17:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "3e21d005-f190-478a-a911-e483e1235057" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "3e21d005-f190-478a-a911-e483e1235057" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "311817c5-7b08-4da9-98eb-c685f37e6fd3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "311817c5-7b08-4da9-98eb-c685f37e6fd3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "f8c537c6-fa3e-4842-9471-7258a22c01f9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "f8c537c6-fa3e-4842-9471-7258a22c01f9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "2de346cb-9858-47b8-a86c-4fde720d6127" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "2de346cb-9858-47b8-a86c-4fde720d6127" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "49c65aca-8392-46ba-8fa3-b47ff2416cb9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "49c65aca-8392-46ba-8fa3-b47ff2416cb9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "bd32c388-aa78-43ef-ae93-8230b8eba8af" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "bd32c388-aa78-43ef-ae93-8230b8eba8af" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "3e21d005-f190-478a-a911-e483e1235057" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "bd32c388-aa78-43ef-ae93-8230b8eba8af" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "311817c5-7b08-4da9-98eb-c685f37e6fd3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "f8c537c6-fa3e-4842-9471-7258a22c01f9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "49c65aca-8392-46ba-8fa3-b47ff2416cb9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "2de346cb-9858-47b8-a86c-4fde720d6127" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:25 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:17:26 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:17:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:28 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:17:28 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:17:28 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:17:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-f8c537c6-fa3e-4842-9471-7258a22c01f9" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:17:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-f8c537c6-fa3e-4842-9471-7258a22c01f9" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:17:29 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:17:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:29 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Updating instance_info_cache with network_info: [{"id": "05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b", "address": "fa:16:3e:83:64:35", "network": {"id": "d5bae261-3db3-492a-a55e-df6c0fd01fe1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-60002553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86724840a9ba4cc486fd1d0d0477c778", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05f5a65e-3f", "ovs_interfaceid": "05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:17:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-f8c537c6-fa3e-4842-9471-7258a22c01f9" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:17:29 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:17:29 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:17:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:30 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:17:30 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:17:31 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:17:31 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:17:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:32 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:17:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json" returned: 0 in 0.269s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:36 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:17:36 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:17:36 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=7719MB free_disk=25.580738067626953GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:17:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:36 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 3e21d005-f190-478a-a911-e483e1235057 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:17:36 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 311817c5-7b08-4da9-98eb-c685f37e6fd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:17:36 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance f8c537c6-fa3e-4842-9471-7258a22c01f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:17:36 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:17:36 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 2de346cb-9858-47b8-a86c-4fde720d6127 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:17:36 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 49c65aca-8392-46ba-8fa3-b47ff2416cb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:17:36 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance bd32c388-aa78-43ef-ae93-8230b8eba8af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:17:36 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:17:36 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:17:36 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:17:36 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:17:36 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:17:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.496s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:37 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:17:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ec8ed122-82c6-4015-8c13-7448a0a123e0 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Acquiring lock "f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ec8ed122-82c6-4015-8c13-7448a0a123e0 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Lock "f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ec8ed122-82c6-4015-8c13-7448a0a123e0 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Acquiring lock "f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ec8ed122-82c6-4015-8c13-7448a0a123e0 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Lock "f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ec8ed122-82c6-4015-8c13-7448a0a123e0 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Lock "f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:39 user nova-compute[74821]: INFO nova.compute.manager [None req-ec8ed122-82c6-4015-8c13-7448a0a123e0 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Terminating instance
Nov 06 13:17:39 user nova-compute[74821]: DEBUG nova.compute.manager [None req-ec8ed122-82c6-4015-8c13-7448a0a123e0 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:17:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:40 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Instance destroyed successfully.
Nov 06 13:17:40 user nova-compute[74821]: DEBUG nova.objects.instance [None req-ec8ed122-82c6-4015-8c13-7448a0a123e0 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Lazy-loading 'resources' on Instance uuid f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:17:40 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-ec8ed122-82c6-4015-8c13-7448a0a123e0 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:15:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-362922964',display_name='tempest-VolumesActionsTest-instance-362922964',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-362922964',id=13,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:15:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d784816c0f14c34afecba6292236040',ramdisk_id='',reservation_id='r-8ghcduzw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1240738149',owner_user_name='tempest-VolumesActionsTest-1240738149-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:15:58Z,user_data=None,user_id='ee1d041e07fd4b7d8a5fcb864243058c',uuid=f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d631a76-0d6f-4132-a87b-c6baf800c911", "address": "fa:16:3e:9e:a0:c0", "network": {"id": "e73a1b38-3c27-4b87-a0f0-f746711d4363", "bridge": "br-int", "label": "tempest-VolumesActionsTest-544363737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d784816c0f14c34afecba6292236040", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d631a76-0d", "ovs_interfaceid": "2d631a76-0d6f-4132-a87b-c6baf800c911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:17:40 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-ec8ed122-82c6-4015-8c13-7448a0a123e0 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Converting VIF {"id": "2d631a76-0d6f-4132-a87b-c6baf800c911", "address": "fa:16:3e:9e:a0:c0", "network": {"id": "e73a1b38-3c27-4b87-a0f0-f746711d4363", "bridge": "br-int", "label": "tempest-VolumesActionsTest-544363737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d784816c0f14c34afecba6292236040", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d631a76-0d", "ovs_interfaceid": "2d631a76-0d6f-4132-a87b-c6baf800c911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:17:40 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-ec8ed122-82c6-4015-8c13-7448a0a123e0 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a0:c0,bridge_name='br-int',has_traffic_filtering=True,id=2d631a76-0d6f-4132-a87b-c6baf800c911,network=Network(e73a1b38-3c27-4b87-a0f0-f746711d4363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d631a76-0d') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:17:40 user nova-compute[74821]: DEBUG os_vif [None req-ec8ed122-82c6-4015-8c13-7448a0a123e0 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a0:c0,bridge_name='br-int',has_traffic_filtering=True,id=2d631a76-0d6f-4132-a87b-c6baf800c911,network=Network(e73a1b38-3c27-4b87-a0f0-f746711d4363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d631a76-0d') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:17:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d631a76-0d, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:17:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:17:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7537a9f-fd7a-4279-8f22-66afdd4f5eb6) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:17:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:40 user nova-compute[74821]: INFO os_vif [None req-ec8ed122-82c6-4015-8c13-7448a0a123e0 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a0:c0,bridge_name='br-int',has_traffic_filtering=True,id=2d631a76-0d6f-4132-a87b-c6baf800c911,network=Network(e73a1b38-3c27-4b87-a0f0-f746711d4363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d631a76-0d')
Nov 06 13:17:40 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-ec8ed122-82c6-4015-8c13-7448a0a123e0 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Deleting instance files /opt/stack/data/nova/instances/f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf_del
Nov 06 13:17:40 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-ec8ed122-82c6-4015-8c13-7448a0a123e0 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Deletion of /opt/stack/data/nova/instances/f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf_del complete
Nov 06 13:17:40 user nova-compute[74821]: INFO nova.compute.manager [None req-ec8ed122-82c6-4015-8c13-7448a0a123e0 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 06 13:17:40 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-ec8ed122-82c6-4015-8c13-7448a0a123e0 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:17:40 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:17:40 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:17:41 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:17:41 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Took 0.77 seconds to deallocate network for instance.
Nov 06 13:17:41 user nova-compute[74821]: DEBUG nova.compute.manager [req-032b54a7-461c-4fd1-bf5e-7b613e2ee0de req-0560bed1-545b-4b31-a92f-7b8054e189fa service nova] [instance: f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf] Received event network-vif-deleted-2d631a76-0d6f-4132-a87b-c6baf800c911 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:17:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ec8ed122-82c6-4015-8c13-7448a0a123e0 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ec8ed122-82c6-4015-8c13-7448a0a123e0 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Acquiring lock "107abf1d-96da-4406-8111-ef0bc09fb3e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "107abf1d-96da-4406-8111-ef0bc09fb3e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:41 user nova-compute[74821]: DEBUG nova.compute.manager [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:17:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:41 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-ec8ed122-82c6-4015-8c13-7448a0a123e0 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:17:41 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-ec8ed122-82c6-4015-8c13-7448a0a123e0 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:17:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ec8ed122-82c6-4015-8c13-7448a0a123e0 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.178s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:41 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:17:41 user nova-compute[74821]: INFO nova.compute.claims [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Claim successful on node user
Nov 06 13:17:41 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-ec8ed122-82c6-4015-8c13-7448a0a123e0 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Deleted allocations for instance f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf
Nov 06 13:17:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ec8ed122-82c6-4015-8c13-7448a0a123e0 tempest-VolumesActionsTest-1240738149 tempest-VolumesActionsTest-1240738149-project-member] Lock "f0c0a94c-c0f9-4d79-a2e2-df64f12e0aaf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.322s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:42 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:17:42 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:17:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.347s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:42 user nova-compute[74821]: DEBUG nova.compute.manager [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:17:42 user nova-compute[74821]: DEBUG nova.compute.manager [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:17:42 user nova-compute[74821]: DEBUG nova.network.neutron [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:17:42 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:17:42 user nova-compute[74821]: DEBUG nova.compute.manager [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:17:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:42 user nova-compute[74821]: DEBUG nova.policy [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0b7addf6de74979a206dfccac04f475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc877e77ae92437f8ae2f5e4d9b65947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:17:42 user nova-compute[74821]: DEBUG nova.compute.manager [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:17:42 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:17:42 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Creating image(s)
Nov 06 13:17:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Acquiring lock "/opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "/opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "/opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.168s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.176s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk 1073741824" returned: 0 in 0.053s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.196s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:43 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Checking if we can resize image /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:17:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:43 user nova-compute[74821]: DEBUG nova.network.neutron [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Successfully created port: 3ce43b79-45cd-4110-9508-0278e47d5bc8 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:17:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:43 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Cannot resize image /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:17:43 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:17:43 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Ensure instance console log exists: /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:17:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:44 user nova-compute[74821]: DEBUG nova.compute.manager [req-9fe0af18-b51a-4c3e-aa23-dc025857653e req-3c39bd21-f17d-45b8-868c-1af0098d3e42 service nova] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Received event network-changed-364b4308-8730-4b11-90a1-48ea6ab3de60 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:17:44 user nova-compute[74821]: DEBUG nova.compute.manager [req-9fe0af18-b51a-4c3e-aa23-dc025857653e req-3c39bd21-f17d-45b8-868c-1af0098d3e42 service nova] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Refreshing instance network info cache due to event network-changed-364b4308-8730-4b11-90a1-48ea6ab3de60. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:17:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-9fe0af18-b51a-4c3e-aa23-dc025857653e req-3c39bd21-f17d-45b8-868c-1af0098d3e42 service nova] Acquiring lock "refresh_cache-2de346cb-9858-47b8-a86c-4fde720d6127" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:17:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-9fe0af18-b51a-4c3e-aa23-dc025857653e req-3c39bd21-f17d-45b8-868c-1af0098d3e42 service nova] Acquired lock "refresh_cache-2de346cb-9858-47b8-a86c-4fde720d6127" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:17:44 user nova-compute[74821]: DEBUG nova.network.neutron [req-9fe0af18-b51a-4c3e-aa23-dc025857653e req-3c39bd21-f17d-45b8-868c-1af0098d3e42 service nova] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Refreshing network info cache for port 364b4308-8730-4b11-90a1-48ea6ab3de60 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:17:44 user nova-compute[74821]: DEBUG nova.network.neutron [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Successfully updated port: 3ce43b79-45cd-4110-9508-0278e47d5bc8 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:17:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Acquiring lock "refresh_cache-107abf1d-96da-4406-8111-ef0bc09fb3e3" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:17:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Acquired lock "refresh_cache-107abf1d-96da-4406-8111-ef0bc09fb3e3" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:17:44 user nova-compute[74821]: DEBUG nova.network.neutron [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:17:44 user nova-compute[74821]: DEBUG nova.compute.manager [req-e76c17f6-e600-47d4-829e-858f0ea4b8af req-dafd624d-72ab-47d6-bbe7-afa04b3cc883 service nova] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Received event network-changed-3ce43b79-45cd-4110-9508-0278e47d5bc8 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:17:44 user nova-compute[74821]: DEBUG nova.compute.manager [req-e76c17f6-e600-47d4-829e-858f0ea4b8af req-dafd624d-72ab-47d6-bbe7-afa04b3cc883 service nova] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Refreshing instance network info cache due to event network-changed-3ce43b79-45cd-4110-9508-0278e47d5bc8. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:17:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e76c17f6-e600-47d4-829e-858f0ea4b8af req-dafd624d-72ab-47d6-bbe7-afa04b3cc883 service nova] Acquiring lock "refresh_cache-107abf1d-96da-4406-8111-ef0bc09fb3e3" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:17:44 user nova-compute[74821]: DEBUG nova.network.neutron [req-9fe0af18-b51a-4c3e-aa23-dc025857653e req-3c39bd21-f17d-45b8-868c-1af0098d3e42 service nova] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Updated VIF entry in instance network info cache for port 364b4308-8730-4b11-90a1-48ea6ab3de60. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:17:44 user nova-compute[74821]: DEBUG nova.network.neutron [req-9fe0af18-b51a-4c3e-aa23-dc025857653e req-3c39bd21-f17d-45b8-868c-1af0098d3e42 service nova] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Updating instance_info_cache with network_info: [{"id": "364b4308-8730-4b11-90a1-48ea6ab3de60", "address": "fa:16:3e:48:8d:c6", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b4308-87", "ovs_interfaceid": "364b4308-8730-4b11-90a1-48ea6ab3de60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:17:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-9fe0af18-b51a-4c3e-aa23-dc025857653e req-3c39bd21-f17d-45b8-868c-1af0098d3e42 service nova] Releasing lock "refresh_cache-2de346cb-9858-47b8-a86c-4fde720d6127" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:17:44 user nova-compute[74821]: DEBUG nova.network.neutron [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG nova.network.neutron [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Updating instance_info_cache with network_info: [{"id": "3ce43b79-45cd-4110-9508-0278e47d5bc8", "address": "fa:16:3e:37:94:57", "network": {"id": "221da9ed-3df1-4f6c-91b0-ec4117f186f9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-999229259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc877e77ae92437f8ae2f5e4d9b65947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce43b79-45", "ovs_interfaceid": "3ce43b79-45cd-4110-9508-0278e47d5bc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Releasing lock "refresh_cache-107abf1d-96da-4406-8111-ef0bc09fb3e3" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG nova.compute.manager [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Instance network_info: |[{"id": "3ce43b79-45cd-4110-9508-0278e47d5bc8", "address": "fa:16:3e:37:94:57", "network": {"id": "221da9ed-3df1-4f6c-91b0-ec4117f186f9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-999229259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc877e77ae92437f8ae2f5e4d9b65947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce43b79-45", "ovs_interfaceid": "3ce43b79-45cd-4110-9508-0278e47d5bc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e76c17f6-e600-47d4-829e-858f0ea4b8af req-dafd624d-72ab-47d6-bbe7-afa04b3cc883 service nova] Acquired lock "refresh_cache-107abf1d-96da-4406-8111-ef0bc09fb3e3" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG nova.network.neutron [req-e76c17f6-e600-47d4-829e-858f0ea4b8af req-dafd624d-72ab-47d6-bbe7-afa04b3cc883 service nova] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Refreshing network info cache for port 3ce43b79-45cd-4110-9508-0278e47d5bc8 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Start _get_guest_xml network_info=[{"id": "3ce43b79-45cd-4110-9508-0278e47d5bc8", "address": "fa:16:3e:37:94:57", "network": {"id": "221da9ed-3df1-4f6c-91b0-ec4117f186f9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-999229259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc877e77ae92437f8ae2f5e4d9b65947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce43b79-45", "ovs_interfaceid": "3ce43b79-45cd-4110-9508-0278e47d5bc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:45 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:17:45 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:17:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:17:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-648502763',display_name='tempest-VolumesAdminNegativeTest-server-648502763',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-648502763',id=18,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONtFiKV3YE6V5SUgDBbtL7ZCGbAXstEw6H++682kYmupKAQazTO1RNFbNdOR4exqo36Tc9FnUiQ1PsapZEf4G7mcYvLXdKuAK/ZfWqiUw+Wx8SMsjjiSHaAdZXUkUL2lg==',key_name='tempest-keypair-1084933158',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc877e77ae92437f8ae2f5e4d9b65947',ramdisk_id='',reservation_id='r-x0mw253n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-610056100',owner_user_name='tempest-VolumesAdminNegativeTest-610056100-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:17:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0b7addf6de74979a206dfccac04f475',uuid=107abf1d-96da-4406-8111-ef0bc09fb3e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ce43b79-45cd-4110-9508-0278e47d5bc8", "address": "fa:16:3e:37:94:57", "network": {"id": "221da9ed-3df1-4f6c-91b0-ec4117f186f9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-999229259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc877e77ae92437f8ae2f5e4d9b65947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce43b79-45", "ovs_interfaceid": "3ce43b79-45cd-4110-9508-0278e47d5bc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Converting VIF {"id": "3ce43b79-45cd-4110-9508-0278e47d5bc8", "address": "fa:16:3e:37:94:57", "network": {"id": "221da9ed-3df1-4f6c-91b0-ec4117f186f9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-999229259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc877e77ae92437f8ae2f5e4d9b65947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce43b79-45", "ovs_interfaceid": "3ce43b79-45cd-4110-9508-0278e47d5bc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:94:57,bridge_name='br-int',has_traffic_filtering=True,id=3ce43b79-45cd-4110-9508-0278e47d5bc8,network=Network(221da9ed-3df1-4f6c-91b0-ec4117f186f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce43b79-45') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG nova.objects.instance [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lazy-loading 'pci_devices' on Instance uuid 107abf1d-96da-4406-8111-ef0bc09fb3e3 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:17:45 user nova-compute[74821]:   <uuid>107abf1d-96da-4406-8111-ef0bc09fb3e3</uuid>
Nov 06 13:17:45 user nova-compute[74821]:   <name>instance-00000012</name>
Nov 06 13:17:45 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:17:45 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:17:45 user nova-compute[74821]:   <metadata>
Nov 06 13:17:45 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:17:45 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:17:45 user nova-compute[74821]:       <nova:name>tempest-VolumesAdminNegativeTest-server-648502763</nova:name>
Nov 06 13:17:45 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:17:45</nova:creationTime>
Nov 06 13:17:45 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:17:45 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:17:45 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:17:45 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:17:45 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:17:45 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:17:45 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:17:45 user nova-compute[74821]:       <nova:owner>
Nov 06 13:17:45 user nova-compute[74821]:         <nova:user uuid="d0b7addf6de74979a206dfccac04f475">tempest-VolumesAdminNegativeTest-610056100-project-member</nova:user>
Nov 06 13:17:45 user nova-compute[74821]:         <nova:project uuid="cc877e77ae92437f8ae2f5e4d9b65947">tempest-VolumesAdminNegativeTest-610056100</nova:project>
Nov 06 13:17:45 user nova-compute[74821]:       </nova:owner>
Nov 06 13:17:45 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:17:45 user nova-compute[74821]:       <nova:ports>
Nov 06 13:17:45 user nova-compute[74821]:         <nova:port uuid="3ce43b79-45cd-4110-9508-0278e47d5bc8">
Nov 06 13:17:45 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 06 13:17:45 user nova-compute[74821]:         </nova:port>
Nov 06 13:17:45 user nova-compute[74821]:       </nova:ports>
Nov 06 13:17:45 user nova-compute[74821]:     </nova:instance>
Nov 06 13:17:45 user nova-compute[74821]:   </metadata>
Nov 06 13:17:45 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:17:45 user nova-compute[74821]:     <system>
Nov 06 13:17:45 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:17:45 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:17:45 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:17:45 user nova-compute[74821]:       <entry name="serial">107abf1d-96da-4406-8111-ef0bc09fb3e3</entry>
Nov 06 13:17:45 user nova-compute[74821]:       <entry name="uuid">107abf1d-96da-4406-8111-ef0bc09fb3e3</entry>
Nov 06 13:17:45 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:17:45 user nova-compute[74821]:     </system>
Nov 06 13:17:45 user nova-compute[74821]:   </sysinfo>
Nov 06 13:17:45 user nova-compute[74821]:   <os>
Nov 06 13:17:45 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:17:45 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:17:45 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:17:45 user nova-compute[74821]:   </os>
Nov 06 13:17:45 user nova-compute[74821]:   <features>
Nov 06 13:17:45 user nova-compute[74821]:     <acpi/>
Nov 06 13:17:45 user nova-compute[74821]:     <apic/>
Nov 06 13:17:45 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:17:45 user nova-compute[74821]:   </features>
Nov 06 13:17:45 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:17:45 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:17:45 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:17:45 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:17:45 user nova-compute[74821]:   </clock>
Nov 06 13:17:45 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:17:45 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:17:45 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:17:45 user nova-compute[74821]:   </cpu>
Nov 06 13:17:45 user nova-compute[74821]:   <devices>
Nov 06 13:17:45 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:17:45 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:17:45 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk"/>
Nov 06 13:17:45 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:17:45 user nova-compute[74821]:     </disk>
Nov 06 13:17:45 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:17:45 user nova-compute[74821]:       <mac address="fa:16:3e:37:94:57"/>
Nov 06 13:17:45 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:17:45 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:17:45 user nova-compute[74821]:       <target dev="tap3ce43b79-45"/>
Nov 06 13:17:45 user nova-compute[74821]:     </interface>
Nov 06 13:17:45 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:17:45 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/console.log" append="off"/>
Nov 06 13:17:45 user nova-compute[74821]:     </serial>
Nov 06 13:17:45 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:17:45 user nova-compute[74821]:     <video>
Nov 06 13:17:45 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:17:45 user nova-compute[74821]:     </video>
Nov 06 13:17:45 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:17:45 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:17:45 user nova-compute[74821]:     </rng>
Nov 06 13:17:45 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:17:45 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:17:45 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:17:45 user nova-compute[74821]:     </memballoon>
Nov 06 13:17:45 user nova-compute[74821]:   </devices>
Nov 06 13:17:45 user nova-compute[74821]: </domain>
Nov 06 13:17:45 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:17:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-648502763',display_name='tempest-VolumesAdminNegativeTest-server-648502763',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-648502763',id=18,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONtFiKV3YE6V5SUgDBbtL7ZCGbAXstEw6H++682kYmupKAQazTO1RNFbNdOR4exqo36Tc9FnUiQ1PsapZEf4G7mcYvLXdKuAK/ZfWqiUw+Wx8SMsjjiSHaAdZXUkUL2lg==',key_name='tempest-keypair-1084933158',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc877e77ae92437f8ae2f5e4d9b65947',ramdisk_id='',reservation_id='r-x0mw253n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-610056100',owner_user_name='tempest-VolumesAdminNegativeTest-610056100-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:17:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0b7addf6de74979a206dfccac04f475',uuid=107abf1d-96da-4406-8111-ef0bc09fb3e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ce43b79-45cd-4110-9508-0278e47d5bc8", "address": "fa:16:3e:37:94:57", "network": {"id": "221da9ed-3df1-4f6c-91b0-ec4117f186f9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-999229259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc877e77ae92437f8ae2f5e4d9b65947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce43b79-45", "ovs_interfaceid": "3ce43b79-45cd-4110-9508-0278e47d5bc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Converting VIF {"id": "3ce43b79-45cd-4110-9508-0278e47d5bc8", "address": "fa:16:3e:37:94:57", "network": {"id": "221da9ed-3df1-4f6c-91b0-ec4117f186f9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-999229259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc877e77ae92437f8ae2f5e4d9b65947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce43b79-45", "ovs_interfaceid": "3ce43b79-45cd-4110-9508-0278e47d5bc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:94:57,bridge_name='br-int',has_traffic_filtering=True,id=3ce43b79-45cd-4110-9508-0278e47d5bc8,network=Network(221da9ed-3df1-4f6c-91b0-ec4117f186f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce43b79-45') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG os_vif [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:94:57,bridge_name='br-int',has_traffic_filtering=True,id=3ce43b79-45cd-4110-9508-0278e47d5bc8,network=Network(221da9ed-3df1-4f6c-91b0-ec4117f186f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce43b79-45') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4bceb7f5-1e2d-540f-8e8b-797c97592400', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ce43b79-45, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ce43b79-45, col_values=(('qos', UUID('f6fbd416-3a98-486c-bc22-48af3fec76c2')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ce43b79-45, col_values=(('external_ids', {'iface-id': '3ce43b79-45cd-4110-9508-0278e47d5bc8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:94:57', 'vm-uuid': '107abf1d-96da-4406-8111-ef0bc09fb3e3'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:45 user nova-compute[74821]: INFO os_vif [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:94:57,bridge_name='br-int',has_traffic_filtering=True,id=3ce43b79-45cd-4110-9508-0278e47d5bc8,network=Network(221da9ed-3df1-4f6c-91b0-ec4117f186f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce43b79-45')
Nov 06 13:17:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] No VIF found with MAC fa:16:3e:37:94:57, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG nova.network.neutron [req-e76c17f6-e600-47d4-829e-858f0ea4b8af req-dafd624d-72ab-47d6-bbe7-afa04b3cc883 service nova] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Updated VIF entry in instance network info cache for port 3ce43b79-45cd-4110-9508-0278e47d5bc8. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG nova.network.neutron [req-e76c17f6-e600-47d4-829e-858f0ea4b8af req-dafd624d-72ab-47d6-bbe7-afa04b3cc883 service nova] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Updating instance_info_cache with network_info: [{"id": "3ce43b79-45cd-4110-9508-0278e47d5bc8", "address": "fa:16:3e:37:94:57", "network": {"id": "221da9ed-3df1-4f6c-91b0-ec4117f186f9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-999229259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc877e77ae92437f8ae2f5e4d9b65947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce43b79-45", "ovs_interfaceid": "3ce43b79-45cd-4110-9508-0278e47d5bc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:17:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e76c17f6-e600-47d4-829e-858f0ea4b8af req-dafd624d-72ab-47d6-bbe7-afa04b3cc883 service nova] Releasing lock "refresh_cache-107abf1d-96da-4406-8111-ef0bc09fb3e3" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:17:46 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:46 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:46 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:47 user nova-compute[74821]: DEBUG nova.compute.manager [req-bc402918-cec2-47dc-8a42-087f8e2ea81a req-eadf8fd6-b569-4fbe-8dbe-62d20f7a3657 service nova] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Received event network-vif-plugged-3ce43b79-45cd-4110-9508-0278e47d5bc8 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:17:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-bc402918-cec2-47dc-8a42-087f8e2ea81a req-eadf8fd6-b569-4fbe-8dbe-62d20f7a3657 service nova] Acquiring lock "107abf1d-96da-4406-8111-ef0bc09fb3e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-bc402918-cec2-47dc-8a42-087f8e2ea81a req-eadf8fd6-b569-4fbe-8dbe-62d20f7a3657 service nova] Lock "107abf1d-96da-4406-8111-ef0bc09fb3e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-bc402918-cec2-47dc-8a42-087f8e2ea81a req-eadf8fd6-b569-4fbe-8dbe-62d20f7a3657 service nova] Lock "107abf1d-96da-4406-8111-ef0bc09fb3e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:47 user nova-compute[74821]: DEBUG nova.compute.manager [req-bc402918-cec2-47dc-8a42-087f8e2ea81a req-eadf8fd6-b569-4fbe-8dbe-62d20f7a3657 service nova] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] No waiting events found dispatching network-vif-plugged-3ce43b79-45cd-4110-9508-0278e47d5bc8 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:17:47 user nova-compute[74821]: WARNING nova.compute.manager [req-bc402918-cec2-47dc-8a42-087f8e2ea81a req-eadf8fd6-b569-4fbe-8dbe-62d20f7a3657 service nova] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Received unexpected event network-vif-plugged-3ce43b79-45cd-4110-9508-0278e47d5bc8 for instance with vm_state building and task_state spawning.
Nov 06 13:17:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Acquiring lock "cc3c1518-c493-41b0-a748-a0ed933c2b1e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lock "cc3c1518-c493-41b0-a748-a0ed933c2b1e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:49 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:17:49 user nova-compute[74821]: DEBUG nova.compute.manager [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:17:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:17:49 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Instance spawned successfully.
Nov 06 13:17:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:17:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:17:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:17:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:17:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:17:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:17:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:17:49 user nova-compute[74821]: DEBUG nova.compute.manager [req-798cd44b-45cb-4bae-93e0-dd2ea4f1963c req-55b4bb18-5e23-429f-aa71-8b39db7bfd7d service nova] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Received event network-vif-plugged-3ce43b79-45cd-4110-9508-0278e47d5bc8 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:17:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-798cd44b-45cb-4bae-93e0-dd2ea4f1963c req-55b4bb18-5e23-429f-aa71-8b39db7bfd7d service nova] Acquiring lock "107abf1d-96da-4406-8111-ef0bc09fb3e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-798cd44b-45cb-4bae-93e0-dd2ea4f1963c req-55b4bb18-5e23-429f-aa71-8b39db7bfd7d service nova] Lock "107abf1d-96da-4406-8111-ef0bc09fb3e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-798cd44b-45cb-4bae-93e0-dd2ea4f1963c req-55b4bb18-5e23-429f-aa71-8b39db7bfd7d service nova] Lock "107abf1d-96da-4406-8111-ef0bc09fb3e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:49 user nova-compute[74821]: DEBUG nova.compute.manager [req-798cd44b-45cb-4bae-93e0-dd2ea4f1963c req-55b4bb18-5e23-429f-aa71-8b39db7bfd7d service nova] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] No waiting events found dispatching network-vif-plugged-3ce43b79-45cd-4110-9508-0278e47d5bc8 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:17:49 user nova-compute[74821]: WARNING nova.compute.manager [req-798cd44b-45cb-4bae-93e0-dd2ea4f1963c req-55b4bb18-5e23-429f-aa71-8b39db7bfd7d service nova] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Received unexpected event network-vif-plugged-3ce43b79-45cd-4110-9508-0278e47d5bc8 for instance with vm_state building and task_state spawning.
Nov 06 13:17:49 user nova-compute[74821]: INFO nova.compute.manager [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Took 7.01 seconds to spawn the instance on the hypervisor.
Nov 06 13:17:49 user nova-compute[74821]: DEBUG nova.compute.manager [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:17:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:49 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:17:49 user nova-compute[74821]: INFO nova.compute.claims [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Claim successful on node user
Nov 06 13:17:49 user nova-compute[74821]: INFO nova.compute.manager [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Took 7.93 seconds to build instance.
Nov 06 13:17:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fe87666f-43b3-4aa4-ba2f-0a5089a35211 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "107abf1d-96da-4406-8111-ef0bc09fb3e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.128s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:49 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:17:49 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:17:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.361s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:49 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:17:49 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:17:49 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:17:49 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:17:49 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:17:50 user nova-compute[74821]: DEBUG nova.policy [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53d9201b8b60408eb3bea10a590e35b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733c88e2098c49969334dad925f621c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:17:50 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:17:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:17:50 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Creating image(s)
Nov 06 13:17:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Acquiring lock "/opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lock "/opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lock "/opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.203s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.204s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e/disk 1073741824" returned: 0 in 0.048s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.203s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:50 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:17:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:17:50 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Successfully created port: 1bd8a943-f48b-4501-8f21-0f2d04e10624 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:17:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:17:50 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Cannot resize image /opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:17:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:17:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Ensure instance console log exists: /opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:17:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:51 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Successfully updated port: 1bd8a943-f48b-4501-8f21-0f2d04e10624 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:17:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Acquiring lock "refresh_cache-cc3c1518-c493-41b0-a748-a0ed933c2b1e" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:17:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Acquired lock "refresh_cache-cc3c1518-c493-41b0-a748-a0ed933c2b1e" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:17:51 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:17:51 user nova-compute[74821]: DEBUG nova.compute.manager [req-d5560c10-a452-4ce7-ac68-6b46fb38b303 req-a88ca84e-91fc-4360-bd3c-7a5e4cbf0071 service nova] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Received event network-changed-1bd8a943-f48b-4501-8f21-0f2d04e10624 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:17:51 user nova-compute[74821]: DEBUG nova.compute.manager [req-d5560c10-a452-4ce7-ac68-6b46fb38b303 req-a88ca84e-91fc-4360-bd3c-7a5e4cbf0071 service nova] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Refreshing instance network info cache due to event network-changed-1bd8a943-f48b-4501-8f21-0f2d04e10624. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:17:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d5560c10-a452-4ce7-ac68-6b46fb38b303 req-a88ca84e-91fc-4360-bd3c-7a5e4cbf0071 service nova] Acquiring lock "refresh_cache-cc3c1518-c493-41b0-a748-a0ed933c2b1e" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:17:51 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Updating instance_info_cache with network_info: [{"id": "1bd8a943-f48b-4501-8f21-0f2d04e10624", "address": "fa:16:3e:b7:63:5d", "network": {"id": "3d0a42fb-8ba8-4d46-bbc2-7d1cde6bc297", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1825623675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733c88e2098c49969334dad925f621c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bd8a943-f4", "ovs_interfaceid": "1bd8a943-f48b-4501-8f21-0f2d04e10624", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Releasing lock "refresh_cache-cc3c1518-c493-41b0-a748-a0ed933c2b1e" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Instance network_info: |[{"id": "1bd8a943-f48b-4501-8f21-0f2d04e10624", "address": "fa:16:3e:b7:63:5d", "network": {"id": "3d0a42fb-8ba8-4d46-bbc2-7d1cde6bc297", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1825623675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733c88e2098c49969334dad925f621c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bd8a943-f4", "ovs_interfaceid": "1bd8a943-f48b-4501-8f21-0f2d04e10624", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d5560c10-a452-4ce7-ac68-6b46fb38b303 req-a88ca84e-91fc-4360-bd3c-7a5e4cbf0071 service nova] Acquired lock "refresh_cache-cc3c1518-c493-41b0-a748-a0ed933c2b1e" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG nova.network.neutron [req-d5560c10-a452-4ce7-ac68-6b46fb38b303 req-a88ca84e-91fc-4360-bd3c-7a5e4cbf0071 service nova] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Refreshing network info cache for port 1bd8a943-f48b-4501-8f21-0f2d04e10624 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Start _get_guest_xml network_info=[{"id": "1bd8a943-f48b-4501-8f21-0f2d04e10624", "address": "fa:16:3e:b7:63:5d", "network": {"id": "3d0a42fb-8ba8-4d46-bbc2-7d1cde6bc297", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1825623675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733c88e2098c49969334dad925f621c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bd8a943-f4", "ovs_interfaceid": "1bd8a943-f48b-4501-8f21-0f2d04e10624", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:17:52 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:17:52 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:17:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:17:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2129299094',display_name='tempest-TestServerVolumeAttachmentScenario-server-2129299094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2129299094',id=19,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIM68JlwItLlxNJIwjiyMwzha01uicyMTpV59ZaLgmn3bggXy7BbyXyYURF8hJaMWb1IO15fc+oxC7QaFU6pdyaNe4DiARfSfy/D00aj4rE044bDSiYNrXx4QOD6Bah1vw==',key_name='tempest-keypair-500936032',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='733c88e2098c49969334dad925f621c2',ramdisk_id='',reservation_id='r-f3vh2d9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2099995196',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2099995196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:17:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53d9201b8b60408eb3bea10a590e35b0',uuid=cc3c1518-c493-41b0-a748-a0ed933c2b1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bd8a943-f48b-4501-8f21-0f2d04e10624", "address": "fa:16:3e:b7:63:5d", "network": {"id": "3d0a42fb-8ba8-4d46-bbc2-7d1cde6bc297", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1825623675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733c88e2098c49969334dad925f621c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bd8a943-f4", "ovs_interfaceid": "1bd8a943-f48b-4501-8f21-0f2d04e10624", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Converting VIF {"id": "1bd8a943-f48b-4501-8f21-0f2d04e10624", "address": "fa:16:3e:b7:63:5d", "network": {"id": "3d0a42fb-8ba8-4d46-bbc2-7d1cde6bc297", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1825623675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733c88e2098c49969334dad925f621c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bd8a943-f4", "ovs_interfaceid": "1bd8a943-f48b-4501-8f21-0f2d04e10624", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:63:5d,bridge_name='br-int',has_traffic_filtering=True,id=1bd8a943-f48b-4501-8f21-0f2d04e10624,network=Network(3d0a42fb-8ba8-4d46-bbc2-7d1cde6bc297),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bd8a943-f4') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG nova.objects.instance [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lazy-loading 'pci_devices' on Instance uuid cc3c1518-c493-41b0-a748-a0ed933c2b1e {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:17:52 user nova-compute[74821]:   <uuid>cc3c1518-c493-41b0-a748-a0ed933c2b1e</uuid>
Nov 06 13:17:52 user nova-compute[74821]:   <name>instance-00000013</name>
Nov 06 13:17:52 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:17:52 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:17:52 user nova-compute[74821]:   <metadata>
Nov 06 13:17:52 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:17:52 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:17:52 user nova-compute[74821]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-2129299094</nova:name>
Nov 06 13:17:52 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:17:52</nova:creationTime>
Nov 06 13:17:52 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:17:52 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:17:52 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:17:52 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:17:52 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:17:52 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:17:52 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:17:52 user nova-compute[74821]:       <nova:owner>
Nov 06 13:17:52 user nova-compute[74821]:         <nova:user uuid="53d9201b8b60408eb3bea10a590e35b0">tempest-TestServerVolumeAttachmentScenario-2099995196-project-member</nova:user>
Nov 06 13:17:52 user nova-compute[74821]:         <nova:project uuid="733c88e2098c49969334dad925f621c2">tempest-TestServerVolumeAttachmentScenario-2099995196</nova:project>
Nov 06 13:17:52 user nova-compute[74821]:       </nova:owner>
Nov 06 13:17:52 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:17:52 user nova-compute[74821]:       <nova:ports>
Nov 06 13:17:52 user nova-compute[74821]:         <nova:port uuid="1bd8a943-f48b-4501-8f21-0f2d04e10624">
Nov 06 13:17:52 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 13:17:52 user nova-compute[74821]:         </nova:port>
Nov 06 13:17:52 user nova-compute[74821]:       </nova:ports>
Nov 06 13:17:52 user nova-compute[74821]:     </nova:instance>
Nov 06 13:17:52 user nova-compute[74821]:   </metadata>
Nov 06 13:17:52 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:17:52 user nova-compute[74821]:     <system>
Nov 06 13:17:52 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:17:52 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:17:52 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:17:52 user nova-compute[74821]:       <entry name="serial">cc3c1518-c493-41b0-a748-a0ed933c2b1e</entry>
Nov 06 13:17:52 user nova-compute[74821]:       <entry name="uuid">cc3c1518-c493-41b0-a748-a0ed933c2b1e</entry>
Nov 06 13:17:52 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:17:52 user nova-compute[74821]:     </system>
Nov 06 13:17:52 user nova-compute[74821]:   </sysinfo>
Nov 06 13:17:52 user nova-compute[74821]:   <os>
Nov 06 13:17:52 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:17:52 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:17:52 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:17:52 user nova-compute[74821]:   </os>
Nov 06 13:17:52 user nova-compute[74821]:   <features>
Nov 06 13:17:52 user nova-compute[74821]:     <acpi/>
Nov 06 13:17:52 user nova-compute[74821]:     <apic/>
Nov 06 13:17:52 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:17:52 user nova-compute[74821]:   </features>
Nov 06 13:17:52 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:17:52 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:17:52 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:17:52 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:17:52 user nova-compute[74821]:   </clock>
Nov 06 13:17:52 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:17:52 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:17:52 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:17:52 user nova-compute[74821]:   </cpu>
Nov 06 13:17:52 user nova-compute[74821]:   <devices>
Nov 06 13:17:52 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:17:52 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:17:52 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e/disk"/>
Nov 06 13:17:52 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:17:52 user nova-compute[74821]:     </disk>
Nov 06 13:17:52 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:17:52 user nova-compute[74821]:       <mac address="fa:16:3e:b7:63:5d"/>
Nov 06 13:17:52 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:17:52 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:17:52 user nova-compute[74821]:       <target dev="tap1bd8a943-f4"/>
Nov 06 13:17:52 user nova-compute[74821]:     </interface>
Nov 06 13:17:52 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:17:52 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e/console.log" append="off"/>
Nov 06 13:17:52 user nova-compute[74821]:     </serial>
Nov 06 13:17:52 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:17:52 user nova-compute[74821]:     <video>
Nov 06 13:17:52 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:17:52 user nova-compute[74821]:     </video>
Nov 06 13:17:52 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:17:52 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:17:52 user nova-compute[74821]:     </rng>
Nov 06 13:17:52 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:17:52 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:17:52 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:17:52 user nova-compute[74821]:     </memballoon>
Nov 06 13:17:52 user nova-compute[74821]:   </devices>
Nov 06 13:17:52 user nova-compute[74821]: </domain>
Nov 06 13:17:52 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:17:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2129299094',display_name='tempest-TestServerVolumeAttachmentScenario-server-2129299094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2129299094',id=19,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIM68JlwItLlxNJIwjiyMwzha01uicyMTpV59ZaLgmn3bggXy7BbyXyYURF8hJaMWb1IO15fc+oxC7QaFU6pdyaNe4DiARfSfy/D00aj4rE044bDSiYNrXx4QOD6Bah1vw==',key_name='tempest-keypair-500936032',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='733c88e2098c49969334dad925f621c2',ramdisk_id='',reservation_id='r-f3vh2d9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2099995196',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2099995196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:17:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53d9201b8b60408eb3bea10a590e35b0',uuid=cc3c1518-c493-41b0-a748-a0ed933c2b1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bd8a943-f48b-4501-8f21-0f2d04e10624", "address": "fa:16:3e:b7:63:5d", "network": {"id": "3d0a42fb-8ba8-4d46-bbc2-7d1cde6bc297", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1825623675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733c88e2098c49969334dad925f621c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bd8a943-f4", "ovs_interfaceid": "1bd8a943-f48b-4501-8f21-0f2d04e10624", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Converting VIF {"id": "1bd8a943-f48b-4501-8f21-0f2d04e10624", "address": "fa:16:3e:b7:63:5d", "network": {"id": "3d0a42fb-8ba8-4d46-bbc2-7d1cde6bc297", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1825623675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733c88e2098c49969334dad925f621c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bd8a943-f4", "ovs_interfaceid": "1bd8a943-f48b-4501-8f21-0f2d04e10624", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:63:5d,bridge_name='br-int',has_traffic_filtering=True,id=1bd8a943-f48b-4501-8f21-0f2d04e10624,network=Network(3d0a42fb-8ba8-4d46-bbc2-7d1cde6bc297),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bd8a943-f4') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG os_vif [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:63:5d,bridge_name='br-int',has_traffic_filtering=True,id=1bd8a943-f48b-4501-8f21-0f2d04e10624,network=Network(3d0a42fb-8ba8-4d46-bbc2-7d1cde6bc297),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bd8a943-f4') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eea840d3-ce57-544f-8663-6bd0ccdd5718', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1bd8a943-f4, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1bd8a943-f4, col_values=(('qos', UUID('941382df-59c2-4f64-aa70-c65108916f25')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1bd8a943-f4, col_values=(('external_ids', {'iface-id': '1bd8a943-f48b-4501-8f21-0f2d04e10624', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:63:5d', 'vm-uuid': 'cc3c1518-c493-41b0-a748-a0ed933c2b1e'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:52 user nova-compute[74821]: INFO os_vif [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:63:5d,bridge_name='br-int',has_traffic_filtering=True,id=1bd8a943-f48b-4501-8f21-0f2d04e10624,network=Network(3d0a42fb-8ba8-4d46-bbc2-7d1cde6bc297),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bd8a943-f4')
Nov 06 13:17:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] No VIF found with MAC fa:16:3e:b7:63:5d, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG nova.network.neutron [req-d5560c10-a452-4ce7-ac68-6b46fb38b303 req-a88ca84e-91fc-4360-bd3c-7a5e4cbf0071 service nova] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Updated VIF entry in instance network info cache for port 1bd8a943-f48b-4501-8f21-0f2d04e10624. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG nova.network.neutron [req-d5560c10-a452-4ce7-ac68-6b46fb38b303 req-a88ca84e-91fc-4360-bd3c-7a5e4cbf0071 service nova] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Updating instance_info_cache with network_info: [{"id": "1bd8a943-f48b-4501-8f21-0f2d04e10624", "address": "fa:16:3e:b7:63:5d", "network": {"id": "3d0a42fb-8ba8-4d46-bbc2-7d1cde6bc297", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1825623675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733c88e2098c49969334dad925f621c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bd8a943-f4", "ovs_interfaceid": "1bd8a943-f48b-4501-8f21-0f2d04e10624", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:17:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d5560c10-a452-4ce7-ac68-6b46fb38b303 req-a88ca84e-91fc-4360-bd3c-7a5e4cbf0071 service nova] Releasing lock "refresh_cache-cc3c1518-c493-41b0-a748-a0ed933c2b1e" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:17:53 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:53 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:53 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:53 user nova-compute[74821]: DEBUG nova.compute.manager [req-7a488c66-341a-4d1f-949d-1253217b43b8 req-0f23f12a-a626-4371-906e-11e5260cace4 service nova] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Received event network-vif-plugged-1bd8a943-f48b-4501-8f21-0f2d04e10624 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:17:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-7a488c66-341a-4d1f-949d-1253217b43b8 req-0f23f12a-a626-4371-906e-11e5260cace4 service nova] Acquiring lock "cc3c1518-c493-41b0-a748-a0ed933c2b1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-7a488c66-341a-4d1f-949d-1253217b43b8 req-0f23f12a-a626-4371-906e-11e5260cace4 service nova] Lock "cc3c1518-c493-41b0-a748-a0ed933c2b1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-7a488c66-341a-4d1f-949d-1253217b43b8 req-0f23f12a-a626-4371-906e-11e5260cace4 service nova] Lock "cc3c1518-c493-41b0-a748-a0ed933c2b1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:53 user nova-compute[74821]: DEBUG nova.compute.manager [req-7a488c66-341a-4d1f-949d-1253217b43b8 req-0f23f12a-a626-4371-906e-11e5260cace4 service nova] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] No waiting events found dispatching network-vif-plugged-1bd8a943-f48b-4501-8f21-0f2d04e10624 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:17:53 user nova-compute[74821]: WARNING nova.compute.manager [req-7a488c66-341a-4d1f-949d-1253217b43b8 req-0f23f12a-a626-4371-906e-11e5260cace4 service nova] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Received unexpected event network-vif-plugged-1bd8a943-f48b-4501-8f21-0f2d04e10624 for instance with vm_state building and task_state spawning.
Nov 06 13:17:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:56 user nova-compute[74821]: DEBUG nova.compute.manager [req-17b4a6d9-7211-4439-9991-e319d9f64d2b req-0a2881f5-d6ae-4abf-8c08-4781524d487a service nova] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Received event network-vif-plugged-1bd8a943-f48b-4501-8f21-0f2d04e10624 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:17:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-17b4a6d9-7211-4439-9991-e319d9f64d2b req-0a2881f5-d6ae-4abf-8c08-4781524d487a service nova] Acquiring lock "cc3c1518-c493-41b0-a748-a0ed933c2b1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:17:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-17b4a6d9-7211-4439-9991-e319d9f64d2b req-0a2881f5-d6ae-4abf-8c08-4781524d487a service nova] Lock "cc3c1518-c493-41b0-a748-a0ed933c2b1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:17:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-17b4a6d9-7211-4439-9991-e319d9f64d2b req-0a2881f5-d6ae-4abf-8c08-4781524d487a service nova] Lock "cc3c1518-c493-41b0-a748-a0ed933c2b1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:56 user nova-compute[74821]: DEBUG nova.compute.manager [req-17b4a6d9-7211-4439-9991-e319d9f64d2b req-0a2881f5-d6ae-4abf-8c08-4781524d487a service nova] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] No waiting events found dispatching network-vif-plugged-1bd8a943-f48b-4501-8f21-0f2d04e10624 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:17:56 user nova-compute[74821]: WARNING nova.compute.manager [req-17b4a6d9-7211-4439-9991-e319d9f64d2b req-0a2881f5-d6ae-4abf-8c08-4781524d487a service nova] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Received unexpected event network-vif-plugged-1bd8a943-f48b-4501-8f21-0f2d04e10624 for instance with vm_state building and task_state spawning.
Nov 06 13:17:56 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:17:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:17:56 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Instance spawned successfully.
Nov 06 13:17:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:17:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:17:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:17:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:17:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:17:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:17:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:17:56 user nova-compute[74821]: INFO nova.compute.manager [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Took 6.69 seconds to spawn the instance on the hypervisor.
Nov 06 13:17:56 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:17:56 user nova-compute[74821]: INFO nova.compute.manager [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Took 7.46 seconds to build instance.
Nov 06 13:17:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5ed7942d-d5cb-4e15-873a-04d485c60821 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lock "cc3c1518-c493-41b0-a748-a0ed933c2b1e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.627s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:17:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:17:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "32e28c73-9e3c-483b-807e-6b286413fe85" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:18:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "32e28c73-9e3c-483b-807e-6b286413fe85" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:18:07 user nova-compute[74821]: DEBUG nova.compute.manager [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:18:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:18:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:18:07 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:18:07 user nova-compute[74821]: INFO nova.compute.claims [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Claim successful on node user
Nov 06 13:18:07 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:18:07 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:18:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:18:07 user nova-compute[74821]: DEBUG nova.compute.manager [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:18:07 user nova-compute[74821]: DEBUG nova.compute.manager [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:18:07 user nova-compute[74821]: DEBUG nova.network.neutron [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:18:07 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:18:07 user nova-compute[74821]: DEBUG nova.compute.manager [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:18:07 user nova-compute[74821]: DEBUG nova.policy [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c82a5e63234e40f6a8e63b3cb4dc97b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07250ce4ef1b429f8a5c3c7763866763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:18:08 user nova-compute[74821]: DEBUG nova.compute.manager [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:18:08 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:18:08 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Creating image(s)
Nov 06 13:18:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "/opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:18:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "/opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:18:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "/opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:18:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.207s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:18:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:18:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.214s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/disk 1073741824" returned: 0 in 0.055s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:18:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.221s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:08 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Checking if we can resize image /opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:18:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:08 user nova-compute[74821]: DEBUG nova.network.neutron [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Successfully created port: e5ab685a-b1f3-4704-963f-e7db827c947c {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:18:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:09 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Cannot resize image /opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:18:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:18:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Ensure instance console log exists: /opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:18:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:18:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:18:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:18:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:09 user nova-compute[74821]: DEBUG nova.network.neutron [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Successfully updated port: e5ab685a-b1f3-4704-963f-e7db827c947c {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:18:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "refresh_cache-32e28c73-9e3c-483b-807e-6b286413fe85" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:18:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquired lock "refresh_cache-32e28c73-9e3c-483b-807e-6b286413fe85" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:18:09 user nova-compute[74821]: DEBUG nova.network.neutron [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:18:09 user nova-compute[74821]: DEBUG nova.compute.manager [req-e10571c4-9e89-41e9-b1f7-48de39e9f70d req-cef25256-243e-4b19-a08d-efc25833a87d service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Received event network-changed-e5ab685a-b1f3-4704-963f-e7db827c947c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:18:09 user nova-compute[74821]: DEBUG nova.compute.manager [req-e10571c4-9e89-41e9-b1f7-48de39e9f70d req-cef25256-243e-4b19-a08d-efc25833a87d service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Refreshing instance network info cache due to event network-changed-e5ab685a-b1f3-4704-963f-e7db827c947c. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:18:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e10571c4-9e89-41e9-b1f7-48de39e9f70d req-cef25256-243e-4b19-a08d-efc25833a87d service nova] Acquiring lock "refresh_cache-32e28c73-9e3c-483b-807e-6b286413fe85" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:18:09 user nova-compute[74821]: DEBUG nova.network.neutron [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG nova.network.neutron [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Updating instance_info_cache with network_info: [{"id": "e5ab685a-b1f3-4704-963f-e7db827c947c", "address": "fa:16:3e:d5:da:15", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5ab685a-b1", "ovs_interfaceid": "e5ab685a-b1f3-4704-963f-e7db827c947c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Releasing lock "refresh_cache-32e28c73-9e3c-483b-807e-6b286413fe85" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG nova.compute.manager [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Instance network_info: |[{"id": "e5ab685a-b1f3-4704-963f-e7db827c947c", "address": "fa:16:3e:d5:da:15", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5ab685a-b1", "ovs_interfaceid": "e5ab685a-b1f3-4704-963f-e7db827c947c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e10571c4-9e89-41e9-b1f7-48de39e9f70d req-cef25256-243e-4b19-a08d-efc25833a87d service nova] Acquired lock "refresh_cache-32e28c73-9e3c-483b-807e-6b286413fe85" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG nova.network.neutron [req-e10571c4-9e89-41e9-b1f7-48de39e9f70d req-cef25256-243e-4b19-a08d-efc25833a87d service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Refreshing network info cache for port e5ab685a-b1f3-4704-963f-e7db827c947c {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Start _get_guest_xml network_info=[{"id": "e5ab685a-b1f3-4704-963f-e7db827c947c", "address": "fa:16:3e:d5:da:15", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5ab685a-b1", "ovs_interfaceid": "e5ab685a-b1f3-4704-963f-e7db827c947c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:18:10 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:18:10 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:18:10 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:18:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1563572892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1563572892',id=20,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEKYnXFLTR+2m8MV2bSy0f782O0BpwK/RW9xjhqlDgMuS85GEfW33cGEVy0+mivD0qgHHUJxCnGxmI4hcaL9bxGOgc60B0tHzOrPILwiUdfVhUEozjAJjaiVLjCwtIusA==',key_name='tempest-keypair-724006026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07250ce4ef1b429f8a5c3c7763866763',ramdisk_id='',reservation_id='r-d03fj2ad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-374688010',owner_user_name='tempest-AttachVolumeShelveTestJSON-374688010-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:18:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c82a5e63234e40f6a8e63b3cb4dc97b3',uuid=32e28c73-9e3c-483b-807e-6b286413fe85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5ab685a-b1f3-4704-963f-e7db827c947c", "address": "fa:16:3e:d5:da:15", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5ab685a-b1", "ovs_interfaceid": "e5ab685a-b1f3-4704-963f-e7db827c947c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Converting VIF {"id": "e5ab685a-b1f3-4704-963f-e7db827c947c", "address": "fa:16:3e:d5:da:15", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5ab685a-b1", "ovs_interfaceid": "e5ab685a-b1f3-4704-963f-e7db827c947c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:da:15,bridge_name='br-int',has_traffic_filtering=True,id=e5ab685a-b1f3-4704-963f-e7db827c947c,network=Network(5318228c-491a-4ea1-a2b2-49ea8e15dccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5ab685a-b1') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG nova.objects.instance [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lazy-loading 'pci_devices' on Instance uuid 32e28c73-9e3c-483b-807e-6b286413fe85 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:18:10 user nova-compute[74821]:   <uuid>32e28c73-9e3c-483b-807e-6b286413fe85</uuid>
Nov 06 13:18:10 user nova-compute[74821]:   <name>instance-00000014</name>
Nov 06 13:18:10 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:18:10 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:18:10 user nova-compute[74821]:   <metadata>
Nov 06 13:18:10 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:18:10 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:18:10 user nova-compute[74821]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1563572892</nova:name>
Nov 06 13:18:10 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:18:10</nova:creationTime>
Nov 06 13:18:10 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:18:10 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:18:10 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:18:10 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:18:10 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:18:10 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:18:10 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:18:10 user nova-compute[74821]:       <nova:owner>
Nov 06 13:18:10 user nova-compute[74821]:         <nova:user uuid="c82a5e63234e40f6a8e63b3cb4dc97b3">tempest-AttachVolumeShelveTestJSON-374688010-project-member</nova:user>
Nov 06 13:18:10 user nova-compute[74821]:         <nova:project uuid="07250ce4ef1b429f8a5c3c7763866763">tempest-AttachVolumeShelveTestJSON-374688010</nova:project>
Nov 06 13:18:10 user nova-compute[74821]:       </nova:owner>
Nov 06 13:18:10 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:18:10 user nova-compute[74821]:       <nova:ports>
Nov 06 13:18:10 user nova-compute[74821]:         <nova:port uuid="e5ab685a-b1f3-4704-963f-e7db827c947c">
Nov 06 13:18:10 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 06 13:18:10 user nova-compute[74821]:         </nova:port>
Nov 06 13:18:10 user nova-compute[74821]:       </nova:ports>
Nov 06 13:18:10 user nova-compute[74821]:     </nova:instance>
Nov 06 13:18:10 user nova-compute[74821]:   </metadata>
Nov 06 13:18:10 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:18:10 user nova-compute[74821]:     <system>
Nov 06 13:18:10 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:18:10 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:18:10 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:18:10 user nova-compute[74821]:       <entry name="serial">32e28c73-9e3c-483b-807e-6b286413fe85</entry>
Nov 06 13:18:10 user nova-compute[74821]:       <entry name="uuid">32e28c73-9e3c-483b-807e-6b286413fe85</entry>
Nov 06 13:18:10 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:18:10 user nova-compute[74821]:     </system>
Nov 06 13:18:10 user nova-compute[74821]:   </sysinfo>
Nov 06 13:18:10 user nova-compute[74821]:   <os>
Nov 06 13:18:10 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:18:10 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:18:10 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:18:10 user nova-compute[74821]:   </os>
Nov 06 13:18:10 user nova-compute[74821]:   <features>
Nov 06 13:18:10 user nova-compute[74821]:     <acpi/>
Nov 06 13:18:10 user nova-compute[74821]:     <apic/>
Nov 06 13:18:10 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:18:10 user nova-compute[74821]:   </features>
Nov 06 13:18:10 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:18:10 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:18:10 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:18:10 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:18:10 user nova-compute[74821]:   </clock>
Nov 06 13:18:10 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:18:10 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:18:10 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:18:10 user nova-compute[74821]:   </cpu>
Nov 06 13:18:10 user nova-compute[74821]:   <devices>
Nov 06 13:18:10 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:18:10 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:18:10 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/disk"/>
Nov 06 13:18:10 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:18:10 user nova-compute[74821]:     </disk>
Nov 06 13:18:10 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:18:10 user nova-compute[74821]:       <mac address="fa:16:3e:d5:da:15"/>
Nov 06 13:18:10 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:18:10 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:18:10 user nova-compute[74821]:       <target dev="tape5ab685a-b1"/>
Nov 06 13:18:10 user nova-compute[74821]:     </interface>
Nov 06 13:18:10 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:18:10 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/console.log" append="off"/>
Nov 06 13:18:10 user nova-compute[74821]:     </serial>
Nov 06 13:18:10 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:18:10 user nova-compute[74821]:     <video>
Nov 06 13:18:10 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:18:10 user nova-compute[74821]:     </video>
Nov 06 13:18:10 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:18:10 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:18:10 user nova-compute[74821]:     </rng>
Nov 06 13:18:10 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:18:10 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:18:10 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:18:10 user nova-compute[74821]:     </memballoon>
Nov 06 13:18:10 user nova-compute[74821]:   </devices>
Nov 06 13:18:10 user nova-compute[74821]: </domain>
Nov 06 13:18:10 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:18:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1563572892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1563572892',id=20,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEKYnXFLTR+2m8MV2bSy0f782O0BpwK/RW9xjhqlDgMuS85GEfW33cGEVy0+mivD0qgHHUJxCnGxmI4hcaL9bxGOgc60B0tHzOrPILwiUdfVhUEozjAJjaiVLjCwtIusA==',key_name='tempest-keypair-724006026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07250ce4ef1b429f8a5c3c7763866763',ramdisk_id='',reservation_id='r-d03fj2ad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-374688010',owner_user_name='tempest-AttachVolumeShelveTestJSON-374688010-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:18:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c82a5e63234e40f6a8e63b3cb4dc97b3',uuid=32e28c73-9e3c-483b-807e-6b286413fe85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5ab685a-b1f3-4704-963f-e7db827c947c", "address": "fa:16:3e:d5:da:15", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5ab685a-b1", "ovs_interfaceid": "e5ab685a-b1f3-4704-963f-e7db827c947c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Converting VIF {"id": "e5ab685a-b1f3-4704-963f-e7db827c947c", "address": "fa:16:3e:d5:da:15", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5ab685a-b1", "ovs_interfaceid": "e5ab685a-b1f3-4704-963f-e7db827c947c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:da:15,bridge_name='br-int',has_traffic_filtering=True,id=e5ab685a-b1f3-4704-963f-e7db827c947c,network=Network(5318228c-491a-4ea1-a2b2-49ea8e15dccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5ab685a-b1') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG os_vif [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:da:15,bridge_name='br-int',has_traffic_filtering=True,id=e5ab685a-b1f3-4704-963f-e7db827c947c,network=Network(5318228c-491a-4ea1-a2b2-49ea8e15dccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5ab685a-b1') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9bc22cd1-492d-5e6d-abbc-b3cbbec0a229', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5ab685a-b1, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape5ab685a-b1, col_values=(('qos', UUID('ce6fea42-b615-4049-afec-ea64083947ea')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape5ab685a-b1, col_values=(('external_ids', {'iface-id': 'e5ab685a-b1f3-4704-963f-e7db827c947c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:da:15', 'vm-uuid': '32e28c73-9e3c-483b-807e-6b286413fe85'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:10 user nova-compute[74821]: INFO os_vif [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:da:15,bridge_name='br-int',has_traffic_filtering=True,id=e5ab685a-b1f3-4704-963f-e7db827c947c,network=Network(5318228c-491a-4ea1-a2b2-49ea8e15dccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5ab685a-b1')
Nov 06 13:18:10 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] No VIF found with MAC fa:16:3e:d5:da:15, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG nova.network.neutron [req-e10571c4-9e89-41e9-b1f7-48de39e9f70d req-cef25256-243e-4b19-a08d-efc25833a87d service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Updated VIF entry in instance network info cache for port e5ab685a-b1f3-4704-963f-e7db827c947c. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG nova.network.neutron [req-e10571c4-9e89-41e9-b1f7-48de39e9f70d req-cef25256-243e-4b19-a08d-efc25833a87d service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Updating instance_info_cache with network_info: [{"id": "e5ab685a-b1f3-4704-963f-e7db827c947c", "address": "fa:16:3e:d5:da:15", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5ab685a-b1", "ovs_interfaceid": "e5ab685a-b1f3-4704-963f-e7db827c947c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:18:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e10571c4-9e89-41e9-b1f7-48de39e9f70d req-cef25256-243e-4b19-a08d-efc25833a87d service nova] Releasing lock "refresh_cache-32e28c73-9e3c-483b-807e-6b286413fe85" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:18:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-9778fc7a-d5eb-407b-93ea-f7b20edda180 req-ff3face1-d1f6-423b-88fe-8a94603792e1 service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Received event network-vif-plugged-e5ab685a-b1f3-4704-963f-e7db827c947c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:18:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-9778fc7a-d5eb-407b-93ea-f7b20edda180 req-ff3face1-d1f6-423b-88fe-8a94603792e1 service nova] Acquiring lock "32e28c73-9e3c-483b-807e-6b286413fe85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:18:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-9778fc7a-d5eb-407b-93ea-f7b20edda180 req-ff3face1-d1f6-423b-88fe-8a94603792e1 service nova] Lock "32e28c73-9e3c-483b-807e-6b286413fe85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:18:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-9778fc7a-d5eb-407b-93ea-f7b20edda180 req-ff3face1-d1f6-423b-88fe-8a94603792e1 service nova] Lock "32e28c73-9e3c-483b-807e-6b286413fe85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:18:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-9778fc7a-d5eb-407b-93ea-f7b20edda180 req-ff3face1-d1f6-423b-88fe-8a94603792e1 service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] No waiting events found dispatching network-vif-plugged-e5ab685a-b1f3-4704-963f-e7db827c947c {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:18:12 user nova-compute[74821]: WARNING nova.compute.manager [req-9778fc7a-d5eb-407b-93ea-f7b20edda180 req-ff3face1-d1f6-423b-88fe-8a94603792e1 service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Received unexpected event network-vif-plugged-e5ab685a-b1f3-4704-963f-e7db827c947c for instance with vm_state building and task_state spawning.
Nov 06 13:18:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:14 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:14 user nova-compute[74821]: DEBUG nova.compute.manager [req-2e6db23e-d7b1-4bf1-9ad2-0b02eef984aa req-a9296759-9f6a-4ba9-8ed7-05a97f1189ab service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Received event network-vif-plugged-e5ab685a-b1f3-4704-963f-e7db827c947c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:18:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2e6db23e-d7b1-4bf1-9ad2-0b02eef984aa req-a9296759-9f6a-4ba9-8ed7-05a97f1189ab service nova] Acquiring lock "32e28c73-9e3c-483b-807e-6b286413fe85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:18:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2e6db23e-d7b1-4bf1-9ad2-0b02eef984aa req-a9296759-9f6a-4ba9-8ed7-05a97f1189ab service nova] Lock "32e28c73-9e3c-483b-807e-6b286413fe85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:18:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2e6db23e-d7b1-4bf1-9ad2-0b02eef984aa req-a9296759-9f6a-4ba9-8ed7-05a97f1189ab service nova] Lock "32e28c73-9e3c-483b-807e-6b286413fe85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:18:14 user nova-compute[74821]: DEBUG nova.compute.manager [req-2e6db23e-d7b1-4bf1-9ad2-0b02eef984aa req-a9296759-9f6a-4ba9-8ed7-05a97f1189ab service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] No waiting events found dispatching network-vif-plugged-e5ab685a-b1f3-4704-963f-e7db827c947c {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:18:14 user nova-compute[74821]: WARNING nova.compute.manager [req-2e6db23e-d7b1-4bf1-9ad2-0b02eef984aa req-a9296759-9f6a-4ba9-8ed7-05a97f1189ab service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Received unexpected event network-vif-plugged-e5ab685a-b1f3-4704-963f-e7db827c947c for instance with vm_state building and task_state spawning.
Nov 06 13:18:14 user nova-compute[74821]: DEBUG nova.compute.manager [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:18:14 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:18:14 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Instance spawned successfully.
Nov 06 13:18:14 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:18:14 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:18:14 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:18:14 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:18:14 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:18:14 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:18:14 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:18:14 user nova-compute[74821]: INFO nova.compute.manager [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Took 6.51 seconds to spawn the instance on the hypervisor.
Nov 06 13:18:14 user nova-compute[74821]: DEBUG nova.compute.manager [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:18:14 user nova-compute[74821]: INFO nova.compute.manager [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Took 7.49 seconds to build instance.
Nov 06 13:18:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e5dfb9d8-02e1-4fe6-880f-29a8b0904268 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "32e28c73-9e3c-483b-807e-6b286413fe85" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.631s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:18:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:20 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:24 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:18:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:27 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:18:28 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:18:28 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:18:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:29 user nova-compute[74821]: DEBUG nova.compute.manager [None req-6ff1dbaa-e69a-41c8-bb07-842b7d6548da tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:18:29 user nova-compute[74821]: INFO nova.compute.manager [None req-6ff1dbaa-e69a-41c8-bb07-842b7d6548da tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] instance snapshotting
Nov 06 13:18:29 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-6ff1dbaa-e69a-41c8-bb07-842b7d6548da tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Beginning live snapshot process
Nov 06 13:18:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6ff1dbaa-e69a-41c8-bb07-842b7d6548da tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json -f qcow2 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6ff1dbaa-e69a-41c8-bb07-842b7d6548da tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6ff1dbaa-e69a-41c8-bb07-842b7d6548da tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json -f qcow2 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:29 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:18:29 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:18:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6ff1dbaa-e69a-41c8-bb07-842b7d6548da tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json -f qcow2" returned: 0 in 0.189s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6ff1dbaa-e69a-41c8-bb07-842b7d6548da tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:30 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Didn't find any instances for network info cache update. {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 13:18:30 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:18:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6ff1dbaa-e69a-41c8-bb07-842b7d6548da tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.196s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6ff1dbaa-e69a-41c8-bb07-842b7d6548da tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6iib5xww/47788095759e47cdaee280b62473bb56.delta 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6ff1dbaa-e69a-41c8-bb07-842b7d6548da tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6iib5xww/47788095759e47cdaee280b62473bb56.delta 1073741824" returned: 0 in 0.176s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:30 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-6ff1dbaa-e69a-41c8-bb07-842b7d6548da tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 06 13:18:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:30 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:18:30 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:18:31 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-6ff1dbaa-e69a-41c8-bb07-842b7d6548da tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74821) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 13:18:31 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-6ff1dbaa-e69a-41c8-bb07-842b7d6548da tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74821) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 13:18:31 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-6ff1dbaa-e69a-41c8-bb07-842b7d6548da tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 06 13:18:31 user nova-compute[74821]: DEBUG nova.privsep.utils [None req-6ff1dbaa-e69a-41c8-bb07-842b7d6548da tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74821) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 13:18:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6ff1dbaa-e69a-41c8-bb07-842b7d6548da tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6iib5xww/47788095759e47cdaee280b62473bb56.delta /opt/stack/data/nova/instances/snapshots/tmp6iib5xww/47788095759e47cdaee280b62473bb56 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:31 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:18:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:18:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:18:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:18:32 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:18:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6ff1dbaa-e69a-41c8-bb07-842b7d6548da tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6iib5xww/47788095759e47cdaee280b62473bb56.delta /opt/stack/data/nova/instances/snapshots/tmp6iib5xww/47788095759e47cdaee280b62473bb56" returned: 0 in 0.392s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:32 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-6ff1dbaa-e69a-41c8-bb07-842b7d6548da tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Snapshot extracted, beginning image upload
Nov 06 13:18:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:35 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-6ff1dbaa-e69a-41c8-bb07-842b7d6548da tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Snapshot image upload complete
Nov 06 13:18:35 user nova-compute[74821]: INFO nova.compute.manager [None req-6ff1dbaa-e69a-41c8-bb07-842b7d6548da tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Took 6.04 seconds to snapshot the instance on the hypervisor.
Nov 06 13:18:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:35 user nova-compute[74821]: DEBUG nova.compute.manager [req-fd2650fe-0fc6-4ea8-abbf-3e1c83989968 req-d6918653-fb55-48ca-bd2a-cb67f992a041 service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Received event network-changed-054bfb88-19a2-4241-ae8d-0eded559c233 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:18:35 user nova-compute[74821]: DEBUG nova.compute.manager [req-fd2650fe-0fc6-4ea8-abbf-3e1c83989968 req-d6918653-fb55-48ca-bd2a-cb67f992a041 service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Refreshing instance network info cache due to event network-changed-054bfb88-19a2-4241-ae8d-0eded559c233. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:18:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fd2650fe-0fc6-4ea8-abbf-3e1c83989968 req-d6918653-fb55-48ca-bd2a-cb67f992a041 service nova] Acquiring lock "refresh_cache-bd32c388-aa78-43ef-ae93-8230b8eba8af" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:18:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fd2650fe-0fc6-4ea8-abbf-3e1c83989968 req-d6918653-fb55-48ca-bd2a-cb67f992a041 service nova] Acquired lock "refresh_cache-bd32c388-aa78-43ef-ae93-8230b8eba8af" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:18:35 user nova-compute[74821]: DEBUG nova.network.neutron [req-fd2650fe-0fc6-4ea8-abbf-3e1c83989968 req-d6918653-fb55-48ca-bd2a-cb67f992a041 service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Refreshing network info cache for port 054bfb88-19a2-4241-ae8d-0eded559c233 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:18:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7c64452a-5377-413a-87bd-b20d4e32ff8e tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Acquiring lock "interface-bd32c388-aa78-43ef-ae93-8230b8eba8af-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:18:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7c64452a-5377-413a-87bd-b20d4e32ff8e tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lock "interface-bd32c388-aa78-43ef-ae93-8230b8eba8af-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:18:36 user nova-compute[74821]: DEBUG nova.objects.instance [None req-7c64452a-5377-413a-87bd-b20d4e32ff8e tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lazy-loading 'flavor' on Instance uuid bd32c388-aa78-43ef-ae93-8230b8eba8af {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:18:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:36 user nova-compute[74821]: DEBUG nova.network.neutron [req-fd2650fe-0fc6-4ea8-abbf-3e1c83989968 req-d6918653-fb55-48ca-bd2a-cb67f992a041 service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Updated VIF entry in instance network info cache for port 054bfb88-19a2-4241-ae8d-0eded559c233. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:18:36 user nova-compute[74821]: DEBUG nova.network.neutron [req-fd2650fe-0fc6-4ea8-abbf-3e1c83989968 req-d6918653-fb55-48ca-bd2a-cb67f992a041 service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Updating instance_info_cache with network_info: [{"id": "054bfb88-19a2-4241-ae8d-0eded559c233", "address": "fa:16:3e:7e:2a:2d", "network": {"id": "f5b630ec-39d9-4d50-b25a-3d90038e8b32", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-950408673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4287a7d278844ade94c8b38f8f76087e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054bfb88-19", "ovs_interfaceid": "054bfb88-19a2-4241-ae8d-0eded559c233", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:18:36 user nova-compute[74821]: DEBUG nova.objects.instance [None req-7c64452a-5377-413a-87bd-b20d4e32ff8e tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lazy-loading 'pci_requests' on Instance uuid bd32c388-aa78-43ef-ae93-8230b8eba8af {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:18:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fd2650fe-0fc6-4ea8-abbf-3e1c83989968 req-d6918653-fb55-48ca-bd2a-cb67f992a041 service nova] Releasing lock "refresh_cache-bd32c388-aa78-43ef-ae93-8230b8eba8af" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:18:36 user nova-compute[74821]: DEBUG nova.objects.base [None req-7c64452a-5377-413a-87bd-b20d4e32ff8e tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Object Instance<bd32c388-aa78-43ef-ae93-8230b8eba8af> lazy-loaded attributes: flavor,pci_requests {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:18:36 user nova-compute[74821]: DEBUG nova.network.neutron [None req-7c64452a-5377-413a-87bd-b20d4e32ff8e tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:18:36 user nova-compute[74821]: DEBUG nova.policy [None req-7c64452a-5377-413a-87bd-b20d4e32ff8e tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '63d66293fbbb4460a5e181687fc31fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4287a7d278844ade94c8b38f8f76087e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:18:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json" returned: 0 in 0.432s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:37 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:18:37 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:18:37 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=7433MB free_disk=25.46560287475586GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:18:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:18:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:18:37 user nova-compute[74821]: DEBUG nova.network.neutron [None req-7c64452a-5377-413a-87bd-b20d4e32ff8e tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Successfully created port: 0cf4a358-eb19-49f2-9ce1-9e4ee135805c {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:18:37 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 3e21d005-f190-478a-a911-e483e1235057 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:18:37 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 311817c5-7b08-4da9-98eb-c685f37e6fd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:18:37 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance f8c537c6-fa3e-4842-9471-7258a22c01f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:18:37 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 2de346cb-9858-47b8-a86c-4fde720d6127 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:18:37 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 49c65aca-8392-46ba-8fa3-b47ff2416cb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:18:37 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance bd32c388-aa78-43ef-ae93-8230b8eba8af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:18:37 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 107abf1d-96da-4406-8111-ef0bc09fb3e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:18:37 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance cc3c1518-c493-41b0-a748-a0ed933c2b1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:18:37 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 32e28c73-9e3c-483b-807e-6b286413fe85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:18:37 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:18:37 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:18:37 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:18:37 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:18:37 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:18:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.505s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:18:38 user nova-compute[74821]: DEBUG nova.network.neutron [None req-7c64452a-5377-413a-87bd-b20d4e32ff8e tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Successfully updated port: 0cf4a358-eb19-49f2-9ce1-9e4ee135805c {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:18:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7c64452a-5377-413a-87bd-b20d4e32ff8e tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Acquiring lock "refresh_cache-bd32c388-aa78-43ef-ae93-8230b8eba8af" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:18:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7c64452a-5377-413a-87bd-b20d4e32ff8e tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Acquired lock "refresh_cache-bd32c388-aa78-43ef-ae93-8230b8eba8af" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:18:38 user nova-compute[74821]: DEBUG nova.network.neutron [None req-7c64452a-5377-413a-87bd-b20d4e32ff8e tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:18:38 user nova-compute[74821]: DEBUG nova.compute.manager [req-e6813045-1dd4-405c-8499-41156f6014a4 req-215bca45-3703-4163-a97c-60dc212d0d9c service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Received event network-changed-0cf4a358-eb19-49f2-9ce1-9e4ee135805c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:18:38 user nova-compute[74821]: DEBUG nova.compute.manager [req-e6813045-1dd4-405c-8499-41156f6014a4 req-215bca45-3703-4163-a97c-60dc212d0d9c service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Refreshing instance network info cache due to event network-changed-0cf4a358-eb19-49f2-9ce1-9e4ee135805c. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:18:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e6813045-1dd4-405c-8499-41156f6014a4 req-215bca45-3703-4163-a97c-60dc212d0d9c service nova] Acquiring lock "refresh_cache-bd32c388-aa78-43ef-ae93-8230b8eba8af" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:18:38 user nova-compute[74821]: DEBUG nova.network.neutron [None req-7c64452a-5377-413a-87bd-b20d4e32ff8e tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Updating instance_info_cache with network_info: [{"id": "054bfb88-19a2-4241-ae8d-0eded559c233", "address": "fa:16:3e:7e:2a:2d", "network": {"id": "f5b630ec-39d9-4d50-b25a-3d90038e8b32", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-950408673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4287a7d278844ade94c8b38f8f76087e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054bfb88-19", "ovs_interfaceid": "054bfb88-19a2-4241-ae8d-0eded559c233", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0cf4a358-eb19-49f2-9ce1-9e4ee135805c", "address": "fa:16:3e:fc:11:5e", "network": {"id": "cc1ad5d0-5dc6-43a6-82ac-f94263c8fb20", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1465765696", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4287a7d278844ade94c8b38f8f76087e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf4a358-eb", "ovs_interfaceid": "0cf4a358-eb19-49f2-9ce1-9e4ee135805c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:18:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7c64452a-5377-413a-87bd-b20d4e32ff8e tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Releasing lock "refresh_cache-bd32c388-aa78-43ef-ae93-8230b8eba8af" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:18:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e6813045-1dd4-405c-8499-41156f6014a4 req-215bca45-3703-4163-a97c-60dc212d0d9c service nova] Acquired lock "refresh_cache-bd32c388-aa78-43ef-ae93-8230b8eba8af" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:18:38 user nova-compute[74821]: DEBUG nova.network.neutron [req-e6813045-1dd4-405c-8499-41156f6014a4 req-215bca45-3703-4163-a97c-60dc212d0d9c service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Refreshing network info cache for port 0cf4a358-eb19-49f2-9ce1-9e4ee135805c {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:18:38 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-7c64452a-5377-413a-87bd-b20d4e32ff8e tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:16:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-63051430',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-63051430',id=17,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTKqcTwYkCQENDzProvGIMFtMqaS+G/n1Hbl3a5LzTI2xbz3a2W94HTVkp4RevkFUNv1QjLjHpnVGJBeVEJild17QwHehxxe7AL3LQT4P27u7Ru79l65cMDiX2/YAksMA==',key_name='tempest-keypair-1412532163',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:16:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4287a7d278844ade94c8b38f8f76087e',ramdisk_id='',reservation_id='r-fuumtn90',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1737511361',owner_user_name='tempest-TaggedAttachmentsTest-1737511361-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:16:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63d66293fbbb4460a5e181687fc31fe7',uuid=bd32c388-aa78-43ef-ae93-8230b8eba8af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0cf4a358-eb19-49f2-9ce1-9e4ee135805c", "address": "fa:16:3e:fc:11:5e", "network": {"id": "cc1ad5d0-5dc6-43a6-82ac-f94263c8fb20", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1465765696", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4287a7d278844ade94c8b38f8f76087e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf4a358-eb", "ovs_interfaceid": "0cf4a358-eb19-49f2-9ce1-9e4ee135805c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:18:38 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-7c64452a-5377-413a-87bd-b20d4e32ff8e tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Converting VIF {"id": "0cf4a358-eb19-49f2-9ce1-9e4ee135805c", "address": "fa:16:3e:fc:11:5e", "network": {"id": "cc1ad5d0-5dc6-43a6-82ac-f94263c8fb20", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1465765696", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4287a7d278844ade94c8b38f8f76087e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf4a358-eb", "ovs_interfaceid": "0cf4a358-eb19-49f2-9ce1-9e4ee135805c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:18:38 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-7c64452a-5377-413a-87bd-b20d4e32ff8e tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:11:5e,bridge_name='br-int',has_traffic_filtering=True,id=0cf4a358-eb19-49f2-9ce1-9e4ee135805c,network=Network(cc1ad5d0-5dc6-43a6-82ac-f94263c8fb20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cf4a358-eb') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:18:38 user nova-compute[74821]: DEBUG os_vif [None req-7c64452a-5377-413a-87bd-b20d4e32ff8e tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:11:5e,bridge_name='br-int',has_traffic_filtering=True,id=0cf4a358-eb19-49f2-9ce1-9e4ee135805c,network=Network(cc1ad5d0-5dc6-43a6-82ac-f94263c8fb20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cf4a358-eb') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:18:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:18:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:18:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '896a4f61-6e38-5d4b-bb35-5f51cc494119', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:18:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:18:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0cf4a358-eb, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:18:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0cf4a358-eb, col_values=(('qos', UUID('89dd89b7-3465-4165-bfb0-92f36407d0c2')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:18:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0cf4a358-eb, col_values=(('external_ids', {'iface-id': '0cf4a358-eb19-49f2-9ce1-9e4ee135805c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:11:5e', 'vm-uuid': 'bd32c388-aa78-43ef-ae93-8230b8eba8af'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:18:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:18:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:38 user nova-compute[74821]: INFO os_vif [None req-7c64452a-5377-413a-87bd-b20d4e32ff8e tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:11:5e,bridge_name='br-int',has_traffic_filtering=True,id=0cf4a358-eb19-49f2-9ce1-9e4ee135805c,network=Network(cc1ad5d0-5dc6-43a6-82ac-f94263c8fb20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cf4a358-eb')
Nov 06 13:18:38 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-7c64452a-5377-413a-87bd-b20d4e32ff8e tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:16:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-63051430',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-63051430',id=17,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTKqcTwYkCQENDzProvGIMFtMqaS+G/n1Hbl3a5LzTI2xbz3a2W94HTVkp4RevkFUNv1QjLjHpnVGJBeVEJild17QwHehxxe7AL3LQT4P27u7Ru79l65cMDiX2/YAksMA==',key_name='tempest-keypair-1412532163',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:16:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4287a7d278844ade94c8b38f8f76087e',ramdisk_id='',reservation_id='r-fuumtn90',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1737511361',owner_user_name='tempest-TaggedAttachmentsTest-1737511361-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:16:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63d66293fbbb4460a5e181687fc31fe7',uuid=bd32c388-aa78-43ef-ae93-8230b8eba8af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0cf4a358-eb19-49f2-9ce1-9e4ee135805c", "address": "fa:16:3e:fc:11:5e", "network": {"id": "cc1ad5d0-5dc6-43a6-82ac-f94263c8fb20", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1465765696", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4287a7d278844ade94c8b38f8f76087e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf4a358-eb", "ovs_interfaceid": "0cf4a358-eb19-49f2-9ce1-9e4ee135805c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:18:38 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-7c64452a-5377-413a-87bd-b20d4e32ff8e tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Converting VIF {"id": "0cf4a358-eb19-49f2-9ce1-9e4ee135805c", "address": "fa:16:3e:fc:11:5e", "network": {"id": "cc1ad5d0-5dc6-43a6-82ac-f94263c8fb20", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1465765696", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4287a7d278844ade94c8b38f8f76087e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf4a358-eb", "ovs_interfaceid": "0cf4a358-eb19-49f2-9ce1-9e4ee135805c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:18:38 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-7c64452a-5377-413a-87bd-b20d4e32ff8e tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:11:5e,bridge_name='br-int',has_traffic_filtering=True,id=0cf4a358-eb19-49f2-9ce1-9e4ee135805c,network=Network(cc1ad5d0-5dc6-43a6-82ac-f94263c8fb20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cf4a358-eb') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:18:38 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-7c64452a-5377-413a-87bd-b20d4e32ff8e tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] attach device xml: <interface type="ethernet">
Nov 06 13:18:38 user nova-compute[74821]:   <mac address="fa:16:3e:fc:11:5e"/>
Nov 06 13:18:38 user nova-compute[74821]:   <model type="virtio"/>
Nov 06 13:18:38 user nova-compute[74821]:   <mtu size="1442"/>
Nov 06 13:18:38 user nova-compute[74821]:   <target dev="tap0cf4a358-eb"/>
Nov 06 13:18:38 user nova-compute[74821]: </interface>
Nov 06 13:18:38 user nova-compute[74821]:  {{(pid=74821) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 13:18:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:39 user nova-compute[74821]: DEBUG nova.network.neutron [req-e6813045-1dd4-405c-8499-41156f6014a4 req-215bca45-3703-4163-a97c-60dc212d0d9c service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Updated VIF entry in instance network info cache for port 0cf4a358-eb19-49f2-9ce1-9e4ee135805c. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:18:39 user nova-compute[74821]: DEBUG nova.network.neutron [req-e6813045-1dd4-405c-8499-41156f6014a4 req-215bca45-3703-4163-a97c-60dc212d0d9c service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Updating instance_info_cache with network_info: [{"id": "054bfb88-19a2-4241-ae8d-0eded559c233", "address": "fa:16:3e:7e:2a:2d", "network": {"id": "f5b630ec-39d9-4d50-b25a-3d90038e8b32", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-950408673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4287a7d278844ade94c8b38f8f76087e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054bfb88-19", "ovs_interfaceid": "054bfb88-19a2-4241-ae8d-0eded559c233", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0cf4a358-eb19-49f2-9ce1-9e4ee135805c", "address": "fa:16:3e:fc:11:5e", "network": {"id": "cc1ad5d0-5dc6-43a6-82ac-f94263c8fb20", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1465765696", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4287a7d278844ade94c8b38f8f76087e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf4a358-eb", "ovs_interfaceid": "0cf4a358-eb19-49f2-9ce1-9e4ee135805c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:18:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e6813045-1dd4-405c-8499-41156f6014a4 req-215bca45-3703-4163-a97c-60dc212d0d9c service nova] Releasing lock "refresh_cache-bd32c388-aa78-43ef-ae93-8230b8eba8af" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:18:39 user nova-compute[74821]: DEBUG nova.compute.manager [req-651b7ba4-96bd-453e-9b4f-ae1ef75ef092 req-a4dc4606-83ac-4da5-9c8f-334b6af3b6e6 service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Received event network-vif-plugged-0cf4a358-eb19-49f2-9ce1-9e4ee135805c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:18:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-651b7ba4-96bd-453e-9b4f-ae1ef75ef092 req-a4dc4606-83ac-4da5-9c8f-334b6af3b6e6 service nova] Acquiring lock "bd32c388-aa78-43ef-ae93-8230b8eba8af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:18:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-651b7ba4-96bd-453e-9b4f-ae1ef75ef092 req-a4dc4606-83ac-4da5-9c8f-334b6af3b6e6 service nova] Lock "bd32c388-aa78-43ef-ae93-8230b8eba8af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:18:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-651b7ba4-96bd-453e-9b4f-ae1ef75ef092 req-a4dc4606-83ac-4da5-9c8f-334b6af3b6e6 service nova] Lock "bd32c388-aa78-43ef-ae93-8230b8eba8af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:18:39 user nova-compute[74821]: DEBUG nova.compute.manager [req-651b7ba4-96bd-453e-9b4f-ae1ef75ef092 req-a4dc4606-83ac-4da5-9c8f-334b6af3b6e6 service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] No waiting events found dispatching network-vif-plugged-0cf4a358-eb19-49f2-9ce1-9e4ee135805c {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:18:39 user nova-compute[74821]: WARNING nova.compute.manager [req-651b7ba4-96bd-453e-9b4f-ae1ef75ef092 req-a4dc4606-83ac-4da5-9c8f-334b6af3b6e6 service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Received unexpected event network-vif-plugged-0cf4a358-eb19-49f2-9ce1-9e4ee135805c for instance with vm_state active and task_state None.
Nov 06 13:18:39 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7c64452a-5377-413a-87bd-b20d4e32ff8e tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:18:39 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7c64452a-5377-413a-87bd-b20d4e32ff8e tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] No BDM found with device name hda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:18:39 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7c64452a-5377-413a-87bd-b20d4e32ff8e tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] No VIF found with MAC fa:16:3e:7e:2a:2d, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:18:39 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-7c64452a-5377-413a-87bd-b20d4e32ff8e tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:18:39 user nova-compute[74821]:   <nova:package version="0.0.0"/>
Nov 06 13:18:39 user nova-compute[74821]:   <nova:name>tempest-device-tagging-server-63051430</nova:name>
Nov 06 13:18:39 user nova-compute[74821]:   <nova:creationTime>2023-11-06 13:18:39</nova:creationTime>
Nov 06 13:18:39 user nova-compute[74821]:   <nova:flavor name="m1.tiny">
Nov 06 13:18:39 user nova-compute[74821]:     <nova:memory>512</nova:memory>
Nov 06 13:18:39 user nova-compute[74821]:     <nova:disk>1</nova:disk>
Nov 06 13:18:39 user nova-compute[74821]:     <nova:swap>0</nova:swap>
Nov 06 13:18:39 user nova-compute[74821]:     <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:18:39 user nova-compute[74821]:     <nova:vcpus>1</nova:vcpus>
Nov 06 13:18:39 user nova-compute[74821]:   </nova:flavor>
Nov 06 13:18:39 user nova-compute[74821]:   <nova:owner>
Nov 06 13:18:39 user nova-compute[74821]:     <nova:user uuid="63d66293fbbb4460a5e181687fc31fe7">tempest-TaggedAttachmentsTest-1737511361-project-member</nova:user>
Nov 06 13:18:39 user nova-compute[74821]:     <nova:project uuid="4287a7d278844ade94c8b38f8f76087e">tempest-TaggedAttachmentsTest-1737511361</nova:project>
Nov 06 13:18:39 user nova-compute[74821]:   </nova:owner>
Nov 06 13:18:39 user nova-compute[74821]:   <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:18:39 user nova-compute[74821]:   <nova:ports>
Nov 06 13:18:39 user nova-compute[74821]:     <nova:port uuid="054bfb88-19a2-4241-ae8d-0eded559c233">
Nov 06 13:18:39 user nova-compute[74821]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 13:18:39 user nova-compute[74821]:     </nova:port>
Nov 06 13:18:39 user nova-compute[74821]:     <nova:port uuid="0cf4a358-eb19-49f2-9ce1-9e4ee135805c">
Nov 06 13:18:39 user nova-compute[74821]:       <nova:ip type="fixed" address="10.10.10.187" ipVersion="4"/>
Nov 06 13:18:39 user nova-compute[74821]:     </nova:port>
Nov 06 13:18:39 user nova-compute[74821]:   </nova:ports>
Nov 06 13:18:39 user nova-compute[74821]: </nova:instance>
Nov 06 13:18:39 user nova-compute[74821]:  {{(pid=74821) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 06 13:18:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7c64452a-5377-413a-87bd-b20d4e32ff8e tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lock "interface-bd32c388-aa78-43ef-ae93-8230b8eba8af-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.289s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:18:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Acquiring lock "bd32c388-aa78-43ef-ae93-8230b8eba8af" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:18:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lock "bd32c388-aa78-43ef-ae93-8230b8eba8af" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:18:39 user nova-compute[74821]: DEBUG nova.objects.instance [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lazy-loading 'flavor' on Instance uuid bd32c388-aa78-43ef-ae93-8230b8eba8af {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:18:39 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:18:39 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:18:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lock "bd32c388-aa78-43ef-ae93-8230b8eba8af" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:18:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Acquiring lock "bd32c388-aa78-43ef-ae93-8230b8eba8af" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:18:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lock "bd32c388-aa78-43ef-ae93-8230b8eba8af" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:18:40 user nova-compute[74821]: INFO nova.compute.manager [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Attaching volume 6f21a78c-e7f7-47c5-9373-c9ed385383db to /dev/vdb
Nov 06 13:18:40 user nova-compute[74821]: DEBUG os_brick.utils [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:18:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:40 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[de58bdb3-3adc-41de-922d-1d222f9244db]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:18:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:40 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4d70d6-7e3a-4a83-ad15-43342e92f7e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:18:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:40 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3b3a65-7e98-405f-9ad1-c12d9d1f3303]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:18:40 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1258a0eb-3e8f-41b4-8336-6914908012b1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:18:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:18:40 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:18:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:18:40 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:18:40 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aaffb7f-0437-4d23-99f7-f27c92a763f8]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:18:40 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:18:40 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:18:40 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:18:40 user nova-compute[74821]: DEBUG os_brick.utils [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:18:40 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Updating existing volume attachment record: 4dedf6bc-22e1-4faf-93d0-8c5762475539 {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:18:41 user nova-compute[74821]: DEBUG nova.compute.manager [req-f8d358af-5e4a-4e1d-af06-9df7e9839a7d req-add315f4-f91f-4be4-b35e-75b1dc5c3b95 service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Received event network-vif-plugged-0cf4a358-eb19-49f2-9ce1-9e4ee135805c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:18:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f8d358af-5e4a-4e1d-af06-9df7e9839a7d req-add315f4-f91f-4be4-b35e-75b1dc5c3b95 service nova] Acquiring lock "bd32c388-aa78-43ef-ae93-8230b8eba8af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:18:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f8d358af-5e4a-4e1d-af06-9df7e9839a7d req-add315f4-f91f-4be4-b35e-75b1dc5c3b95 service nova] Lock "bd32c388-aa78-43ef-ae93-8230b8eba8af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:18:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f8d358af-5e4a-4e1d-af06-9df7e9839a7d req-add315f4-f91f-4be4-b35e-75b1dc5c3b95 service nova] Lock "bd32c388-aa78-43ef-ae93-8230b8eba8af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:18:41 user nova-compute[74821]: DEBUG nova.compute.manager [req-f8d358af-5e4a-4e1d-af06-9df7e9839a7d req-add315f4-f91f-4be4-b35e-75b1dc5c3b95 service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] No waiting events found dispatching network-vif-plugged-0cf4a358-eb19-49f2-9ce1-9e4ee135805c {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:18:41 user nova-compute[74821]: WARNING nova.compute.manager [req-f8d358af-5e4a-4e1d-af06-9df7e9839a7d req-add315f4-f91f-4be4-b35e-75b1dc5c3b95 service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Received unexpected event network-vif-plugged-0cf4a358-eb19-49f2-9ce1-9e4ee135805c for instance with vm_state active and task_state None.
Nov 06 13:18:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:43 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:46 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:48 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "290cd798-a041-40c0-8ef9-319d3627ff82" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:18:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "290cd798-a041-40c0-8ef9-319d3627ff82" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:18:49 user nova-compute[74821]: DEBUG nova.compute.manager [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:18:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:18:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:18:49 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:18:49 user nova-compute[74821]: INFO nova.compute.claims [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Claim successful on node user
Nov 06 13:18:49 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:18:49 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:18:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.567s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:18:49 user nova-compute[74821]: DEBUG nova.compute.manager [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:18:49 user nova-compute[74821]: DEBUG nova.compute.manager [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:18:49 user nova-compute[74821]: DEBUG nova.network.neutron [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:18:49 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:18:49 user nova-compute[74821]: DEBUG nova.compute.manager [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:18:50 user nova-compute[74821]: DEBUG nova.compute.manager [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:18:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:18:50 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Creating image(s)
Nov 06 13:18:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "/opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:18:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "/opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:18:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "/opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:18:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:50 user nova-compute[74821]: DEBUG nova.policy [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0620d1928d8d434fbe0bc1cdb31a2a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77233758870b4fdfbb7ca76829f0f82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:18:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.197s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:18:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:18:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.246s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk 1073741824" returned: 0 in 0.052s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.305s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:18:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.208s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:50 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Checking if we can resize image /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:18:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:18:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:18:51 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Cannot resize image /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:18:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:18:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Ensure instance console log exists: /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:18:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:18:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:18:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:18:51 user nova-compute[74821]: DEBUG nova.network.neutron [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Successfully created port: 741cb43d-19ba-4edc-92f0-5de562bf4c2c {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG nova.network.neutron [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Successfully updated port: 741cb43d-19ba-4edc-92f0-5de562bf4c2c {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "refresh_cache-290cd798-a041-40c0-8ef9-319d3627ff82" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquired lock "refresh_cache-290cd798-a041-40c0-8ef9-319d3627ff82" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG nova.network.neutron [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-eb05255c-6f77-4649-a94b-729c68456e23 req-db5e498b-0018-4cb4-9798-d482e62912ea service nova] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Received event network-changed-741cb43d-19ba-4edc-92f0-5de562bf4c2c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-eb05255c-6f77-4649-a94b-729c68456e23 req-db5e498b-0018-4cb4-9798-d482e62912ea service nova] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Refreshing instance network info cache due to event network-changed-741cb43d-19ba-4edc-92f0-5de562bf4c2c. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-eb05255c-6f77-4649-a94b-729c68456e23 req-db5e498b-0018-4cb4-9798-d482e62912ea service nova] Acquiring lock "refresh_cache-290cd798-a041-40c0-8ef9-319d3627ff82" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG nova.network.neutron [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG nova.network.neutron [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Updating instance_info_cache with network_info: [{"id": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "address": "fa:16:3e:6c:6c:87", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap741cb43d-19", "ovs_interfaceid": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Releasing lock "refresh_cache-290cd798-a041-40c0-8ef9-319d3627ff82" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG nova.compute.manager [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Instance network_info: |[{"id": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "address": "fa:16:3e:6c:6c:87", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap741cb43d-19", "ovs_interfaceid": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-eb05255c-6f77-4649-a94b-729c68456e23 req-db5e498b-0018-4cb4-9798-d482e62912ea service nova] Acquired lock "refresh_cache-290cd798-a041-40c0-8ef9-319d3627ff82" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG nova.network.neutron [req-eb05255c-6f77-4649-a94b-729c68456e23 req-db5e498b-0018-4cb4-9798-d482e62912ea service nova] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Refreshing network info cache for port 741cb43d-19ba-4edc-92f0-5de562bf4c2c {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Start _get_guest_xml network_info=[{"id": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "address": "fa:16:3e:6c:6c:87", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap741cb43d-19", "ovs_interfaceid": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:18:52 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:18:52 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:18:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:18:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-219751972',display_name='tempest-tempest.common.compute-instance-219751972',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-219751972',id=21,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGVJpgtmRZL9WKhOaXwD5m/EAyvGSguG6jTTT7b4IRvn135izX0urMafelC8vQXZBMR8O1HoZmDg8wWA0Bz8SPSg87ol6FREXNQzdTu5vhYkn54jvZdlsWdAb1XlCYP+3Q==',key_name='tempest-keypair-1473532461',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77233758870b4fdfbb7ca76829f0f82e',ramdisk_id='',reservation_id='r-4lip00k3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1986828412',owner_user_name='tempest-ServerActionsTestOtherA-1986828412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:18:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0620d1928d8d434fbe0bc1cdb31a2a89',uuid=290cd798-a041-40c0-8ef9-319d3627ff82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "address": "fa:16:3e:6c:6c:87", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap741cb43d-19", "ovs_interfaceid": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Converting VIF {"id": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "address": "fa:16:3e:6c:6c:87", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap741cb43d-19", "ovs_interfaceid": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:6c:87,bridge_name='br-int',has_traffic_filtering=True,id=741cb43d-19ba-4edc-92f0-5de562bf4c2c,network=Network(a3838abe-b3bb-4878-9d5d-eb80a8cf60a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap741cb43d-19') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG nova.objects.instance [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lazy-loading 'pci_devices' on Instance uuid 290cd798-a041-40c0-8ef9-319d3627ff82 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:18:52 user nova-compute[74821]:   <uuid>290cd798-a041-40c0-8ef9-319d3627ff82</uuid>
Nov 06 13:18:52 user nova-compute[74821]:   <name>instance-00000015</name>
Nov 06 13:18:52 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:18:52 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:18:52 user nova-compute[74821]:   <metadata>
Nov 06 13:18:52 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:18:52 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:18:52 user nova-compute[74821]:       <nova:name>tempest-tempest.common.compute-instance-219751972</nova:name>
Nov 06 13:18:52 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:18:52</nova:creationTime>
Nov 06 13:18:52 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:18:52 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:18:52 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:18:52 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:18:52 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:18:52 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:18:52 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:18:52 user nova-compute[74821]:       <nova:owner>
Nov 06 13:18:52 user nova-compute[74821]:         <nova:user uuid="0620d1928d8d434fbe0bc1cdb31a2a89">tempest-ServerActionsTestOtherA-1986828412-project-member</nova:user>
Nov 06 13:18:52 user nova-compute[74821]:         <nova:project uuid="77233758870b4fdfbb7ca76829f0f82e">tempest-ServerActionsTestOtherA-1986828412</nova:project>
Nov 06 13:18:52 user nova-compute[74821]:       </nova:owner>
Nov 06 13:18:52 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:18:52 user nova-compute[74821]:       <nova:ports>
Nov 06 13:18:52 user nova-compute[74821]:         <nova:port uuid="741cb43d-19ba-4edc-92f0-5de562bf4c2c">
Nov 06 13:18:52 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 06 13:18:52 user nova-compute[74821]:         </nova:port>
Nov 06 13:18:52 user nova-compute[74821]:       </nova:ports>
Nov 06 13:18:52 user nova-compute[74821]:     </nova:instance>
Nov 06 13:18:52 user nova-compute[74821]:   </metadata>
Nov 06 13:18:52 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:18:52 user nova-compute[74821]:     <system>
Nov 06 13:18:52 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:18:52 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:18:52 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:18:52 user nova-compute[74821]:       <entry name="serial">290cd798-a041-40c0-8ef9-319d3627ff82</entry>
Nov 06 13:18:52 user nova-compute[74821]:       <entry name="uuid">290cd798-a041-40c0-8ef9-319d3627ff82</entry>
Nov 06 13:18:52 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:18:52 user nova-compute[74821]:     </system>
Nov 06 13:18:52 user nova-compute[74821]:   </sysinfo>
Nov 06 13:18:52 user nova-compute[74821]:   <os>
Nov 06 13:18:52 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:18:52 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:18:52 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:18:52 user nova-compute[74821]:   </os>
Nov 06 13:18:52 user nova-compute[74821]:   <features>
Nov 06 13:18:52 user nova-compute[74821]:     <acpi/>
Nov 06 13:18:52 user nova-compute[74821]:     <apic/>
Nov 06 13:18:52 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:18:52 user nova-compute[74821]:   </features>
Nov 06 13:18:52 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:18:52 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:18:52 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:18:52 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:18:52 user nova-compute[74821]:   </clock>
Nov 06 13:18:52 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:18:52 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:18:52 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:18:52 user nova-compute[74821]:   </cpu>
Nov 06 13:18:52 user nova-compute[74821]:   <devices>
Nov 06 13:18:52 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:18:52 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:18:52 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk"/>
Nov 06 13:18:52 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:18:52 user nova-compute[74821]:     </disk>
Nov 06 13:18:52 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:18:52 user nova-compute[74821]:       <mac address="fa:16:3e:6c:6c:87"/>
Nov 06 13:18:52 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:18:52 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:18:52 user nova-compute[74821]:       <target dev="tap741cb43d-19"/>
Nov 06 13:18:52 user nova-compute[74821]:     </interface>
Nov 06 13:18:52 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:18:52 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/console.log" append="off"/>
Nov 06 13:18:52 user nova-compute[74821]:     </serial>
Nov 06 13:18:52 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:18:52 user nova-compute[74821]:     <video>
Nov 06 13:18:52 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:18:52 user nova-compute[74821]:     </video>
Nov 06 13:18:52 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:18:52 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:18:52 user nova-compute[74821]:     </rng>
Nov 06 13:18:52 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:18:52 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:18:52 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:18:52 user nova-compute[74821]:     </memballoon>
Nov 06 13:18:52 user nova-compute[74821]:   </devices>
Nov 06 13:18:52 user nova-compute[74821]: </domain>
Nov 06 13:18:52 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:18:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-219751972',display_name='tempest-tempest.common.compute-instance-219751972',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-219751972',id=21,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGVJpgtmRZL9WKhOaXwD5m/EAyvGSguG6jTTT7b4IRvn135izX0urMafelC8vQXZBMR8O1HoZmDg8wWA0Bz8SPSg87ol6FREXNQzdTu5vhYkn54jvZdlsWdAb1XlCYP+3Q==',key_name='tempest-keypair-1473532461',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77233758870b4fdfbb7ca76829f0f82e',ramdisk_id='',reservation_id='r-4lip00k3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1986828412',owner_user_name='tempest-ServerActionsTestOtherA-1986828412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:18:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0620d1928d8d434fbe0bc1cdb31a2a89',uuid=290cd798-a041-40c0-8ef9-319d3627ff82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "address": "fa:16:3e:6c:6c:87", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap741cb43d-19", "ovs_interfaceid": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Converting VIF {"id": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "address": "fa:16:3e:6c:6c:87", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap741cb43d-19", "ovs_interfaceid": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:6c:87,bridge_name='br-int',has_traffic_filtering=True,id=741cb43d-19ba-4edc-92f0-5de562bf4c2c,network=Network(a3838abe-b3bb-4878-9d5d-eb80a8cf60a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap741cb43d-19') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG os_vif [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:6c:87,bridge_name='br-int',has_traffic_filtering=True,id=741cb43d-19ba-4edc-92f0-5de562bf4c2c,network=Network(a3838abe-b3bb-4878-9d5d-eb80a8cf60a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap741cb43d-19') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fbbe4059-72df-5a25-a197-c8a0e5f4a1f0', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap741cb43d-19, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap741cb43d-19, col_values=(('qos', UUID('fd612e67-2fa4-4555-92ac-b82a64f848bb')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap741cb43d-19, col_values=(('external_ids', {'iface-id': '741cb43d-19ba-4edc-92f0-5de562bf4c2c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:6c:87', 'vm-uuid': '290cd798-a041-40c0-8ef9-319d3627ff82'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:18:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:52 user nova-compute[74821]: INFO os_vif [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:6c:87,bridge_name='br-int',has_traffic_filtering=True,id=741cb43d-19ba-4edc-92f0-5de562bf4c2c,network=Network(a3838abe-b3bb-4878-9d5d-eb80a8cf60a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap741cb43d-19')
Nov 06 13:18:53 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:18:53 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] No VIF found with MAC fa:16:3e:6c:6c:87, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:18:53 user nova-compute[74821]: DEBUG nova.network.neutron [req-eb05255c-6f77-4649-a94b-729c68456e23 req-db5e498b-0018-4cb4-9798-d482e62912ea service nova] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Updated VIF entry in instance network info cache for port 741cb43d-19ba-4edc-92f0-5de562bf4c2c. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:18:53 user nova-compute[74821]: DEBUG nova.network.neutron [req-eb05255c-6f77-4649-a94b-729c68456e23 req-db5e498b-0018-4cb4-9798-d482e62912ea service nova] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Updating instance_info_cache with network_info: [{"id": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "address": "fa:16:3e:6c:6c:87", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap741cb43d-19", "ovs_interfaceid": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:18:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-eb05255c-6f77-4649-a94b-729c68456e23 req-db5e498b-0018-4cb4-9798-d482e62912ea service nova] Releasing lock "refresh_cache-290cd798-a041-40c0-8ef9-319d3627ff82" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:18:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:57 user nova-compute[74821]: DEBUG nova.compute.manager [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:18:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:18:57 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Instance spawned successfully.
Nov 06 13:18:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:18:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:18:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:18:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:18:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:18:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:18:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:18:57 user nova-compute[74821]: INFO nova.compute.manager [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Took 7.16 seconds to spawn the instance on the hypervisor.
Nov 06 13:18:57 user nova-compute[74821]: DEBUG nova.compute.manager [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:18:57 user nova-compute[74821]: INFO nova.compute.manager [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Took 8.13 seconds to build instance.
Nov 06 13:18:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0e86637c-ff8d-484b-8b4d-077fd1dec548 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "290cd798-a041-40c0-8ef9-319d3627ff82" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.256s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:18:57 user nova-compute[74821]: DEBUG nova.compute.manager [req-24255d5f-8263-4830-b917-b8135c3e31c6 req-7e2a46e9-7b18-493f-bad8-af469b753efe service nova] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Received event network-vif-plugged-741cb43d-19ba-4edc-92f0-5de562bf4c2c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:18:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-24255d5f-8263-4830-b917-b8135c3e31c6 req-7e2a46e9-7b18-493f-bad8-af469b753efe service nova] Acquiring lock "290cd798-a041-40c0-8ef9-319d3627ff82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:18:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-24255d5f-8263-4830-b917-b8135c3e31c6 req-7e2a46e9-7b18-493f-bad8-af469b753efe service nova] Lock "290cd798-a041-40c0-8ef9-319d3627ff82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:18:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-24255d5f-8263-4830-b917-b8135c3e31c6 req-7e2a46e9-7b18-493f-bad8-af469b753efe service nova] Lock "290cd798-a041-40c0-8ef9-319d3627ff82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:18:57 user nova-compute[74821]: DEBUG nova.compute.manager [req-24255d5f-8263-4830-b917-b8135c3e31c6 req-7e2a46e9-7b18-493f-bad8-af469b753efe service nova] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] No waiting events found dispatching network-vif-plugged-741cb43d-19ba-4edc-92f0-5de562bf4c2c {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:18:57 user nova-compute[74821]: WARNING nova.compute.manager [req-24255d5f-8263-4830-b917-b8135c3e31c6 req-7e2a46e9-7b18-493f-bad8-af469b753efe service nova] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Received unexpected event network-vif-plugged-741cb43d-19ba-4edc-92f0-5de562bf4c2c for instance with vm_state active and task_state None.
Nov 06 13:18:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:18:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-287b8a2d-3c69-494a-b4e0-e3f3bd951993 req-c66b2102-5eb9-4984-b1a4-4b09075556e6 service nova] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Received event network-vif-plugged-741cb43d-19ba-4edc-92f0-5de562bf4c2c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:18:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-287b8a2d-3c69-494a-b4e0-e3f3bd951993 req-c66b2102-5eb9-4984-b1a4-4b09075556e6 service nova] Acquiring lock "290cd798-a041-40c0-8ef9-319d3627ff82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:18:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-287b8a2d-3c69-494a-b4e0-e3f3bd951993 req-c66b2102-5eb9-4984-b1a4-4b09075556e6 service nova] Lock "290cd798-a041-40c0-8ef9-319d3627ff82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:18:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-287b8a2d-3c69-494a-b4e0-e3f3bd951993 req-c66b2102-5eb9-4984-b1a4-4b09075556e6 service nova] Lock "290cd798-a041-40c0-8ef9-319d3627ff82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:18:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-287b8a2d-3c69-494a-b4e0-e3f3bd951993 req-c66b2102-5eb9-4984-b1a4-4b09075556e6 service nova] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] No waiting events found dispatching network-vif-plugged-741cb43d-19ba-4edc-92f0-5de562bf4c2c {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:18:59 user nova-compute[74821]: WARNING nova.compute.manager [req-287b8a2d-3c69-494a-b4e0-e3f3bd951993 req-c66b2102-5eb9-4984-b1a4-4b09075556e6 service nova] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Received unexpected event network-vif-plugged-741cb43d-19ba-4edc-92f0-5de562bf4c2c for instance with vm_state active and task_state None.
Nov 06 13:19:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Acquiring lock "5a07f64b-5b12-4e7d-a041-ad591141aa17" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:19:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:19:01 user nova-compute[74821]: DEBUG nova.compute.manager [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:19:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:19:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:19:01 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:19:01 user nova-compute[74821]: INFO nova.compute.claims [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Claim successful on node user
Nov 06 13:19:01 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:19:01 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:19:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.631s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:19:01 user nova-compute[74821]: DEBUG nova.compute.manager [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:19:02 user nova-compute[74821]: DEBUG nova.compute.manager [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:19:02 user nova-compute[74821]: DEBUG nova.network.neutron [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:19:02 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:19:02 user nova-compute[74821]: DEBUG nova.compute.manager [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:19:02 user nova-compute[74821]: DEBUG nova.compute.manager [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:19:02 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:19:02 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Creating image(s)
Nov 06 13:19:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:19:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "/opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:19:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "/opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:19:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:02 user nova-compute[74821]: DEBUG nova.policy [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c788f2d8493b4bbab80872eba4045fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d867544bce424f90bcb0403e953f59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:19:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.238s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:19:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:19:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.213s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk 1073741824" returned: 0 in 0.064s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:19:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.208s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:03 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:19:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:03 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Cannot resize image /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:19:03 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:19:03 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Ensure instance console log exists: /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:19:03 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:19:03 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:19:03 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:19:03 user nova-compute[74821]: DEBUG nova.network.neutron [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Successfully created port: db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:19:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:04 user nova-compute[74821]: DEBUG nova.network.neutron [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Successfully updated port: db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:19:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Acquiring lock "refresh_cache-5a07f64b-5b12-4e7d-a041-ad591141aa17" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:19:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Acquired lock "refresh_cache-5a07f64b-5b12-4e7d-a041-ad591141aa17" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:19:04 user nova-compute[74821]: DEBUG nova.network.neutron [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:19:04 user nova-compute[74821]: DEBUG nova.compute.manager [req-3ed0d186-d8cd-4c5e-ad1a-c987cfe057ad req-375acbbc-524c-4d88-aa95-c3659bfcc486 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received event network-changed-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:19:04 user nova-compute[74821]: DEBUG nova.compute.manager [req-3ed0d186-d8cd-4c5e-ad1a-c987cfe057ad req-375acbbc-524c-4d88-aa95-c3659bfcc486 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Refreshing instance network info cache due to event network-changed-db18095e-82aa-407a-b43f-5f060b8c64ec. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:19:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3ed0d186-d8cd-4c5e-ad1a-c987cfe057ad req-375acbbc-524c-4d88-aa95-c3659bfcc486 service nova] Acquiring lock "refresh_cache-5a07f64b-5b12-4e7d-a041-ad591141aa17" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:19:04 user nova-compute[74821]: DEBUG nova.network.neutron [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG nova.network.neutron [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Updating instance_info_cache with network_info: [{"id": "db18095e-82aa-407a-b43f-5f060b8c64ec", "address": "fa:16:3e:30:ef:48", "network": {"id": "79eddc13-4e87-497c-af1f-ce215f23e831", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412663699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d867544bce424f90bcb0403e953f59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb18095e-82", "ovs_interfaceid": "db18095e-82aa-407a-b43f-5f060b8c64ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Releasing lock "refresh_cache-5a07f64b-5b12-4e7d-a041-ad591141aa17" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG nova.compute.manager [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Instance network_info: |[{"id": "db18095e-82aa-407a-b43f-5f060b8c64ec", "address": "fa:16:3e:30:ef:48", "network": {"id": "79eddc13-4e87-497c-af1f-ce215f23e831", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412663699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d867544bce424f90bcb0403e953f59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb18095e-82", "ovs_interfaceid": "db18095e-82aa-407a-b43f-5f060b8c64ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3ed0d186-d8cd-4c5e-ad1a-c987cfe057ad req-375acbbc-524c-4d88-aa95-c3659bfcc486 service nova] Acquired lock "refresh_cache-5a07f64b-5b12-4e7d-a041-ad591141aa17" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG nova.network.neutron [req-3ed0d186-d8cd-4c5e-ad1a-c987cfe057ad req-375acbbc-524c-4d88-aa95-c3659bfcc486 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Refreshing network info cache for port db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Start _get_guest_xml network_info=[{"id": "db18095e-82aa-407a-b43f-5f060b8c64ec", "address": "fa:16:3e:30:ef:48", "network": {"id": "79eddc13-4e87-497c-af1f-ce215f23e831", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412663699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d867544bce424f90bcb0403e953f59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb18095e-82", "ovs_interfaceid": "db18095e-82aa-407a-b43f-5f060b8c64ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:19:05 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:19:05 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:19:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:19:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1004493493',display_name='tempest-ServerStableDeviceRescueTest-server-1004493493',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1004493493',id=22,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBv29rmsLsLYiSk9kbTOijARa8gu+ah6i2bQrZxKfobLwcDnuJUCtjfp+YJRgwX32aeI6MDK+wE0irmaV53pFlnbi+Na7GAsfUUsSfu+9E+Izyqg0uf2ImUG12ugRFqtGw==',key_name='tempest-keypair-1601620280',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63d867544bce424f90bcb0403e953f59',ramdisk_id='',reservation_id='r-h5j27ucc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-273439640',owner_user_name='tempest-ServerStableDeviceRescueTest-273439640-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:19:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c788f2d8493b4bbab80872eba4045fb0',uuid=5a07f64b-5b12-4e7d-a041-ad591141aa17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db18095e-82aa-407a-b43f-5f060b8c64ec", "address": "fa:16:3e:30:ef:48", "network": {"id": "79eddc13-4e87-497c-af1f-ce215f23e831", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412663699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d867544bce424f90bcb0403e953f59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb18095e-82", "ovs_interfaceid": "db18095e-82aa-407a-b43f-5f060b8c64ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Converting VIF {"id": "db18095e-82aa-407a-b43f-5f060b8c64ec", "address": "fa:16:3e:30:ef:48", "network": {"id": "79eddc13-4e87-497c-af1f-ce215f23e831", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412663699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d867544bce424f90bcb0403e953f59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb18095e-82", "ovs_interfaceid": "db18095e-82aa-407a-b43f-5f060b8c64ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:ef:48,bridge_name='br-int',has_traffic_filtering=True,id=db18095e-82aa-407a-b43f-5f060b8c64ec,network=Network(79eddc13-4e87-497c-af1f-ce215f23e831),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb18095e-82') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG nova.objects.instance [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a07f64b-5b12-4e7d-a041-ad591141aa17 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:19:05 user nova-compute[74821]:   <uuid>5a07f64b-5b12-4e7d-a041-ad591141aa17</uuid>
Nov 06 13:19:05 user nova-compute[74821]:   <name>instance-00000016</name>
Nov 06 13:19:05 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:19:05 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:19:05 user nova-compute[74821]:   <metadata>
Nov 06 13:19:05 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:19:05 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:19:05 user nova-compute[74821]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1004493493</nova:name>
Nov 06 13:19:05 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:19:05</nova:creationTime>
Nov 06 13:19:05 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:19:05 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:19:05 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:19:05 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:19:05 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:19:05 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:19:05 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:19:05 user nova-compute[74821]:       <nova:owner>
Nov 06 13:19:05 user nova-compute[74821]:         <nova:user uuid="c788f2d8493b4bbab80872eba4045fb0">tempest-ServerStableDeviceRescueTest-273439640-project-member</nova:user>
Nov 06 13:19:05 user nova-compute[74821]:         <nova:project uuid="63d867544bce424f90bcb0403e953f59">tempest-ServerStableDeviceRescueTest-273439640</nova:project>
Nov 06 13:19:05 user nova-compute[74821]:       </nova:owner>
Nov 06 13:19:05 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:19:05 user nova-compute[74821]:       <nova:ports>
Nov 06 13:19:05 user nova-compute[74821]:         <nova:port uuid="db18095e-82aa-407a-b43f-5f060b8c64ec">
Nov 06 13:19:05 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 13:19:05 user nova-compute[74821]:         </nova:port>
Nov 06 13:19:05 user nova-compute[74821]:       </nova:ports>
Nov 06 13:19:05 user nova-compute[74821]:     </nova:instance>
Nov 06 13:19:05 user nova-compute[74821]:   </metadata>
Nov 06 13:19:05 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:19:05 user nova-compute[74821]:     <system>
Nov 06 13:19:05 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:19:05 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:19:05 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:19:05 user nova-compute[74821]:       <entry name="serial">5a07f64b-5b12-4e7d-a041-ad591141aa17</entry>
Nov 06 13:19:05 user nova-compute[74821]:       <entry name="uuid">5a07f64b-5b12-4e7d-a041-ad591141aa17</entry>
Nov 06 13:19:05 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:19:05 user nova-compute[74821]:     </system>
Nov 06 13:19:05 user nova-compute[74821]:   </sysinfo>
Nov 06 13:19:05 user nova-compute[74821]:   <os>
Nov 06 13:19:05 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:19:05 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:19:05 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:19:05 user nova-compute[74821]:   </os>
Nov 06 13:19:05 user nova-compute[74821]:   <features>
Nov 06 13:19:05 user nova-compute[74821]:     <acpi/>
Nov 06 13:19:05 user nova-compute[74821]:     <apic/>
Nov 06 13:19:05 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:19:05 user nova-compute[74821]:   </features>
Nov 06 13:19:05 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:19:05 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:19:05 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:19:05 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:19:05 user nova-compute[74821]:   </clock>
Nov 06 13:19:05 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:19:05 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:19:05 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:19:05 user nova-compute[74821]:   </cpu>
Nov 06 13:19:05 user nova-compute[74821]:   <devices>
Nov 06 13:19:05 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:19:05 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:19:05 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk"/>
Nov 06 13:19:05 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:19:05 user nova-compute[74821]:     </disk>
Nov 06 13:19:05 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:19:05 user nova-compute[74821]:       <mac address="fa:16:3e:30:ef:48"/>
Nov 06 13:19:05 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:19:05 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:19:05 user nova-compute[74821]:       <target dev="tapdb18095e-82"/>
Nov 06 13:19:05 user nova-compute[74821]:     </interface>
Nov 06 13:19:05 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:19:05 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/console.log" append="off"/>
Nov 06 13:19:05 user nova-compute[74821]:     </serial>
Nov 06 13:19:05 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:19:05 user nova-compute[74821]:     <video>
Nov 06 13:19:05 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:19:05 user nova-compute[74821]:     </video>
Nov 06 13:19:05 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:19:05 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:19:05 user nova-compute[74821]:     </rng>
Nov 06 13:19:05 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:19:05 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:19:05 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:19:05 user nova-compute[74821]:     </memballoon>
Nov 06 13:19:05 user nova-compute[74821]:   </devices>
Nov 06 13:19:05 user nova-compute[74821]: </domain>
Nov 06 13:19:05 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:19:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1004493493',display_name='tempest-ServerStableDeviceRescueTest-server-1004493493',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1004493493',id=22,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBv29rmsLsLYiSk9kbTOijARa8gu+ah6i2bQrZxKfobLwcDnuJUCtjfp+YJRgwX32aeI6MDK+wE0irmaV53pFlnbi+Na7GAsfUUsSfu+9E+Izyqg0uf2ImUG12ugRFqtGw==',key_name='tempest-keypair-1601620280',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63d867544bce424f90bcb0403e953f59',ramdisk_id='',reservation_id='r-h5j27ucc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-273439640',owner_user_name='tempest-ServerStableDeviceRescueTest-273439640-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:19:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c788f2d8493b4bbab80872eba4045fb0',uuid=5a07f64b-5b12-4e7d-a041-ad591141aa17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db18095e-82aa-407a-b43f-5f060b8c64ec", "address": "fa:16:3e:30:ef:48", "network": {"id": "79eddc13-4e87-497c-af1f-ce215f23e831", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412663699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d867544bce424f90bcb0403e953f59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb18095e-82", "ovs_interfaceid": "db18095e-82aa-407a-b43f-5f060b8c64ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Converting VIF {"id": "db18095e-82aa-407a-b43f-5f060b8c64ec", "address": "fa:16:3e:30:ef:48", "network": {"id": "79eddc13-4e87-497c-af1f-ce215f23e831", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412663699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d867544bce424f90bcb0403e953f59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb18095e-82", "ovs_interfaceid": "db18095e-82aa-407a-b43f-5f060b8c64ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:ef:48,bridge_name='br-int',has_traffic_filtering=True,id=db18095e-82aa-407a-b43f-5f060b8c64ec,network=Network(79eddc13-4e87-497c-af1f-ce215f23e831),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb18095e-82') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG os_vif [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:ef:48,bridge_name='br-int',has_traffic_filtering=True,id=db18095e-82aa-407a-b43f-5f060b8c64ec,network=Network(79eddc13-4e87-497c-af1f-ce215f23e831),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb18095e-82') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b854852b-977e-5171-8d3d-233ba73c4c94', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb18095e-82, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdb18095e-82, col_values=(('qos', UUID('3546c493-a409-40de-ba11-8472920680a1')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdb18095e-82, col_values=(('external_ids', {'iface-id': 'db18095e-82aa-407a-b43f-5f060b8c64ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:ef:48', 'vm-uuid': '5a07f64b-5b12-4e7d-a041-ad591141aa17'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:05 user nova-compute[74821]: INFO os_vif [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:ef:48,bridge_name='br-int',has_traffic_filtering=True,id=db18095e-82aa-407a-b43f-5f060b8c64ec,network=Network(79eddc13-4e87-497c-af1f-ce215f23e831),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb18095e-82')
Nov 06 13:19:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] No VIF found with MAC fa:16:3e:30:ef:48, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG nova.network.neutron [req-3ed0d186-d8cd-4c5e-ad1a-c987cfe057ad req-375acbbc-524c-4d88-aa95-c3659bfcc486 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Updated VIF entry in instance network info cache for port db18095e-82aa-407a-b43f-5f060b8c64ec. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG nova.network.neutron [req-3ed0d186-d8cd-4c5e-ad1a-c987cfe057ad req-375acbbc-524c-4d88-aa95-c3659bfcc486 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Updating instance_info_cache with network_info: [{"id": "db18095e-82aa-407a-b43f-5f060b8c64ec", "address": "fa:16:3e:30:ef:48", "network": {"id": "79eddc13-4e87-497c-af1f-ce215f23e831", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412663699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d867544bce424f90bcb0403e953f59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb18095e-82", "ovs_interfaceid": "db18095e-82aa-407a-b43f-5f060b8c64ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:19:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3ed0d186-d8cd-4c5e-ad1a-c987cfe057ad req-375acbbc-524c-4d88-aa95-c3659bfcc486 service nova] Releasing lock "refresh_cache-5a07f64b-5b12-4e7d-a041-ad591141aa17" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:19:06 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:19:06 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iVEeNxzj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:19:06 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:19:06 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:19:06 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:19:06 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:19:06 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:19:06 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:19:06 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:19:06 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:06 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db -p 172.16.0.220:3260" returned: 21 in 0.043s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:06 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2027ef9d-dfbb-4b02-bbe7-9a794b390f02]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:19:06 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:19:06 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:19:06 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:06 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97913af-65cd-454e-b1fa-79ee4a235437]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:19:06 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db] added
Nov 06 13:19:06 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:19:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:06 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f81275-353e-462f-895e-8af84a95a3ab]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:19:06 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:19:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.041s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f021a907-43b7-4514-9dd4-124235e3d91f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iVEeNxzj {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iVEeNxzj" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fbbcb8-d807-4b1d-94a0-2261275760be]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iVEeNxzj'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1a90b4-a851-43af-83ac-54a2be96097b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b72a2f6-91b8-4e62-8641-968484b0a98f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 06 13:19:07 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 06 13:19:07 user nova-compute[74821]:  {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:19:07 user nova-compute[74821]: WARNING os_brick.initiator.connectors.iscsi [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 06 13:19:07 user nova-compute[74821]: 
Nov 06 13:19:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG nova.compute.manager [req-ac69d3d1-8b7f-44da-9b6b-ea267b55ee1c req-766c99f3-9386-4a12-9aa8-2370df1d2799 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received event network-vif-plugged-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ac69d3d1-8b7f-44da-9b6b-ea267b55ee1c req-766c99f3-9386-4a12-9aa8-2370df1d2799 service nova] Acquiring lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ac69d3d1-8b7f-44da-9b6b-ea267b55ee1c req-766c99f3-9386-4a12-9aa8-2370df1d2799 service nova] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ac69d3d1-8b7f-44da-9b6b-ea267b55ee1c req-766c99f3-9386-4a12-9aa8-2370df1d2799 service nova] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG nova.compute.manager [req-ac69d3d1-8b7f-44da-9b6b-ea267b55ee1c req-766c99f3-9386-4a12-9aa8-2370df1d2799 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] No waiting events found dispatching network-vif-plugged-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:19:07 user nova-compute[74821]: WARNING nova.compute.manager [req-ac69d3d1-8b7f-44da-9b6b-ea267b55ee1c req-766c99f3-9386-4a12-9aa8-2370df1d2799 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received unexpected event network-vif-plugged-db18095e-82aa-407a-b43f-5f060b8c64ec for instance with vm_state building and task_state spawning.
Nov 06 13:19:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db -p 172.16.0.220:3260 --login" returned: 0 in 0.402s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f2463e-30cf-4521-9f06-521f282b3641]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db, portal: 172.16.0.220,3260]
Nov 06 13:19:07 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db, portal: 172.16.0.220,3260] successful.
Nov 06 13:19:07 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c78d77-d7bf-47c8-a50f-1df8dfef7758]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fbaca3-f3bf-4290-8de4-6faf9a104389]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db (non-flash)
Nov 06 13:19:07 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db (non-flash)
Nov 06 13:19:07 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.743s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.033s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9033fb28-c479-44cc-b420-378c18007f59]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iVEeNxzj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.794s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:19:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] <== connect_volume: return (1797ms) {'type': 'block', 'scsi_wwn': '23931326136653731', 'path': '/dev/sdb'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:19:08 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931326136653731', 'path': '/dev/sdb'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:19:08 user nova-compute[74821]: DEBUG nova.objects.instance [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lazy-loading 'flavor' on Instance uuid bd32c388-aa78-43ef-ae93-8230b8eba8af {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:19:08 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 13:19:08 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:19:08 user nova-compute[74821]:   <source dev="/dev/sdb"/>
Nov 06 13:19:08 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:19:08 user nova-compute[74821]:   <serial>6f21a78c-e7f7-47c5-9373-c9ed385383db</serial>
Nov 06 13:19:08 user nova-compute[74821]: </disk>
Nov 06 13:19:08 user nova-compute[74821]:  {{(pid=74821) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 13:19:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:19:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] No BDM found with device name hda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:19:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] No VIF found with MAC fa:16:3e:7e:2a:2d, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:19:09 user nova-compute[74821]: DEBUG nova.compute.manager [req-25ec37ae-9b37-43c8-a1ac-4aeac99241c4 req-9c60cc52-aea8-4ad7-b2c5-034ce0419e25 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received event network-vif-plugged-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:19:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-25ec37ae-9b37-43c8-a1ac-4aeac99241c4 req-9c60cc52-aea8-4ad7-b2c5-034ce0419e25 service nova] Acquiring lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:19:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-25ec37ae-9b37-43c8-a1ac-4aeac99241c4 req-9c60cc52-aea8-4ad7-b2c5-034ce0419e25 service nova] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:19:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-25ec37ae-9b37-43c8-a1ac-4aeac99241c4 req-9c60cc52-aea8-4ad7-b2c5-034ce0419e25 service nova] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:19:09 user nova-compute[74821]: DEBUG nova.compute.manager [req-25ec37ae-9b37-43c8-a1ac-4aeac99241c4 req-9c60cc52-aea8-4ad7-b2c5-034ce0419e25 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] No waiting events found dispatching network-vif-plugged-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:19:09 user nova-compute[74821]: WARNING nova.compute.manager [req-25ec37ae-9b37-43c8-a1ac-4aeac99241c4 req-9c60cc52-aea8-4ad7-b2c5-034ce0419e25 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received unexpected event network-vif-plugged-db18095e-82aa-407a-b43f-5f060b8c64ec for instance with vm_state building and task_state spawning.
Nov 06 13:19:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0c924702-d1f4-4c7b-b673-10d9a445cb73 tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lock "bd32c388-aa78-43ef-ae93-8230b8eba8af" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.350s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:19:09 user nova-compute[74821]: DEBUG nova.compute.manager [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:19:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:19:09 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Instance spawned successfully.
Nov 06 13:19:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:19:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:19:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:19:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:19:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:19:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:19:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:19:09 user nova-compute[74821]: INFO nova.compute.manager [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Took 7.62 seconds to spawn the instance on the hypervisor.
Nov 06 13:19:09 user nova-compute[74821]: DEBUG nova.compute.manager [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:19:10 user nova-compute[74821]: INFO nova.compute.manager [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Took 8.72 seconds to build instance.
Nov 06 13:19:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-29cde3fd-a8f7-4449-99ab-1f553fe2caf2 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.927s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:19:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Acquiring lock "bd32c388-aa78-43ef-ae93-8230b8eba8af" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:19:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lock "bd32c388-aa78-43ef-ae93-8230b8eba8af" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:19:10 user nova-compute[74821]: INFO nova.compute.manager [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Detaching volume 6f21a78c-e7f7-47c5-9373-c9ed385383db
Nov 06 13:19:10 user nova-compute[74821]: INFO nova.virt.block_device [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Attempting to driver detach volume 6f21a78c-e7f7-47c5-9373-c9ed385383db from mountpoint /dev/vdb
Nov 06 13:19:10 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Attempting to detach device vdb from instance bd32c388-aa78-43ef-ae93-8230b8eba8af from the persistent domain config. {{(pid=74821) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 13:19:10 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:19:10 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:19:10 user nova-compute[74821]:   <source dev="/dev/sdb"/>
Nov 06 13:19:10 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:19:10 user nova-compute[74821]:   <serial>6f21a78c-e7f7-47c5-9373-c9ed385383db</serial>
Nov 06 13:19:10 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 06 13:19:10 user nova-compute[74821]: </disk>
Nov 06 13:19:10 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:19:10 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Successfully detached device vdb from instance bd32c388-aa78-43ef-ae93-8230b8eba8af from the persistent domain config.
Nov 06 13:19:10 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bd32c388-aa78-43ef-ae93-8230b8eba8af from the live domain config. {{(pid=74821) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 13:19:10 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:19:10 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:19:10 user nova-compute[74821]:   <source dev="/dev/sdb"/>
Nov 06 13:19:10 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:19:10 user nova-compute[74821]:   <serial>6f21a78c-e7f7-47c5-9373-c9ed385383db</serial>
Nov 06 13:19:10 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 06 13:19:10 user nova-compute[74821]: </disk>
Nov 06 13:19:10 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:19:11 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bd32c388-aa78-43ef-ae93-8230b8eba8af {{(pid=74821) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 13:19:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "61beb251-4345-44e6-a176-5c14c99c9a52" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:19:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "61beb251-4345-44e6-a176-5c14c99c9a52" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:19:13 user nova-compute[74821]: DEBUG nova.compute.manager [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:19:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:19:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:19:13 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:19:13 user nova-compute[74821]: INFO nova.compute.claims [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Claim successful on node user
Nov 06 13:19:14 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:14 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:19:14 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:19:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.903s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:19:14 user nova-compute[74821]: DEBUG nova.compute.manager [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:19:14 user nova-compute[74821]: DEBUG nova.compute.manager [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:19:14 user nova-compute[74821]: DEBUG nova.network.neutron [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:19:14 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:19:14 user nova-compute[74821]: DEBUG nova.compute.manager [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:19:14 user nova-compute[74821]: DEBUG nova.policy [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a0f35998b664c32990f079ca1cd5e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e246e1fd12054401988f9d49f6ad9373', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:19:14 user nova-compute[74821]: DEBUG nova.compute.manager [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:19:14 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:19:14 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Creating image(s)
Nov 06 13:19:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "/opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:19:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "/opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:19:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "/opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:19:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.247s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:19:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:19:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.267s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk 1073741824" returned: 0 in 0.058s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.349s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:19:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:15 user nova-compute[74821]: DEBUG nova.network.neutron [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Successfully created port: b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:19:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.245s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:15 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Checking if we can resize image /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:19:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk --force-share --output=json" returned: 0 in 0.306s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Cannot resize image /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Ensure instance console log exists: /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG nova.network.neutron [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Successfully updated port: b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "refresh_cache-61beb251-4345-44e6-a176-5c14c99c9a52" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquired lock "refresh_cache-61beb251-4345-44e6-a176-5c14c99c9a52" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG nova.network.neutron [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG nova.compute.manager [req-78903a34-0553-4a09-888b-9e274876a207 req-66bef397-7503-4e4c-bb8e-4acc32750474 service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received event network-changed-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG nova.compute.manager [req-78903a34-0553-4a09-888b-9e274876a207 req-66bef397-7503-4e4c-bb8e-4acc32750474 service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Refreshing instance network info cache due to event network-changed-b5020053-395f-4341-99be-d522ebb938c7. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-78903a34-0553-4a09-888b-9e274876a207 req-66bef397-7503-4e4c-bb8e-4acc32750474 service nova] Acquiring lock "refresh_cache-61beb251-4345-44e6-a176-5c14c99c9a52" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG nova.network.neutron [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG nova.network.neutron [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Updating instance_info_cache with network_info: [{"id": "b5020053-395f-4341-99be-d522ebb938c7", "address": "fa:16:3e:d4:3e:f8", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5020053-39", "ovs_interfaceid": "b5020053-395f-4341-99be-d522ebb938c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Releasing lock "refresh_cache-61beb251-4345-44e6-a176-5c14c99c9a52" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG nova.compute.manager [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Instance network_info: |[{"id": "b5020053-395f-4341-99be-d522ebb938c7", "address": "fa:16:3e:d4:3e:f8", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5020053-39", "ovs_interfaceid": "b5020053-395f-4341-99be-d522ebb938c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-78903a34-0553-4a09-888b-9e274876a207 req-66bef397-7503-4e4c-bb8e-4acc32750474 service nova] Acquired lock "refresh_cache-61beb251-4345-44e6-a176-5c14c99c9a52" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG nova.network.neutron [req-78903a34-0553-4a09-888b-9e274876a207 req-66bef397-7503-4e4c-bb8e-4acc32750474 service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Refreshing network info cache for port b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Start _get_guest_xml network_info=[{"id": "b5020053-395f-4341-99be-d522ebb938c7", "address": "fa:16:3e:d4:3e:f8", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5020053-39", "ovs_interfaceid": "b5020053-395f-4341-99be-d522ebb938c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:19:16 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:19:16 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:19:16 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:19:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-654751200',display_name='tempest-ServerRescueNegativeTestJSON-server-654751200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-654751200',id=23,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG84x+NylQWBd2g1pTgN6nYOGcxuM7ptMYLF1iYUf4C/EmePaiAY94KGATgiwZv/MCDbgtJ1U0U0tBBU4OAE3ODDx+p2CM+mUmjEW5IGA4t+YMPmSLPcZoG14d2vm4joFQ==',key_name='tempest-keypair-200545764',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e246e1fd12054401988f9d49f6ad9373',ramdisk_id='',reservation_id='r-2f5gtrij',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1107947568',owner_user_name='tempest-ServerRescueNegativeTestJSON-1107947568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:19:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a0f35998b664c32990f079ca1cd5e6d',uuid=61beb251-4345-44e6-a176-5c14c99c9a52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5020053-395f-4341-99be-d522ebb938c7", "address": "fa:16:3e:d4:3e:f8", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5020053-39", "ovs_interfaceid": "b5020053-395f-4341-99be-d522ebb938c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Converting VIF {"id": "b5020053-395f-4341-99be-d522ebb938c7", "address": "fa:16:3e:d4:3e:f8", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5020053-39", "ovs_interfaceid": "b5020053-395f-4341-99be-d522ebb938c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:3e:f8,bridge_name='br-int',has_traffic_filtering=True,id=b5020053-395f-4341-99be-d522ebb938c7,network=Network(45ec1f7e-dbfa-4746-8d35-e32f7c938a0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5020053-39') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG nova.objects.instance [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lazy-loading 'pci_devices' on Instance uuid 61beb251-4345-44e6-a176-5c14c99c9a52 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:19:16 user nova-compute[74821]:   <uuid>61beb251-4345-44e6-a176-5c14c99c9a52</uuid>
Nov 06 13:19:16 user nova-compute[74821]:   <name>instance-00000017</name>
Nov 06 13:19:16 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:19:16 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:19:16 user nova-compute[74821]:   <metadata>
Nov 06 13:19:16 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:19:16 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:19:16 user nova-compute[74821]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-654751200</nova:name>
Nov 06 13:19:16 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:19:16</nova:creationTime>
Nov 06 13:19:16 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:19:16 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:19:16 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:19:16 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:19:16 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:19:16 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:19:16 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:19:16 user nova-compute[74821]:       <nova:owner>
Nov 06 13:19:16 user nova-compute[74821]:         <nova:user uuid="4a0f35998b664c32990f079ca1cd5e6d">tempest-ServerRescueNegativeTestJSON-1107947568-project-member</nova:user>
Nov 06 13:19:16 user nova-compute[74821]:         <nova:project uuid="e246e1fd12054401988f9d49f6ad9373">tempest-ServerRescueNegativeTestJSON-1107947568</nova:project>
Nov 06 13:19:16 user nova-compute[74821]:       </nova:owner>
Nov 06 13:19:16 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:19:16 user nova-compute[74821]:       <nova:ports>
Nov 06 13:19:16 user nova-compute[74821]:         <nova:port uuid="b5020053-395f-4341-99be-d522ebb938c7">
Nov 06 13:19:16 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 06 13:19:16 user nova-compute[74821]:         </nova:port>
Nov 06 13:19:16 user nova-compute[74821]:       </nova:ports>
Nov 06 13:19:16 user nova-compute[74821]:     </nova:instance>
Nov 06 13:19:16 user nova-compute[74821]:   </metadata>
Nov 06 13:19:16 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:19:16 user nova-compute[74821]:     <system>
Nov 06 13:19:16 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:19:16 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:19:16 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:19:16 user nova-compute[74821]:       <entry name="serial">61beb251-4345-44e6-a176-5c14c99c9a52</entry>
Nov 06 13:19:16 user nova-compute[74821]:       <entry name="uuid">61beb251-4345-44e6-a176-5c14c99c9a52</entry>
Nov 06 13:19:16 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:19:16 user nova-compute[74821]:     </system>
Nov 06 13:19:16 user nova-compute[74821]:   </sysinfo>
Nov 06 13:19:16 user nova-compute[74821]:   <os>
Nov 06 13:19:16 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:19:16 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:19:16 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:19:16 user nova-compute[74821]:   </os>
Nov 06 13:19:16 user nova-compute[74821]:   <features>
Nov 06 13:19:16 user nova-compute[74821]:     <acpi/>
Nov 06 13:19:16 user nova-compute[74821]:     <apic/>
Nov 06 13:19:16 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:19:16 user nova-compute[74821]:   </features>
Nov 06 13:19:16 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:19:16 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:19:16 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:19:16 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:19:16 user nova-compute[74821]:   </clock>
Nov 06 13:19:16 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:19:16 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:19:16 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:19:16 user nova-compute[74821]:   </cpu>
Nov 06 13:19:16 user nova-compute[74821]:   <devices>
Nov 06 13:19:16 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:19:16 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:19:16 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk"/>
Nov 06 13:19:16 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:19:16 user nova-compute[74821]:     </disk>
Nov 06 13:19:16 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:19:16 user nova-compute[74821]:       <mac address="fa:16:3e:d4:3e:f8"/>
Nov 06 13:19:16 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:19:16 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:19:16 user nova-compute[74821]:       <target dev="tapb5020053-39"/>
Nov 06 13:19:16 user nova-compute[74821]:     </interface>
Nov 06 13:19:16 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:19:16 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/console.log" append="off"/>
Nov 06 13:19:16 user nova-compute[74821]:     </serial>
Nov 06 13:19:16 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:19:16 user nova-compute[74821]:     <video>
Nov 06 13:19:16 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:19:16 user nova-compute[74821]:     </video>
Nov 06 13:19:16 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:19:16 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:19:16 user nova-compute[74821]:     </rng>
Nov 06 13:19:16 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:19:16 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:19:16 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:19:16 user nova-compute[74821]:     </memballoon>
Nov 06 13:19:16 user nova-compute[74821]:   </devices>
Nov 06 13:19:16 user nova-compute[74821]: </domain>
Nov 06 13:19:16 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:19:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-654751200',display_name='tempest-ServerRescueNegativeTestJSON-server-654751200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-654751200',id=23,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG84x+NylQWBd2g1pTgN6nYOGcxuM7ptMYLF1iYUf4C/EmePaiAY94KGATgiwZv/MCDbgtJ1U0U0tBBU4OAE3ODDx+p2CM+mUmjEW5IGA4t+YMPmSLPcZoG14d2vm4joFQ==',key_name='tempest-keypair-200545764',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e246e1fd12054401988f9d49f6ad9373',ramdisk_id='',reservation_id='r-2f5gtrij',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1107947568',owner_user_name='tempest-ServerRescueNegativeTestJSON-1107947568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:19:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a0f35998b664c32990f079ca1cd5e6d',uuid=61beb251-4345-44e6-a176-5c14c99c9a52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5020053-395f-4341-99be-d522ebb938c7", "address": "fa:16:3e:d4:3e:f8", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5020053-39", "ovs_interfaceid": "b5020053-395f-4341-99be-d522ebb938c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Converting VIF {"id": "b5020053-395f-4341-99be-d522ebb938c7", "address": "fa:16:3e:d4:3e:f8", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5020053-39", "ovs_interfaceid": "b5020053-395f-4341-99be-d522ebb938c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:3e:f8,bridge_name='br-int',has_traffic_filtering=True,id=b5020053-395f-4341-99be-d522ebb938c7,network=Network(45ec1f7e-dbfa-4746-8d35-e32f7c938a0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5020053-39') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG os_vif [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:3e:f8,bridge_name='br-int',has_traffic_filtering=True,id=b5020053-395f-4341-99be-d522ebb938c7,network=Network(45ec1f7e-dbfa-4746-8d35-e32f7c938a0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5020053-39') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e6125d4c-b1ba-5b0f-94a4-1da7b23ad090', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5020053-39, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb5020053-39, col_values=(('qos', UUID('44d8bbd1-37bb-4871-94e9-a40f32421966')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb5020053-39, col_values=(('external_ids', {'iface-id': 'b5020053-395f-4341-99be-d522ebb938c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:3e:f8', 'vm-uuid': '61beb251-4345-44e6-a176-5c14c99c9a52'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:19:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:16 user nova-compute[74821]: INFO os_vif [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:3e:f8,bridge_name='br-int',has_traffic_filtering=True,id=b5020053-395f-4341-99be-d522ebb938c7,network=Network(45ec1f7e-dbfa-4746-8d35-e32f7c938a0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5020053-39')
Nov 06 13:19:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:19:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] No VIF found with MAC fa:16:3e:d4:3e:f8, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:19:17 user nova-compute[74821]: DEBUG nova.network.neutron [req-78903a34-0553-4a09-888b-9e274876a207 req-66bef397-7503-4e4c-bb8e-4acc32750474 service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Updated VIF entry in instance network info cache for port b5020053-395f-4341-99be-d522ebb938c7. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:19:17 user nova-compute[74821]: DEBUG nova.network.neutron [req-78903a34-0553-4a09-888b-9e274876a207 req-66bef397-7503-4e4c-bb8e-4acc32750474 service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Updating instance_info_cache with network_info: [{"id": "b5020053-395f-4341-99be-d522ebb938c7", "address": "fa:16:3e:d4:3e:f8", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5020053-39", "ovs_interfaceid": "b5020053-395f-4341-99be-d522ebb938c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:19:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-78903a34-0553-4a09-888b-9e274876a207 req-66bef397-7503-4e4c-bb8e-4acc32750474 service nova] Releasing lock "refresh_cache-61beb251-4345-44e6-a176-5c14c99c9a52" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:19:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:18 user nova-compute[74821]: DEBUG nova.compute.manager [req-b555fb7c-0acf-4e11-a96b-a37e9f700855 req-7095fb2c-f797-40d3-92e7-986758041a86 service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received event network-vif-plugged-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:19:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b555fb7c-0acf-4e11-a96b-a37e9f700855 req-7095fb2c-f797-40d3-92e7-986758041a86 service nova] Acquiring lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:19:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b555fb7c-0acf-4e11-a96b-a37e9f700855 req-7095fb2c-f797-40d3-92e7-986758041a86 service nova] Lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:19:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b555fb7c-0acf-4e11-a96b-a37e9f700855 req-7095fb2c-f797-40d3-92e7-986758041a86 service nova] Lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:19:18 user nova-compute[74821]: DEBUG nova.compute.manager [req-b555fb7c-0acf-4e11-a96b-a37e9f700855 req-7095fb2c-f797-40d3-92e7-986758041a86 service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] No waiting events found dispatching network-vif-plugged-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:19:18 user nova-compute[74821]: WARNING nova.compute.manager [req-b555fb7c-0acf-4e11-a96b-a37e9f700855 req-7095fb2c-f797-40d3-92e7-986758041a86 service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received unexpected event network-vif-plugged-b5020053-395f-4341-99be-d522ebb938c7 for instance with vm_state building and task_state spawning.
Nov 06 13:19:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:20 user nova-compute[74821]: DEBUG nova.compute.manager [req-01a20751-c2dd-473f-ba22-9c8b15b79035 req-c17a5166-504f-4fae-9efd-e966336f8b9f service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received event network-vif-plugged-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:19:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-01a20751-c2dd-473f-ba22-9c8b15b79035 req-c17a5166-504f-4fae-9efd-e966336f8b9f service nova] Acquiring lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:19:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-01a20751-c2dd-473f-ba22-9c8b15b79035 req-c17a5166-504f-4fae-9efd-e966336f8b9f service nova] Lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:19:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-01a20751-c2dd-473f-ba22-9c8b15b79035 req-c17a5166-504f-4fae-9efd-e966336f8b9f service nova] Lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:19:20 user nova-compute[74821]: DEBUG nova.compute.manager [req-01a20751-c2dd-473f-ba22-9c8b15b79035 req-c17a5166-504f-4fae-9efd-e966336f8b9f service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] No waiting events found dispatching network-vif-plugged-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:19:20 user nova-compute[74821]: WARNING nova.compute.manager [req-01a20751-c2dd-473f-ba22-9c8b15b79035 req-c17a5166-504f-4fae-9efd-e966336f8b9f service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received unexpected event network-vif-plugged-b5020053-395f-4341-99be-d522ebb938c7 for instance with vm_state building and task_state spawning.
Nov 06 13:19:21 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:22 user nova-compute[74821]: DEBUG nova.compute.manager [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:19:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:19:22 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Instance spawned successfully.
Nov 06 13:19:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:19:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:19:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:19:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:19:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:19:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:19:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:19:22 user nova-compute[74821]: INFO nova.compute.manager [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Took 7.91 seconds to spawn the instance on the hypervisor.
Nov 06 13:19:22 user nova-compute[74821]: DEBUG nova.compute.manager [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:19:22 user nova-compute[74821]: INFO nova.compute.manager [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Took 9.29 seconds to build instance.
Nov 06 13:19:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e50bec05-3cdf-4c8c-9adc-4e586d4011a8 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "61beb251-4345-44e6-a176-5c14c99c9a52" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.433s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:19:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:24 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:19:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:27 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:19:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:29 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:19:30 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:19:30 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:19:31 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bd32c388-aa78-43ef-ae93-8230b8eba8af is timed out.
Nov 06 13:19:31 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Successfully detached device vdb from instance bd32c388-aa78-43ef-ae93-8230b8eba8af from the live domain config.
Nov 06 13:19:31 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iVEeNxzj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:19:31 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:19:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a178321f-481e-429e-83cc-295d10239869]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:19:31 user nova-compute[74821]: No targets found.
Nov 06 13:19:31 user nova-compute[74821]: iSNS:
Nov 06 13:19:31 user nova-compute[74821]: No targets found.
Nov 06 13:19:31 user nova-compute[74821]: STATIC:
Nov 06 13:19:31 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db
Nov 06 13:19:31 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:19:31 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:19:31 user nova-compute[74821]: FIRMWARE:
Nov 06 13:19:31 user nova-compute[74821]: No targets found.
Nov 06 13:19:31 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:19:31 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:19:31 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6112dc4-5fa2-4d99-a2a8-3c9d3c4a3364]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6a37df-8201-4d3e-8779-b422e09ffd5a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db (non-flash)
Nov 06 13:19:31 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db (non-flash)
Nov 06 13:19:31 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e404db910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db'): ({'sdb'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Removing single pathed devices sdb {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdb49f7-873e-4d71-8b2e-2c34f7b02854]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca629932-c9f2-4833-b234-c33e57245814]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Flushing IO for device /dev/sdb {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bde843-41d6-49dc-aec4-30eaa3696ff3]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0f1916-feae-4a09-bd12-fbb14f5e6268]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] SCSI volumes sdb have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abe3942-719c-415b-b387-72dd64104e58]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f018b1-0113-4530-8b00-7de158954272]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db, portal: 172.16.0.220,3260]
Nov 06 13:19:31 user nova-compute[74821]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db, portal: 172.16.0.220,3260] successful.
Nov 06 13:19:31 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f21a78c-e7f7-47c5-9373-c9ed385383db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[700a6682-76ea-4707-8f46-6a3daed8f1df]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] <== disconnect_volume: return (312ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Rebuilding the list of instances to heal {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 13:19:31 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-3e21d005-f190-478a-a911-e483e1235057" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:19:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-3e21d005-f190-478a-a911-e483e1235057" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:19:32 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 3e21d005-f190-478a-a911-e483e1235057] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:19:32 user nova-compute[74821]: DEBUG nova.objects.instance [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lazy-loading 'info_cache' on Instance uuid 3e21d005-f190-478a-a911-e483e1235057 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:19:32 user nova-compute[74821]: DEBUG nova.compute.manager [req-e1d076d5-a1f2-4e2f-9ca6-d542949412e8 req-748917ec-1225-4ca7-b6bf-9854339b98f3 service nova] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Received event network-changed-3ce43b79-45cd-4110-9508-0278e47d5bc8 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:19:32 user nova-compute[74821]: DEBUG nova.compute.manager [req-e1d076d5-a1f2-4e2f-9ca6-d542949412e8 req-748917ec-1225-4ca7-b6bf-9854339b98f3 service nova] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Refreshing instance network info cache due to event network-changed-3ce43b79-45cd-4110-9508-0278e47d5bc8. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:19:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e1d076d5-a1f2-4e2f-9ca6-d542949412e8 req-748917ec-1225-4ca7-b6bf-9854339b98f3 service nova] Acquiring lock "refresh_cache-107abf1d-96da-4406-8111-ef0bc09fb3e3" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:19:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e1d076d5-a1f2-4e2f-9ca6-d542949412e8 req-748917ec-1225-4ca7-b6bf-9854339b98f3 service nova] Acquired lock "refresh_cache-107abf1d-96da-4406-8111-ef0bc09fb3e3" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:19:32 user nova-compute[74821]: DEBUG nova.network.neutron [req-e1d076d5-a1f2-4e2f-9ca6-d542949412e8 req-748917ec-1225-4ca7-b6bf-9854339b98f3 service nova] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Refreshing network info cache for port 3ce43b79-45cd-4110-9508-0278e47d5bc8 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:19:32 user nova-compute[74821]: DEBUG nova.objects.instance [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lazy-loading 'flavor' on Instance uuid bd32c388-aa78-43ef-ae93-8230b8eba8af {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:19:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1acfa660-d1ce-4b3f-8ca3-696b9c46cc0d tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lock "bd32c388-aa78-43ef-ae93-8230b8eba8af" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.311s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:19:33 user nova-compute[74821]: DEBUG nova.network.neutron [req-e1d076d5-a1f2-4e2f-9ca6-d542949412e8 req-748917ec-1225-4ca7-b6bf-9854339b98f3 service nova] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Updated VIF entry in instance network info cache for port 3ce43b79-45cd-4110-9508-0278e47d5bc8. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:19:33 user nova-compute[74821]: DEBUG nova.network.neutron [req-e1d076d5-a1f2-4e2f-9ca6-d542949412e8 req-748917ec-1225-4ca7-b6bf-9854339b98f3 service nova] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Updating instance_info_cache with network_info: [{"id": "3ce43b79-45cd-4110-9508-0278e47d5bc8", "address": "fa:16:3e:37:94:57", "network": {"id": "221da9ed-3df1-4f6c-91b0-ec4117f186f9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-999229259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc877e77ae92437f8ae2f5e4d9b65947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce43b79-45", "ovs_interfaceid": "3ce43b79-45cd-4110-9508-0278e47d5bc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:19:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e1d076d5-a1f2-4e2f-9ca6-d542949412e8 req-748917ec-1225-4ca7-b6bf-9854339b98f3 service nova] Releasing lock "refresh_cache-107abf1d-96da-4406-8111-ef0bc09fb3e3" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:19:33 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 3e21d005-f190-478a-a911-e483e1235057] Updating instance_info_cache with network_info: [{"id": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "address": "fa:16:3e:e0:fc:40", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6fb684-24", "ovs_interfaceid": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:19:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-3e21d005-f190-478a-a911-e483e1235057" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:19:33 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 3e21d005-f190-478a-a911-e483e1235057] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:19:33 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:19:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b12363c1-637c-41cd-9905-5a176906dfce tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Acquiring lock "interface-bd32c388-aa78-43ef-ae93-8230b8eba8af-0cf4a358-eb19-49f2-9ce1-9e4ee135805c" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:19:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b12363c1-637c-41cd-9905-5a176906dfce tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lock "interface-bd32c388-aa78-43ef-ae93-8230b8eba8af-0cf4a358-eb19-49f2-9ce1-9e4ee135805c" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:19:33 user nova-compute[74821]: DEBUG nova.objects.instance [None req-b12363c1-637c-41cd-9905-5a176906dfce tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lazy-loading 'flavor' on Instance uuid bd32c388-aa78-43ef-ae93-8230b8eba8af {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:19:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-b12363c1-637c-41cd-9905-5a176906dfce tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:16:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-63051430',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-63051430',id=17,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTKqcTwYkCQENDzProvGIMFtMqaS+G/n1Hbl3a5LzTI2xbz3a2W94HTVkp4RevkFUNv1QjLjHpnVGJBeVEJild17QwHehxxe7AL3LQT4P27u7Ru79l65cMDiX2/YAksMA==',key_name='tempest-keypair-1412532163',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:16:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4287a7d278844ade94c8b38f8f76087e',ramdisk_id='',reservation_id='r-fuumtn90',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1737511361',owner_user_name='tempest-TaggedAttachmentsTest-1737511361-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:16:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63d66293fbbb4460a5e181687fc31fe7',uuid=bd32c388-aa78-43ef-ae93-8230b8eba8af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0cf4a358-eb19-49f2-9ce1-9e4ee135805c", "address": "fa:16:3e:fc:11:5e", "network": {"id": "cc1ad5d0-5dc6-43a6-82ac-f94263c8fb20", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1465765696", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4287a7d278844ade94c8b38f8f76087e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf4a358-eb", "ovs_interfaceid": "0cf4a358-eb19-49f2-9ce1-9e4ee135805c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:19:33 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-b12363c1-637c-41cd-9905-5a176906dfce tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Converting VIF {"id": "0cf4a358-eb19-49f2-9ce1-9e4ee135805c", "address": "fa:16:3e:fc:11:5e", "network": {"id": "cc1ad5d0-5dc6-43a6-82ac-f94263c8fb20", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1465765696", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4287a7d278844ade94c8b38f8f76087e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf4a358-eb", "ovs_interfaceid": "0cf4a358-eb19-49f2-9ce1-9e4ee135805c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:19:33 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-b12363c1-637c-41cd-9905-5a176906dfce tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:11:5e,bridge_name='br-int',has_traffic_filtering=True,id=0cf4a358-eb19-49f2-9ce1-9e4ee135805c,network=Network(cc1ad5d0-5dc6-43a6-82ac-f94263c8fb20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cf4a358-eb') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:19:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-b12363c1-637c-41cd-9905-5a176906dfce tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fc:11:5e"/><model type="virtio"/><mtu size="1442"/><target dev="tap0cf4a358-eb"/></interface> {{(pid=74821) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 06 13:19:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-b12363c1-637c-41cd-9905-5a176906dfce tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fc:11:5e"/><model type="virtio"/><mtu size="1442"/><target dev="tap0cf4a358-eb"/></interface> {{(pid=74821) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 06 13:19:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b12363c1-637c-41cd-9905-5a176906dfce tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Attempting to detach device tap0cf4a358-eb from instance bd32c388-aa78-43ef-ae93-8230b8eba8af from the persistent domain config. {{(pid=74821) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 13:19:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-b12363c1-637c-41cd-9905-5a176906dfce tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] detach device xml: <interface type="ethernet">
Nov 06 13:19:33 user nova-compute[74821]:   <mac address="fa:16:3e:fc:11:5e"/>
Nov 06 13:19:33 user nova-compute[74821]:   <model type="virtio"/>
Nov 06 13:19:33 user nova-compute[74821]:   <mtu size="1442"/>
Nov 06 13:19:33 user nova-compute[74821]:   <target dev="tap0cf4a358-eb"/>
Nov 06 13:19:33 user nova-compute[74821]: </interface>
Nov 06 13:19:33 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:19:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-b12363c1-637c-41cd-9905-5a176906dfce tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fc:11:5e"/><model type="virtio"/><mtu size="1442"/><target dev="tap0cf4a358-eb"/></interface> {{(pid=74821) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 06 13:19:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-b12363c1-637c-41cd-9905-5a176906dfce tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:fc:11:5e"/><model type="virtio"/><mtu size="1442"/><target dev="tap0cf4a358-eb"/></interface>not found in domain: <domain type='kvm' id='19'>
Nov 06 13:19:33 user nova-compute[74821]:   <name>instance-00000011</name>
Nov 06 13:19:33 user nova-compute[74821]:   <uuid>bd32c388-aa78-43ef-ae93-8230b8eba8af</uuid>
Nov 06 13:19:33 user nova-compute[74821]:   <metadata>
Nov 06 13:19:33 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:19:33 user nova-compute[74821]:   <nova:package version="0.0.0"/>
Nov 06 13:19:33 user nova-compute[74821]:   <nova:name>tempest-device-tagging-server-63051430</nova:name>
Nov 06 13:19:33 user nova-compute[74821]:   <nova:creationTime>2023-11-06 13:18:39</nova:creationTime>
Nov 06 13:19:33 user nova-compute[74821]:   <nova:flavor name="m1.tiny">
Nov 06 13:19:33 user nova-compute[74821]:     <nova:memory>512</nova:memory>
Nov 06 13:19:33 user nova-compute[74821]:     <nova:disk>1</nova:disk>
Nov 06 13:19:33 user nova-compute[74821]:     <nova:swap>0</nova:swap>
Nov 06 13:19:33 user nova-compute[74821]:     <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:19:33 user nova-compute[74821]:     <nova:vcpus>1</nova:vcpus>
Nov 06 13:19:33 user nova-compute[74821]:   </nova:flavor>
Nov 06 13:19:33 user nova-compute[74821]:   <nova:owner>
Nov 06 13:19:33 user nova-compute[74821]:     <nova:user uuid="63d66293fbbb4460a5e181687fc31fe7">tempest-TaggedAttachmentsTest-1737511361-project-member</nova:user>
Nov 06 13:19:33 user nova-compute[74821]:     <nova:project uuid="4287a7d278844ade94c8b38f8f76087e">tempest-TaggedAttachmentsTest-1737511361</nova:project>
Nov 06 13:19:33 user nova-compute[74821]:   </nova:owner>
Nov 06 13:19:33 user nova-compute[74821]:   <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:19:33 user nova-compute[74821]:   <nova:ports>
Nov 06 13:19:33 user nova-compute[74821]:     <nova:port uuid="054bfb88-19a2-4241-ae8d-0eded559c233">
Nov 06 13:19:33 user nova-compute[74821]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 13:19:33 user nova-compute[74821]:     </nova:port>
Nov 06 13:19:33 user nova-compute[74821]:     <nova:port uuid="0cf4a358-eb19-49f2-9ce1-9e4ee135805c">
Nov 06 13:19:33 user nova-compute[74821]:       <nova:ip type="fixed" address="10.10.10.187" ipVersion="4"/>
Nov 06 13:19:33 user nova-compute[74821]:     </nova:port>
Nov 06 13:19:33 user nova-compute[74821]:   </nova:ports>
Nov 06 13:19:33 user nova-compute[74821]: </nova:instance>
Nov 06 13:19:33 user nova-compute[74821]:   </metadata>
Nov 06 13:19:33 user nova-compute[74821]:   <memory unit='KiB'>524288</memory>
Nov 06 13:19:33 user nova-compute[74821]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 06 13:19:33 user nova-compute[74821]:   <vcpu placement='static'>1</vcpu>
Nov 06 13:19:33 user nova-compute[74821]:   <resource>
Nov 06 13:19:33 user nova-compute[74821]:     <partition>/machine</partition>
Nov 06 13:19:33 user nova-compute[74821]:   </resource>
Nov 06 13:19:33 user nova-compute[74821]:   <sysinfo type='smbios'>
Nov 06 13:19:33 user nova-compute[74821]:     <system>
Nov 06 13:19:33 user nova-compute[74821]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 06 13:19:33 user nova-compute[74821]:       <entry name='product'>OpenStack Nova</entry>
Nov 06 13:19:33 user nova-compute[74821]:       <entry name='version'>0.0.0</entry>
Nov 06 13:19:33 user nova-compute[74821]:       <entry name='serial'>bd32c388-aa78-43ef-ae93-8230b8eba8af</entry>
Nov 06 13:19:33 user nova-compute[74821]:       <entry name='uuid'>bd32c388-aa78-43ef-ae93-8230b8eba8af</entry>
Nov 06 13:19:33 user nova-compute[74821]:       <entry name='family'>Virtual Machine</entry>
Nov 06 13:19:33 user nova-compute[74821]:     </system>
Nov 06 13:19:33 user nova-compute[74821]:   </sysinfo>
Nov 06 13:19:33 user nova-compute[74821]:   <os>
Nov 06 13:19:33 user nova-compute[74821]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 06 13:19:33 user nova-compute[74821]:     <boot dev='hd'/>
Nov 06 13:19:33 user nova-compute[74821]:     <smbios mode='sysinfo'/>
Nov 06 13:19:33 user nova-compute[74821]:   </os>
Nov 06 13:19:33 user nova-compute[74821]:   <features>
Nov 06 13:19:33 user nova-compute[74821]:     <acpi/>
Nov 06 13:19:33 user nova-compute[74821]:     <apic/>
Nov 06 13:19:33 user nova-compute[74821]:     <vmcoreinfo state='on'/>
Nov 06 13:19:33 user nova-compute[74821]:   </features>
Nov 06 13:19:33 user nova-compute[74821]:   <cpu mode='custom' match='exact' check='full'>
Nov 06 13:19:33 user nova-compute[74821]:     <model fallback='forbid'>Nehalem</model>
Nov 06 13:19:33 user nova-compute[74821]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 06 13:19:33 user nova-compute[74821]:     <feature policy='require' name='vme'/>
Nov 06 13:19:33 user nova-compute[74821]:     <feature policy='require' name='x2apic'/>
Nov 06 13:19:33 user nova-compute[74821]:     <feature policy='require' name='hypervisor'/>
Nov 06 13:19:33 user nova-compute[74821]:   </cpu>
Nov 06 13:19:33 user nova-compute[74821]:   <clock offset='utc'>
Nov 06 13:19:33 user nova-compute[74821]:     <timer name='pit' tickpolicy='delay'/>
Nov 06 13:19:33 user nova-compute[74821]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 06 13:19:33 user nova-compute[74821]:     <timer name='hpet' present='no'/>
Nov 06 13:19:33 user nova-compute[74821]:   </clock>
Nov 06 13:19:33 user nova-compute[74821]:   <on_poweroff>destroy</on_poweroff>
Nov 06 13:19:33 user nova-compute[74821]:   <on_reboot>restart</on_reboot>
Nov 06 13:19:33 user nova-compute[74821]:   <on_crash>destroy</on_crash>
Nov 06 13:19:33 user nova-compute[74821]:   <devices>
Nov 06 13:19:33 user nova-compute[74821]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 06 13:19:33 user nova-compute[74821]:     <disk type='file' device='disk'>
Nov 06 13:19:33 user nova-compute[74821]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 06 13:19:33 user nova-compute[74821]:       <source file='/opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/disk' index='2'/>
Nov 06 13:19:33 user nova-compute[74821]:       <backingStore type='file' index='3'>
Nov 06 13:19:33 user nova-compute[74821]:         <format type='raw'/>
Nov 06 13:19:33 user nova-compute[74821]:         <source file='/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374'/>
Nov 06 13:19:33 user nova-compute[74821]:         <backingStore/>
Nov 06 13:19:33 user nova-compute[74821]:       </backingStore>
Nov 06 13:19:33 user nova-compute[74821]:       <target dev='vda' bus='virtio'/>
Nov 06 13:19:33 user nova-compute[74821]:       <alias name='virtio-disk0'/>
Nov 06 13:19:33 user nova-compute[74821]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 06 13:19:33 user nova-compute[74821]:     </disk>
Nov 06 13:19:33 user nova-compute[74821]:     <disk type='file' device='cdrom'>
Nov 06 13:19:33 user nova-compute[74821]:       <driver name='qemu' type='raw' cache='none'/>
Nov 06 13:19:33 user nova-compute[74821]:       <source file='/opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/disk.config' index='1'/>
Nov 06 13:19:33 user nova-compute[74821]:       <backingStore/>
Nov 06 13:19:33 user nova-compute[74821]:       <target dev='hda' bus='ide'/>
Nov 06 13:19:33 user nova-compute[74821]:       <readonly/>
Nov 06 13:19:33 user nova-compute[74821]:       <alias name='ide0-0-0'/>
Nov 06 13:19:33 user nova-compute[74821]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 06 13:19:33 user nova-compute[74821]:     </disk>
Nov 06 13:19:33 user nova-compute[74821]:     <controller type='usb' index='0' model='none'>
Nov 06 13:19:33 user nova-compute[74821]:       <alias name='usb'/>
Nov 06 13:19:33 user nova-compute[74821]:     </controller>
Nov 06 13:19:33 user nova-compute[74821]:     <controller type='pci' index='0' model='pci-root'>
Nov 06 13:19:33 user nova-compute[74821]:       <alias name='pci.0'/>
Nov 06 13:19:33 user nova-compute[74821]:     </controller>
Nov 06 13:19:33 user nova-compute[74821]:     <controller type='ide' index='0'>
Nov 06 13:19:33 user nova-compute[74821]:       <alias name='ide'/>
Nov 06 13:19:33 user nova-compute[74821]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 06 13:19:33 user nova-compute[74821]:     </controller>
Nov 06 13:19:33 user nova-compute[74821]:     <interface type='ethernet'>
Nov 06 13:19:33 user nova-compute[74821]:       <mac address='fa:16:3e:7e:2a:2d'/>
Nov 06 13:19:33 user nova-compute[74821]:       <target dev='tap054bfb88-19'/>
Nov 06 13:19:33 user nova-compute[74821]:       <model type='virtio'/>
Nov 06 13:19:33 user nova-compute[74821]:       <mtu size='1442'/>
Nov 06 13:19:33 user nova-compute[74821]:       <alias name='net0'/>
Nov 06 13:19:33 user nova-compute[74821]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 06 13:19:33 user nova-compute[74821]:     </interface>
Nov 06 13:19:33 user nova-compute[74821]:     <interface type='ethernet'>
Nov 06 13:19:33 user nova-compute[74821]:       <mac address='fa:16:3e:fc:11:5e'/>
Nov 06 13:19:33 user nova-compute[74821]:       <target dev='tap0cf4a358-eb'/>
Nov 06 13:19:33 user nova-compute[74821]:       <model type='virtio'/>
Nov 06 13:19:33 user nova-compute[74821]:       <mtu size='1442'/>
Nov 06 13:19:33 user nova-compute[74821]:       <alias name='net1'/>
Nov 06 13:19:33 user nova-compute[74821]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 06 13:19:33 user nova-compute[74821]:     </interface>
Nov 06 13:19:33 user nova-compute[74821]:     <serial type='pty'>
Nov 06 13:19:33 user nova-compute[74821]:       <source path='/dev/pts/7'/>
Nov 06 13:19:33 user nova-compute[74821]:       <log file='/opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/console.log' append='off'/>
Nov 06 13:19:33 user nova-compute[74821]:       <target type='isa-serial' port='0'>
Nov 06 13:19:33 user nova-compute[74821]:         <model name='isa-serial'/>
Nov 06 13:19:33 user nova-compute[74821]:       </target>
Nov 06 13:19:33 user nova-compute[74821]:       <alias name='serial0'/>
Nov 06 13:19:33 user nova-compute[74821]:     </serial>
Nov 06 13:19:33 user nova-compute[74821]:     <console type='pty' tty='/dev/pts/7'>
Nov 06 13:19:33 user nova-compute[74821]:       <source path='/dev/pts/7'/>
Nov 06 13:19:33 user nova-compute[74821]:       <log file='/opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/console.log' append='off'/>
Nov 06 13:19:33 user nova-compute[74821]:       <target type='serial' port='0'/>
Nov 06 13:19:33 user nova-compute[74821]:       <alias name='serial0'/>
Nov 06 13:19:33 user nova-compute[74821]:     </console>
Nov 06 13:19:33 user nova-compute[74821]:     <input type='mouse' bus='ps2'>
Nov 06 13:19:33 user nova-compute[74821]:       <alias name='input0'/>
Nov 06 13:19:33 user nova-compute[74821]:     </input>
Nov 06 13:19:33 user nova-compute[74821]:     <input type='keyboard' bus='ps2'>
Nov 06 13:19:33 user nova-compute[74821]:       <alias name='input1'/>
Nov 06 13:19:33 user nova-compute[74821]:     </input>
Nov 06 13:19:33 user nova-compute[74821]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 06 13:19:33 user nova-compute[74821]:       <listen type='address' address='0.0.0.0'/>
Nov 06 13:19:33 user nova-compute[74821]:     </graphics>
Nov 06 13:19:33 user nova-compute[74821]:     <audio id='1' type='none'/>
Nov 06 13:19:33 user nova-compute[74821]:     <video>
Nov 06 13:19:33 user nova-compute[74821]:       <model type='virtio' heads='1' primary='yes'/>
Nov 06 13:19:33 user nova-compute[74821]:       <alias name='video0'/>
Nov 06 13:19:33 user nova-compute[74821]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 06 13:19:33 user nova-compute[74821]:     </video>
Nov 06 13:19:33 user nova-compute[74821]:     <memballoon model='virtio'>
Nov 06 13:19:33 user nova-compute[74821]:       <stats period='10'/>
Nov 06 13:19:33 user nova-compute[74821]:       <alias name='balloon0'/>
Nov 06 13:19:33 user nova-compute[74821]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 06 13:19:33 user nova-compute[74821]:     </memballoon>
Nov 06 13:19:33 user nova-compute[74821]:     <rng model='virtio'>
Nov 06 13:19:33 user nova-compute[74821]:       <backend model='random'>/dev/urandom</backend>
Nov 06 13:19:33 user nova-compute[74821]:       <alias name='rng0'/>
Nov 06 13:19:33 user nova-compute[74821]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 06 13:19:33 user nova-compute[74821]:     </rng>
Nov 06 13:19:33 user nova-compute[74821]:   </devices>
Nov 06 13:19:33 user nova-compute[74821]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 06 13:19:33 user nova-compute[74821]:     <label>libvirt-bd32c388-aa78-43ef-ae93-8230b8eba8af</label>
Nov 06 13:19:33 user nova-compute[74821]:     <imagelabel>libvirt-bd32c388-aa78-43ef-ae93-8230b8eba8af</imagelabel>
Nov 06 13:19:33 user nova-compute[74821]:   </seclabel>
Nov 06 13:19:33 user nova-compute[74821]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 06 13:19:33 user nova-compute[74821]:     <label>+64055:+108</label>
Nov 06 13:19:33 user nova-compute[74821]:     <imagelabel>+64055:+108</imagelabel>
Nov 06 13:19:33 user nova-compute[74821]:   </seclabel>
Nov 06 13:19:33 user nova-compute[74821]: </domain>
Nov 06 13:19:33 user nova-compute[74821]:  {{(pid=74821) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 06 13:19:33 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-b12363c1-637c-41cd-9905-5a176906dfce tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Successfully detached device tap0cf4a358-eb from instance bd32c388-aa78-43ef-ae93-8230b8eba8af from the persistent domain config.
Nov 06 13:19:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b12363c1-637c-41cd-9905-5a176906dfce tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] (1/8): Attempting to detach device tap0cf4a358-eb with device alias net1 from instance bd32c388-aa78-43ef-ae93-8230b8eba8af from the live domain config. {{(pid=74821) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 13:19:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-b12363c1-637c-41cd-9905-5a176906dfce tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] detach device xml: <interface type="ethernet">
Nov 06 13:19:33 user nova-compute[74821]:   <mac address="fa:16:3e:fc:11:5e"/>
Nov 06 13:19:33 user nova-compute[74821]:   <model type="virtio"/>
Nov 06 13:19:33 user nova-compute[74821]:   <mtu size="1442"/>
Nov 06 13:19:33 user nova-compute[74821]:   <target dev="tap0cf4a358-eb"/>
Nov 06 13:19:33 user nova-compute[74821]: </interface>
Nov 06 13:19:33 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:19:33 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:19:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:19:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:19:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:19:34 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:19:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b12363c1-637c-41cd-9905-5a176906dfce tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Start waiting for the detach event from libvirt for device tap0cf4a358-eb with device alias net1 for instance bd32c388-aa78-43ef-ae93-8230b8eba8af {{(pid=74821) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 13:19:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:34 user nova-compute[74821]: DEBUG nova.compute.manager [req-fd1be69f-0409-4c2c-87cb-83d8a6b87dcf req-856fda98-b4e9-44ac-8c36-bed4f175b3bc service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Received event network-vif-unplugged-0cf4a358-eb19-49f2-9ce1-9e4ee135805c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:19:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fd1be69f-0409-4c2c-87cb-83d8a6b87dcf req-856fda98-b4e9-44ac-8c36-bed4f175b3bc service nova] Acquiring lock "bd32c388-aa78-43ef-ae93-8230b8eba8af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:19:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fd1be69f-0409-4c2c-87cb-83d8a6b87dcf req-856fda98-b4e9-44ac-8c36-bed4f175b3bc service nova] Lock "bd32c388-aa78-43ef-ae93-8230b8eba8af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:19:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fd1be69f-0409-4c2c-87cb-83d8a6b87dcf req-856fda98-b4e9-44ac-8c36-bed4f175b3bc service nova] Lock "bd32c388-aa78-43ef-ae93-8230b8eba8af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:19:34 user nova-compute[74821]: DEBUG nova.compute.manager [req-fd1be69f-0409-4c2c-87cb-83d8a6b87dcf req-856fda98-b4e9-44ac-8c36-bed4f175b3bc service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] No waiting events found dispatching network-vif-unplugged-0cf4a358-eb19-49f2-9ce1-9e4ee135805c {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:19:34 user nova-compute[74821]: WARNING nova.compute.manager [req-fd1be69f-0409-4c2c-87cb-83d8a6b87dcf req-856fda98-b4e9-44ac-8c36-bed4f175b3bc service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Received unexpected event network-vif-unplugged-0cf4a358-eb19-49f2-9ce1-9e4ee135805c for instance with vm_state active and task_state None.
Nov 06 13:19:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:36 user nova-compute[74821]: DEBUG nova.compute.manager [req-a75a448b-4427-4775-bc7c-40748b7816fa req-f9accb11-d06c-4274-aca8-7a51ed3f03e8 service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Received event network-vif-plugged-0cf4a358-eb19-49f2-9ce1-9e4ee135805c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:19:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-a75a448b-4427-4775-bc7c-40748b7816fa req-f9accb11-d06c-4274-aca8-7a51ed3f03e8 service nova] Acquiring lock "bd32c388-aa78-43ef-ae93-8230b8eba8af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:19:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-a75a448b-4427-4775-bc7c-40748b7816fa req-f9accb11-d06c-4274-aca8-7a51ed3f03e8 service nova] Lock "bd32c388-aa78-43ef-ae93-8230b8eba8af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:19:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-a75a448b-4427-4775-bc7c-40748b7816fa req-f9accb11-d06c-4274-aca8-7a51ed3f03e8 service nova] Lock "bd32c388-aa78-43ef-ae93-8230b8eba8af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:19:36 user nova-compute[74821]: DEBUG nova.compute.manager [req-a75a448b-4427-4775-bc7c-40748b7816fa req-f9accb11-d06c-4274-aca8-7a51ed3f03e8 service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] No waiting events found dispatching network-vif-plugged-0cf4a358-eb19-49f2-9ce1-9e4ee135805c {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:19:36 user nova-compute[74821]: WARNING nova.compute.manager [req-a75a448b-4427-4775-bc7c-40748b7816fa req-f9accb11-d06c-4274-aca8-7a51ed3f03e8 service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Received unexpected event network-vif-plugged-0cf4a358-eb19-49f2-9ce1-9e4ee135805c for instance with vm_state active and task_state None.
Nov 06 13:19:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.392s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "496f8213-4b32-4211-a354-e33a4a088848" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:19:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "496f8213-4b32-4211-a354-e33a4a088848" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:19:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:38 user nova-compute[74821]: DEBUG nova.compute.manager [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:19:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:19:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:19:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:38 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:19:38 user nova-compute[74821]: INFO nova.compute.claims [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Claim successful on node user
Nov 06 13:19:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:39 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:19:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:39 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:19:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.781s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:19:39 user nova-compute[74821]: DEBUG nova.compute.manager [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:19:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:39 user nova-compute[74821]: DEBUG nova.compute.manager [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:19:39 user nova-compute[74821]: DEBUG nova.network.neutron [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:19:39 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:19:39 user nova-compute[74821]: DEBUG nova.compute.manager [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:19:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Acquiring lock "107abf1d-96da-4406-8111-ef0bc09fb3e3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:19:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "107abf1d-96da-4406-8111-ef0bc09fb3e3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:19:39 user nova-compute[74821]: DEBUG nova.policy [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '133932d1063241078d84731624e89216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745a322931e4150b12d139bfb17b94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:19:39 user nova-compute[74821]: INFO nova.virt.block_device [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Booting with blank volume at /dev/vda
Nov 06 13:19:39 user nova-compute[74821]: DEBUG nova.objects.instance [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lazy-loading 'flavor' on Instance uuid 107abf1d-96da-4406-8111-ef0bc09fb3e3 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:19:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "107abf1d-96da-4406-8111-ef0bc09fb3e3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.121s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:19:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Acquiring lock "107abf1d-96da-4406-8111-ef0bc09fb3e3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:19:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "107abf1d-96da-4406-8111-ef0bc09fb3e3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:19:40 user nova-compute[74821]: INFO nova.compute.manager [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Attaching volume 744517a5-fbdc-4bf2-bfb3-86217cb180ac to /dev/vdb
Nov 06 13:19:40 user nova-compute[74821]: DEBUG os_brick.utils [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:19:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:40 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[391532b6-af4a-49f1-bb0f-cddcd0eee6e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:19:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:40 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fcc2cc-d48a-4648-9788-9bcc61a51d3c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:19:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:40 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b03e1e8-0feb-49dd-bbfd-5cbf6ad968c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:19:40 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5f02cb-bd23-4aa2-9191-9b28603957ba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:19:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:19:40 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:19:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json" returned: 0 in 0.298s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:19:40 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:19:40 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f047a39f-f66c-4d2b-9379-813882290b98]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:19:40 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:19:40 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:19:40 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:19:40 user nova-compute[74821]: DEBUG os_brick.utils [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] <== get_connector_properties: return (194ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:19:40 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Updating existing volume attachment record: 839d7b73-dcae-433e-9126-19002ee8a43c {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:19:40 user nova-compute[74821]: DEBUG nova.compute.manager [req-0252e121-0919-4030-9c2d-41bc92006bbb req-4e8e156b-26e1-4eed-9bbb-9134488b428a service nova] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Received event network-changed-1bd8a943-f48b-4501-8f21-0f2d04e10624 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:19:40 user nova-compute[74821]: DEBUG nova.compute.manager [req-0252e121-0919-4030-9c2d-41bc92006bbb req-4e8e156b-26e1-4eed-9bbb-9134488b428a service nova] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Refreshing instance network info cache due to event network-changed-1bd8a943-f48b-4501-8f21-0f2d04e10624. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:19:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0252e121-0919-4030-9c2d-41bc92006bbb req-4e8e156b-26e1-4eed-9bbb-9134488b428a service nova] Acquiring lock "refresh_cache-cc3c1518-c493-41b0-a748-a0ed933c2b1e" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:19:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0252e121-0919-4030-9c2d-41bc92006bbb req-4e8e156b-26e1-4eed-9bbb-9134488b428a service nova] Acquired lock "refresh_cache-cc3c1518-c493-41b0-a748-a0ed933c2b1e" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:19:40 user nova-compute[74821]: DEBUG nova.network.neutron [req-0252e121-0919-4030-9c2d-41bc92006bbb req-4e8e156b-26e1-4eed-9bbb-9134488b428a service nova] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Refreshing network info cache for port 1bd8a943-f48b-4501-8f21-0f2d04e10624 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:19:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:40 user nova-compute[74821]: DEBUG nova.network.neutron [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Successfully created port: 0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:19:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:41 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:19:41 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:19:41 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=7084MB free_disk=25.372913360595703GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:19:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:19:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:19:41 user nova-compute[74821]: DEBUG nova.network.neutron [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Successfully updated port: 0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:19:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Acquiring lock "cc3c1518-c493-41b0-a748-a0ed933c2b1e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:19:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lock "cc3c1518-c493-41b0-a748-a0ed933c2b1e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:19:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "refresh_cache-496f8213-4b32-4211-a354-e33a4a088848" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:19:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquired lock "refresh_cache-496f8213-4b32-4211-a354-e33a4a088848" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:19:41 user nova-compute[74821]: DEBUG nova.network.neutron [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:19:41 user nova-compute[74821]: DEBUG nova.objects.instance [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lazy-loading 'flavor' on Instance uuid cc3c1518-c493-41b0-a748-a0ed933c2b1e {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:19:41 user nova-compute[74821]: DEBUG nova.compute.manager [req-321ad75c-6dbe-4605-9993-f67ced0c553f req-a79e240d-e6c4-4eca-befd-a152fa27024a service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Received event network-changed-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:19:41 user nova-compute[74821]: DEBUG nova.compute.manager [req-321ad75c-6dbe-4605-9993-f67ced0c553f req-a79e240d-e6c4-4eca-befd-a152fa27024a service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Refreshing instance network info cache due to event network-changed-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:19:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-321ad75c-6dbe-4605-9993-f67ced0c553f req-a79e240d-e6c4-4eca-befd-a152fa27024a service nova] Acquiring lock "refresh_cache-496f8213-4b32-4211-a354-e33a4a088848" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:19:41 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 3e21d005-f190-478a-a911-e483e1235057 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:19:41 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 311817c5-7b08-4da9-98eb-c685f37e6fd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:19:41 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance f8c537c6-fa3e-4842-9471-7258a22c01f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:19:41 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 2de346cb-9858-47b8-a86c-4fde720d6127 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:19:41 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 49c65aca-8392-46ba-8fa3-b47ff2416cb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:19:41 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance bd32c388-aa78-43ef-ae93-8230b8eba8af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:19:41 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 107abf1d-96da-4406-8111-ef0bc09fb3e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:19:41 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance cc3c1518-c493-41b0-a748-a0ed933c2b1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:19:41 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 32e28c73-9e3c-483b-807e-6b286413fe85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:19:41 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 290cd798-a041-40c0-8ef9-319d3627ff82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:19:41 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 5a07f64b-5b12-4e7d-a041-ad591141aa17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:19:41 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 61beb251-4345-44e6-a176-5c14c99c9a52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:19:41 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 496f8213-4b32-4211-a354-e33a4a088848 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:19:41 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:19:41 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:19:41 user nova-compute[74821]: DEBUG nova.network.neutron [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:19:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lock "cc3c1518-c493-41b0-a748-a0ed933c2b1e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.095s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:19:41 user nova-compute[74821]: DEBUG nova.network.neutron [req-0252e121-0919-4030-9c2d-41bc92006bbb req-4e8e156b-26e1-4eed-9bbb-9134488b428a service nova] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Updated VIF entry in instance network info cache for port 1bd8a943-f48b-4501-8f21-0f2d04e10624. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:19:41 user nova-compute[74821]: DEBUG nova.network.neutron [req-0252e121-0919-4030-9c2d-41bc92006bbb req-4e8e156b-26e1-4eed-9bbb-9134488b428a service nova] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Updating instance_info_cache with network_info: [{"id": "1bd8a943-f48b-4501-8f21-0f2d04e10624", "address": "fa:16:3e:b7:63:5d", "network": {"id": "3d0a42fb-8ba8-4d46-bbc2-7d1cde6bc297", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1825623675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733c88e2098c49969334dad925f621c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bd8a943-f4", "ovs_interfaceid": "1bd8a943-f48b-4501-8f21-0f2d04e10624", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:19:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0252e121-0919-4030-9c2d-41bc92006bbb req-4e8e156b-26e1-4eed-9bbb-9134488b428a service nova] Releasing lock "refresh_cache-cc3c1518-c493-41b0-a748-a0ed933c2b1e" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:19:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:42 user nova-compute[74821]: DEBUG nova.network.neutron [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Updating instance_info_cache with network_info: [{"id": "0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc", "address": "fa:16:3e:de:d4:5d", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dbd0a11-07", "ovs_interfaceid": "0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:19:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Releasing lock "refresh_cache-496f8213-4b32-4211-a354-e33a4a088848" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:19:42 user nova-compute[74821]: DEBUG nova.compute.manager [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Instance network_info: |[{"id": "0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc", "address": "fa:16:3e:de:d4:5d", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dbd0a11-07", "ovs_interfaceid": "0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:19:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-321ad75c-6dbe-4605-9993-f67ced0c553f req-a79e240d-e6c4-4eca-befd-a152fa27024a service nova] Acquired lock "refresh_cache-496f8213-4b32-4211-a354-e33a4a088848" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:19:42 user nova-compute[74821]: DEBUG nova.network.neutron [req-321ad75c-6dbe-4605-9993-f67ced0c553f req-a79e240d-e6c4-4eca-befd-a152fa27024a service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Refreshing network info cache for port 0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:19:42 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:19:42 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:19:42 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:19:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.717s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:19:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Acquiring lock "cc3c1518-c493-41b0-a748-a0ed933c2b1e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:19:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lock "cc3c1518-c493-41b0-a748-a0ed933c2b1e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:19:42 user nova-compute[74821]: INFO nova.compute.manager [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Attaching volume 4f5f31c1-284d-4554-ac80-322ddb4146d5 to /dev/vdb
Nov 06 13:19:42 user nova-compute[74821]: DEBUG os_brick.utils [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:19:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:42 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e83654-ef9b-43b6-83e7-7d190c7c0a7b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:19:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:42 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[011196f8-3e84-47e5-9f3b-8a74349d1bbf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:19:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:42 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4265f41-7070-4038-9ce2-cfde8572ad7a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:19:42 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[852d4c3a-e126-4788-b4b4-310de1b7d4ab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:19:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:19:42 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:19:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:19:42 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:19:42 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3849ac4-d2ba-464a-b80d-2567389794f6]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:19:42 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:19:42 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:19:42 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:19:42 user nova-compute[74821]: DEBUG os_brick.utils [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:19:42 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Updating existing volume attachment record: 06ab5839-46df-44f3-a76e-e7f58b55cc3a {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:19:42 user nova-compute[74821]: DEBUG nova.network.neutron [req-321ad75c-6dbe-4605-9993-f67ced0c553f req-a79e240d-e6c4-4eca-befd-a152fa27024a service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Updated VIF entry in instance network info cache for port 0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:19:42 user nova-compute[74821]: DEBUG nova.network.neutron [req-321ad75c-6dbe-4605-9993-f67ced0c553f req-a79e240d-e6c4-4eca-befd-a152fa27024a service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Updating instance_info_cache with network_info: [{"id": "0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc", "address": "fa:16:3e:de:d4:5d", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dbd0a11-07", "ovs_interfaceid": "0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:19:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-321ad75c-6dbe-4605-9993-f67ced0c553f req-a79e240d-e6c4-4eca-befd-a152fa27024a service nova] Releasing lock "refresh_cache-496f8213-4b32-4211-a354-e33a4a088848" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:19:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:43 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:19:43 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:19:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:46 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:46 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:48 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:51 user nova-compute[74821]: DEBUG os_brick.utils [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:19:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b13303-bf0f-4f08-94fa-2ca528737ca6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:19:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3deaf487-1b37-4f8a-8576-3d959aa15cc5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:19:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:19:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95bb286-56ec-49db-a0d3-d153c04ff46c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:19:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77d7932-393e-4fa6-90e1-e231348a13ef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:19:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:19:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:19:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:19:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:19:51 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:19:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1929243-10fa-4281-9b54-464a325c2c3d]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:19:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:19:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:19:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:19:51 user nova-compute[74821]: DEBUG os_brick.utils [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:19:51 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Updating existing volume attachment record: 198cb9d2-0a76-4638-a87f-752ba260b760 {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:19:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:54 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-b12363c1-637c-41cd-9905-5a176906dfce tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Waiting for libvirt event about the detach of device tap0cf4a358-eb with device alias net1 from instance bd32c388-aa78-43ef-ae93-8230b8eba8af is timed out.
Nov 06 13:19:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-b12363c1-637c-41cd-9905-5a176906dfce tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fc:11:5e"/><model type="virtio"/><mtu size="1442"/><target dev="tap0cf4a358-eb"/></interface> {{(pid=74821) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 06 13:19:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-b12363c1-637c-41cd-9905-5a176906dfce tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:fc:11:5e"/><model type="virtio"/><mtu size="1442"/><target dev="tap0cf4a358-eb"/></interface>not found in domain: <domain type='kvm' id='19'>
Nov 06 13:19:54 user nova-compute[74821]:   <name>instance-00000011</name>
Nov 06 13:19:54 user nova-compute[74821]:   <uuid>bd32c388-aa78-43ef-ae93-8230b8eba8af</uuid>
Nov 06 13:19:54 user nova-compute[74821]:   <metadata>
Nov 06 13:19:54 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:19:54 user nova-compute[74821]:   <nova:package version="0.0.0"/>
Nov 06 13:19:54 user nova-compute[74821]:   <nova:name>tempest-device-tagging-server-63051430</nova:name>
Nov 06 13:19:54 user nova-compute[74821]:   <nova:creationTime>2023-11-06 13:18:39</nova:creationTime>
Nov 06 13:19:54 user nova-compute[74821]:   <nova:flavor name="m1.tiny">
Nov 06 13:19:54 user nova-compute[74821]:     <nova:memory>512</nova:memory>
Nov 06 13:19:54 user nova-compute[74821]:     <nova:disk>1</nova:disk>
Nov 06 13:19:54 user nova-compute[74821]:     <nova:swap>0</nova:swap>
Nov 06 13:19:54 user nova-compute[74821]:     <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:19:54 user nova-compute[74821]:     <nova:vcpus>1</nova:vcpus>
Nov 06 13:19:54 user nova-compute[74821]:   </nova:flavor>
Nov 06 13:19:54 user nova-compute[74821]:   <nova:owner>
Nov 06 13:19:54 user nova-compute[74821]:     <nova:user uuid="63d66293fbbb4460a5e181687fc31fe7">tempest-TaggedAttachmentsTest-1737511361-project-member</nova:user>
Nov 06 13:19:54 user nova-compute[74821]:     <nova:project uuid="4287a7d278844ade94c8b38f8f76087e">tempest-TaggedAttachmentsTest-1737511361</nova:project>
Nov 06 13:19:54 user nova-compute[74821]:   </nova:owner>
Nov 06 13:19:54 user nova-compute[74821]:   <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:19:54 user nova-compute[74821]:   <nova:ports>
Nov 06 13:19:54 user nova-compute[74821]:     <nova:port uuid="054bfb88-19a2-4241-ae8d-0eded559c233">
Nov 06 13:19:54 user nova-compute[74821]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 13:19:54 user nova-compute[74821]:     </nova:port>
Nov 06 13:19:54 user nova-compute[74821]:     <nova:port uuid="0cf4a358-eb19-49f2-9ce1-9e4ee135805c">
Nov 06 13:19:54 user nova-compute[74821]:       <nova:ip type="fixed" address="10.10.10.187" ipVersion="4"/>
Nov 06 13:19:54 user nova-compute[74821]:     </nova:port>
Nov 06 13:19:54 user nova-compute[74821]:   </nova:ports>
Nov 06 13:19:54 user nova-compute[74821]: </nova:instance>
Nov 06 13:19:54 user nova-compute[74821]:   </metadata>
Nov 06 13:19:54 user nova-compute[74821]:   <memory unit='KiB'>524288</memory>
Nov 06 13:19:54 user nova-compute[74821]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 06 13:19:54 user nova-compute[74821]:   <vcpu placement='static'>1</vcpu>
Nov 06 13:19:54 user nova-compute[74821]:   <resource>
Nov 06 13:19:54 user nova-compute[74821]:     <partition>/machine</partition>
Nov 06 13:19:54 user nova-compute[74821]:   </resource>
Nov 06 13:19:54 user nova-compute[74821]:   <sysinfo type='smbios'>
Nov 06 13:19:54 user nova-compute[74821]:     <system>
Nov 06 13:19:54 user nova-compute[74821]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 06 13:19:54 user nova-compute[74821]:       <entry name='product'>OpenStack Nova</entry>
Nov 06 13:19:54 user nova-compute[74821]:       <entry name='version'>0.0.0</entry>
Nov 06 13:19:54 user nova-compute[74821]:       <entry name='serial'>bd32c388-aa78-43ef-ae93-8230b8eba8af</entry>
Nov 06 13:19:54 user nova-compute[74821]:       <entry name='uuid'>bd32c388-aa78-43ef-ae93-8230b8eba8af</entry>
Nov 06 13:19:54 user nova-compute[74821]:       <entry name='family'>Virtual Machine</entry>
Nov 06 13:19:54 user nova-compute[74821]:     </system>
Nov 06 13:19:54 user nova-compute[74821]:   </sysinfo>
Nov 06 13:19:54 user nova-compute[74821]:   <os>
Nov 06 13:19:54 user nova-compute[74821]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 06 13:19:54 user nova-compute[74821]:     <boot dev='hd'/>
Nov 06 13:19:54 user nova-compute[74821]:     <smbios mode='sysinfo'/>
Nov 06 13:19:54 user nova-compute[74821]:   </os>
Nov 06 13:19:54 user nova-compute[74821]:   <features>
Nov 06 13:19:54 user nova-compute[74821]:     <acpi/>
Nov 06 13:19:54 user nova-compute[74821]:     <apic/>
Nov 06 13:19:54 user nova-compute[74821]:     <vmcoreinfo state='on'/>
Nov 06 13:19:54 user nova-compute[74821]:   </features>
Nov 06 13:19:54 user nova-compute[74821]:   <cpu mode='custom' match='exact' check='full'>
Nov 06 13:19:54 user nova-compute[74821]:     <model fallback='forbid'>Nehalem</model>
Nov 06 13:19:54 user nova-compute[74821]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 06 13:19:54 user nova-compute[74821]:     <feature policy='require' name='vme'/>
Nov 06 13:19:54 user nova-compute[74821]:     <feature policy='require' name='x2apic'/>
Nov 06 13:19:54 user nova-compute[74821]:     <feature policy='require' name='hypervisor'/>
Nov 06 13:19:54 user nova-compute[74821]:   </cpu>
Nov 06 13:19:54 user nova-compute[74821]:   <clock offset='utc'>
Nov 06 13:19:54 user nova-compute[74821]:     <timer name='pit' tickpolicy='delay'/>
Nov 06 13:19:54 user nova-compute[74821]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 06 13:19:54 user nova-compute[74821]:     <timer name='hpet' present='no'/>
Nov 06 13:19:54 user nova-compute[74821]:   </clock>
Nov 06 13:19:54 user nova-compute[74821]:   <on_poweroff>destroy</on_poweroff>
Nov 06 13:19:54 user nova-compute[74821]:   <on_reboot>restart</on_reboot>
Nov 06 13:19:54 user nova-compute[74821]:   <on_crash>destroy</on_crash>
Nov 06 13:19:54 user nova-compute[74821]:   <devices>
Nov 06 13:19:54 user nova-compute[74821]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 06 13:19:54 user nova-compute[74821]:     <disk type='file' device='disk'>
Nov 06 13:19:54 user nova-compute[74821]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 06 13:19:54 user nova-compute[74821]:       <source file='/opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/disk' index='2'/>
Nov 06 13:19:54 user nova-compute[74821]:       <backingStore type='file' index='3'>
Nov 06 13:19:54 user nova-compute[74821]:         <format type='raw'/>
Nov 06 13:19:54 user nova-compute[74821]:         <source file='/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374'/>
Nov 06 13:19:54 user nova-compute[74821]:         <backingStore/>
Nov 06 13:19:54 user nova-compute[74821]:       </backingStore>
Nov 06 13:19:54 user nova-compute[74821]:       <target dev='vda' bus='virtio'/>
Nov 06 13:19:54 user nova-compute[74821]:       <alias name='virtio-disk0'/>
Nov 06 13:19:54 user nova-compute[74821]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 06 13:19:54 user nova-compute[74821]:     </disk>
Nov 06 13:19:54 user nova-compute[74821]:     <disk type='file' device='cdrom'>
Nov 06 13:19:54 user nova-compute[74821]:       <driver name='qemu' type='raw' cache='none'/>
Nov 06 13:19:54 user nova-compute[74821]:       <source file='/opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/disk.config' index='1'/>
Nov 06 13:19:54 user nova-compute[74821]:       <backingStore/>
Nov 06 13:19:54 user nova-compute[74821]:       <target dev='hda' bus='ide'/>
Nov 06 13:19:54 user nova-compute[74821]:       <readonly/>
Nov 06 13:19:54 user nova-compute[74821]:       <alias name='ide0-0-0'/>
Nov 06 13:19:54 user nova-compute[74821]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 06 13:19:54 user nova-compute[74821]:     </disk>
Nov 06 13:19:54 user nova-compute[74821]:     <controller type='usb' index='0' model='none'>
Nov 06 13:19:54 user nova-compute[74821]:       <alias name='usb'/>
Nov 06 13:19:54 user nova-compute[74821]:     </controller>
Nov 06 13:19:54 user nova-compute[74821]:     <controller type='pci' index='0' model='pci-root'>
Nov 06 13:19:54 user nova-compute[74821]:       <alias name='pci.0'/>
Nov 06 13:19:54 user nova-compute[74821]:     </controller>
Nov 06 13:19:54 user nova-compute[74821]:     <controller type='ide' index='0'>
Nov 06 13:19:54 user nova-compute[74821]:       <alias name='ide'/>
Nov 06 13:19:54 user nova-compute[74821]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 06 13:19:54 user nova-compute[74821]:     </controller>
Nov 06 13:19:54 user nova-compute[74821]:     <interface type='ethernet'>
Nov 06 13:19:54 user nova-compute[74821]:       <mac address='fa:16:3e:7e:2a:2d'/>
Nov 06 13:19:54 user nova-compute[74821]:       <target dev='tap054bfb88-19'/>
Nov 06 13:19:54 user nova-compute[74821]:       <model type='virtio'/>
Nov 06 13:19:54 user nova-compute[74821]:       <mtu size='1442'/>
Nov 06 13:19:54 user nova-compute[74821]:       <alias name='net0'/>
Nov 06 13:19:54 user nova-compute[74821]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 06 13:19:54 user nova-compute[74821]:     </interface>
Nov 06 13:19:54 user nova-compute[74821]:     <serial type='pty'>
Nov 06 13:19:54 user nova-compute[74821]:       <source path='/dev/pts/7'/>
Nov 06 13:19:54 user nova-compute[74821]:       <log file='/opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/console.log' append='off'/>
Nov 06 13:19:54 user nova-compute[74821]:       <target type='isa-serial' port='0'>
Nov 06 13:19:54 user nova-compute[74821]:         <model name='isa-serial'/>
Nov 06 13:19:54 user nova-compute[74821]:       </target>
Nov 06 13:19:54 user nova-compute[74821]:       <alias name='serial0'/>
Nov 06 13:19:54 user nova-compute[74821]:     </serial>
Nov 06 13:19:54 user nova-compute[74821]:     <console type='pty' tty='/dev/pts/7'>
Nov 06 13:19:54 user nova-compute[74821]:       <source path='/dev/pts/7'/>
Nov 06 13:19:54 user nova-compute[74821]:       <log file='/opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/console.log' append='off'/>
Nov 06 13:19:54 user nova-compute[74821]:       <target type='serial' port='0'/>
Nov 06 13:19:54 user nova-compute[74821]:       <alias name='serial0'/>
Nov 06 13:19:54 user nova-compute[74821]:     </console>
Nov 06 13:19:54 user nova-compute[74821]:     <input type='mouse' bus='ps2'>
Nov 06 13:19:54 user nova-compute[74821]:       <alias name='input0'/>
Nov 06 13:19:54 user nova-compute[74821]:     </input>
Nov 06 13:19:54 user nova-compute[74821]:     <input type='keyboard' bus='ps2'>
Nov 06 13:19:54 user nova-compute[74821]:       <alias name='input1'/>
Nov 06 13:19:54 user nova-compute[74821]:     </input>
Nov 06 13:19:54 user nova-compute[74821]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 06 13:19:54 user nova-compute[74821]:       <listen type='address' address='0.0.0.0'/>
Nov 06 13:19:54 user nova-compute[74821]:     </graphics>
Nov 06 13:19:54 user nova-compute[74821]:     <audio id='1' type='none'/>
Nov 06 13:19:54 user nova-compute[74821]:     <video>
Nov 06 13:19:54 user nova-compute[74821]:       <model type='virtio' heads='1' primary='yes'/>
Nov 06 13:19:54 user nova-compute[74821]:       <alias name='video0'/>
Nov 06 13:19:54 user nova-compute[74821]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 06 13:19:54 user nova-compute[74821]:     </video>
Nov 06 13:19:54 user nova-compute[74821]:     <memballoon model='virtio'>
Nov 06 13:19:54 user nova-compute[74821]:       <stats period='10'/>
Nov 06 13:19:54 user nova-compute[74821]:       <alias name='balloon0'/>
Nov 06 13:19:54 user nova-compute[74821]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 06 13:19:54 user nova-compute[74821]:     </memballoon>
Nov 06 13:19:54 user nova-compute[74821]:     <rng model='virtio'>
Nov 06 13:19:54 user nova-compute[74821]:       <backend model='random'>/dev/urandom</backend>
Nov 06 13:19:54 user nova-compute[74821]:       <alias name='rng0'/>
Nov 06 13:19:54 user nova-compute[74821]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 06 13:19:54 user nova-compute[74821]:     </rng>
Nov 06 13:19:54 user nova-compute[74821]:   </devices>
Nov 06 13:19:54 user nova-compute[74821]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 06 13:19:54 user nova-compute[74821]:     <label>libvirt-bd32c388-aa78-43ef-ae93-8230b8eba8af</label>
Nov 06 13:19:54 user nova-compute[74821]:     <imagelabel>libvirt-bd32c388-aa78-43ef-ae93-8230b8eba8af</imagelabel>
Nov 06 13:19:54 user nova-compute[74821]:   </seclabel>
Nov 06 13:19:54 user nova-compute[74821]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 06 13:19:54 user nova-compute[74821]:     <label>+64055:+108</label>
Nov 06 13:19:54 user nova-compute[74821]:     <imagelabel>+64055:+108</imagelabel>
Nov 06 13:19:54 user nova-compute[74821]:   </seclabel>
Nov 06 13:19:54 user nova-compute[74821]: </domain>
Nov 06 13:19:54 user nova-compute[74821]:  {{(pid=74821) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 06 13:19:54 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-b12363c1-637c-41cd-9905-5a176906dfce tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Successfully detached device tap0cf4a358-eb from instance bd32c388-aa78-43ef-ae93-8230b8eba8af from the live domain config.
Nov 06 13:19:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-b12363c1-637c-41cd-9905-5a176906dfce tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:16:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-63051430',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-63051430',id=17,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTKqcTwYkCQENDzProvGIMFtMqaS+G/n1Hbl3a5LzTI2xbz3a2W94HTVkp4RevkFUNv1QjLjHpnVGJBeVEJild17QwHehxxe7AL3LQT4P27u7Ru79l65cMDiX2/YAksMA==',key_name='tempest-keypair-1412532163',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:16:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4287a7d278844ade94c8b38f8f76087e',ramdisk_id='',reservation_id='r-fuumtn90',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1737511361',owner_user_name='tempest-TaggedAttachmentsTest-1737511361-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:16:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63d66293fbbb4460a5e181687fc31fe7',uuid=bd32c388-aa78-43ef-ae93-8230b8eba8af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0cf4a358-eb19-49f2-9ce1-9e4ee135805c", "address": "fa:16:3e:fc:11:5e", "network": {"id": "cc1ad5d0-5dc6-43a6-82ac-f94263c8fb20", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1465765696", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4287a7d278844ade94c8b38f8f76087e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf4a358-eb", "ovs_interfaceid": "0cf4a358-eb19-49f2-9ce1-9e4ee135805c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:19:54 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-b12363c1-637c-41cd-9905-5a176906dfce tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Converting VIF {"id": "0cf4a358-eb19-49f2-9ce1-9e4ee135805c", "address": "fa:16:3e:fc:11:5e", "network": {"id": "cc1ad5d0-5dc6-43a6-82ac-f94263c8fb20", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1465765696", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4287a7d278844ade94c8b38f8f76087e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf4a358-eb", "ovs_interfaceid": "0cf4a358-eb19-49f2-9ce1-9e4ee135805c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:19:54 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-b12363c1-637c-41cd-9905-5a176906dfce tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:11:5e,bridge_name='br-int',has_traffic_filtering=True,id=0cf4a358-eb19-49f2-9ce1-9e4ee135805c,network=Network(cc1ad5d0-5dc6-43a6-82ac-f94263c8fb20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cf4a358-eb') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:19:54 user nova-compute[74821]: DEBUG os_vif [None req-b12363c1-637c-41cd-9905-5a176906dfce tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:11:5e,bridge_name='br-int',has_traffic_filtering=True,id=0cf4a358-eb19-49f2-9ce1-9e4ee135805c,network=Network(cc1ad5d0-5dc6-43a6-82ac-f94263c8fb20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cf4a358-eb') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:19:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0cf4a358-eb, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:19:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=89dd89b7-3465-4165-bfb0-92f36407d0c2) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:19:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:54 user nova-compute[74821]: INFO os_vif [None req-b12363c1-637c-41cd-9905-5a176906dfce tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:11:5e,bridge_name='br-int',has_traffic_filtering=True,id=0cf4a358-eb19-49f2-9ce1-9e4ee135805c,network=Network(cc1ad5d0-5dc6-43a6-82ac-f94263c8fb20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cf4a358-eb')
Nov 06 13:19:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-b12363c1-637c-41cd-9905-5a176906dfce tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:19:54 user nova-compute[74821]:   <nova:package version="0.0.0"/>
Nov 06 13:19:54 user nova-compute[74821]:   <nova:name>tempest-device-tagging-server-63051430</nova:name>
Nov 06 13:19:54 user nova-compute[74821]:   <nova:creationTime>2023-11-06 13:19:54</nova:creationTime>
Nov 06 13:19:54 user nova-compute[74821]:   <nova:flavor name="m1.tiny">
Nov 06 13:19:54 user nova-compute[74821]:     <nova:memory>512</nova:memory>
Nov 06 13:19:54 user nova-compute[74821]:     <nova:disk>1</nova:disk>
Nov 06 13:19:54 user nova-compute[74821]:     <nova:swap>0</nova:swap>
Nov 06 13:19:54 user nova-compute[74821]:     <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:19:54 user nova-compute[74821]:     <nova:vcpus>1</nova:vcpus>
Nov 06 13:19:54 user nova-compute[74821]:   </nova:flavor>
Nov 06 13:19:54 user nova-compute[74821]:   <nova:owner>
Nov 06 13:19:54 user nova-compute[74821]:     <nova:user uuid="63d66293fbbb4460a5e181687fc31fe7">tempest-TaggedAttachmentsTest-1737511361-project-member</nova:user>
Nov 06 13:19:54 user nova-compute[74821]:     <nova:project uuid="4287a7d278844ade94c8b38f8f76087e">tempest-TaggedAttachmentsTest-1737511361</nova:project>
Nov 06 13:19:54 user nova-compute[74821]:   </nova:owner>
Nov 06 13:19:54 user nova-compute[74821]:   <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:19:54 user nova-compute[74821]:   <nova:ports>
Nov 06 13:19:54 user nova-compute[74821]:     <nova:port uuid="054bfb88-19a2-4241-ae8d-0eded559c233">
Nov 06 13:19:54 user nova-compute[74821]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 13:19:54 user nova-compute[74821]:     </nova:port>
Nov 06 13:19:54 user nova-compute[74821]:   </nova:ports>
Nov 06 13:19:54 user nova-compute[74821]: </nova:instance>
Nov 06 13:19:54 user nova-compute[74821]:  {{(pid=74821) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 06 13:19:54 user nova-compute[74821]: DEBUG nova.compute.manager [req-cd7e9d99-ac70-40f5-8164-54e3efd22433 req-caf7c32a-d683-420e-8400-435d89922ce8 service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Received event network-vif-deleted-0cf4a358-eb19-49f2-9ce1-9e4ee135805c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:19:54 user nova-compute[74821]: INFO nova.compute.manager [req-cd7e9d99-ac70-40f5-8164-54e3efd22433 req-caf7c32a-d683-420e-8400-435d89922ce8 service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Neutron deleted interface 0cf4a358-eb19-49f2-9ce1-9e4ee135805c; detaching it from the instance and deleting it from the info cache
Nov 06 13:19:54 user nova-compute[74821]: DEBUG nova.network.neutron [req-cd7e9d99-ac70-40f5-8164-54e3efd22433 req-caf7c32a-d683-420e-8400-435d89922ce8 service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Updating instance_info_cache with network_info: [{"id": "054bfb88-19a2-4241-ae8d-0eded559c233", "address": "fa:16:3e:7e:2a:2d", "network": {"id": "f5b630ec-39d9-4d50-b25a-3d90038e8b32", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-950408673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4287a7d278844ade94c8b38f8f76087e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054bfb88-19", "ovs_interfaceid": "054bfb88-19a2-4241-ae8d-0eded559c233", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:19:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b12363c1-637c-41cd-9905-5a176906dfce tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Acquiring lock "refresh_cache-bd32c388-aa78-43ef-ae93-8230b8eba8af" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:19:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b12363c1-637c-41cd-9905-5a176906dfce tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Acquired lock "refresh_cache-bd32c388-aa78-43ef-ae93-8230b8eba8af" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:19:54 user nova-compute[74821]: DEBUG nova.network.neutron [None req-b12363c1-637c-41cd-9905-5a176906dfce tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:19:54 user nova-compute[74821]: DEBUG nova.objects.instance [req-cd7e9d99-ac70-40f5-8164-54e3efd22433 req-caf7c32a-d683-420e-8400-435d89922ce8 service nova] Lazy-loading 'system_metadata' on Instance uuid bd32c388-aa78-43ef-ae93-8230b8eba8af {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:19:55 user nova-compute[74821]: DEBUG nova.objects.instance [req-cd7e9d99-ac70-40f5-8164-54e3efd22433 req-caf7c32a-d683-420e-8400-435d89922ce8 service nova] Lazy-loading 'flavor' on Instance uuid bd32c388-aa78-43ef-ae93-8230b8eba8af {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:19:55 user nova-compute[74821]: DEBUG nova.objects.base [req-cd7e9d99-ac70-40f5-8164-54e3efd22433 req-caf7c32a-d683-420e-8400-435d89922ce8 service nova] Object Instance<bd32c388-aa78-43ef-ae93-8230b8eba8af> lazy-loaded attributes: system_metadata,flavor {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:19:55 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [req-cd7e9d99-ac70-40f5-8164-54e3efd22433 req-caf7c32a-d683-420e-8400-435d89922ce8 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:16:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-63051430',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-63051430',id=17,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTKqcTwYkCQENDzProvGIMFtMqaS+G/n1Hbl3a5LzTI2xbz3a2W94HTVkp4RevkFUNv1QjLjHpnVGJBeVEJild17QwHehxxe7AL3LQT4P27u7Ru79l65cMDiX2/YAksMA==',key_name='tempest-keypair-1412532163',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:16:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4287a7d278844ade94c8b38f8f76087e',ramdisk_id='',reservation_id='r-fuumtn90',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1737511361',owner_user_name='tempest-TaggedAttachmentsTest-1737511361-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:16:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63d66293fbbb4460a5e181687fc31fe7',uuid=bd32c388-aa78-43ef-ae93-8230b8eba8af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0cf4a358-eb19-49f2-9ce1-9e4ee135805c", "address": "fa:16:3e:fc:11:5e", "network": {"id": "cc1ad5d0-5dc6-43a6-82ac-f94263c8fb20", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1465765696", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4287a7d278844ade94c8b38f8f76087e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf4a358-eb", "ovs_interfaceid": "0cf4a358-eb19-49f2-9ce1-9e4ee135805c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:19:55 user nova-compute[74821]: DEBUG nova.network.os_vif_util [req-cd7e9d99-ac70-40f5-8164-54e3efd22433 req-caf7c32a-d683-420e-8400-435d89922ce8 service nova] Converting VIF {"id": "0cf4a358-eb19-49f2-9ce1-9e4ee135805c", "address": "fa:16:3e:fc:11:5e", "network": {"id": "cc1ad5d0-5dc6-43a6-82ac-f94263c8fb20", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1465765696", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4287a7d278844ade94c8b38f8f76087e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf4a358-eb", "ovs_interfaceid": "0cf4a358-eb19-49f2-9ce1-9e4ee135805c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:19:55 user nova-compute[74821]: DEBUG nova.network.os_vif_util [req-cd7e9d99-ac70-40f5-8164-54e3efd22433 req-caf7c32a-d683-420e-8400-435d89922ce8 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:11:5e,bridge_name='br-int',has_traffic_filtering=True,id=0cf4a358-eb19-49f2-9ce1-9e4ee135805c,network=Network(cc1ad5d0-5dc6-43a6-82ac-f94263c8fb20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cf4a358-eb') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:19:55 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [req-cd7e9d99-ac70-40f5-8164-54e3efd22433 req-caf7c32a-d683-420e-8400-435d89922ce8 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fc:11:5e"/><model type="virtio"/><mtu size="1442"/><target dev="tap0cf4a358-eb"/></interface> {{(pid=74821) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 06 13:19:55 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [req-cd7e9d99-ac70-40f5-8164-54e3efd22433 req-caf7c32a-d683-420e-8400-435d89922ce8 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:fc:11:5e"/><model type="virtio"/><mtu size="1442"/><target dev="tap0cf4a358-eb"/></interface>not found in domain: <domain type='kvm' id='19'>
Nov 06 13:19:55 user nova-compute[74821]:   <name>instance-00000011</name>
Nov 06 13:19:55 user nova-compute[74821]:   <uuid>bd32c388-aa78-43ef-ae93-8230b8eba8af</uuid>
Nov 06 13:19:55 user nova-compute[74821]:   <metadata>
Nov 06 13:19:55 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:19:55 user nova-compute[74821]:   <nova:package version="0.0.0"/>
Nov 06 13:19:55 user nova-compute[74821]:   <nova:name>tempest-device-tagging-server-63051430</nova:name>
Nov 06 13:19:55 user nova-compute[74821]:   <nova:creationTime>2023-11-06 13:19:54</nova:creationTime>
Nov 06 13:19:55 user nova-compute[74821]:   <nova:flavor name="m1.tiny">
Nov 06 13:19:55 user nova-compute[74821]:     <nova:memory>512</nova:memory>
Nov 06 13:19:55 user nova-compute[74821]:     <nova:disk>1</nova:disk>
Nov 06 13:19:55 user nova-compute[74821]:     <nova:swap>0</nova:swap>
Nov 06 13:19:55 user nova-compute[74821]:     <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:19:55 user nova-compute[74821]:     <nova:vcpus>1</nova:vcpus>
Nov 06 13:19:55 user nova-compute[74821]:   </nova:flavor>
Nov 06 13:19:55 user nova-compute[74821]:   <nova:owner>
Nov 06 13:19:55 user nova-compute[74821]:     <nova:user uuid="63d66293fbbb4460a5e181687fc31fe7">tempest-TaggedAttachmentsTest-1737511361-project-member</nova:user>
Nov 06 13:19:55 user nova-compute[74821]:     <nova:project uuid="4287a7d278844ade94c8b38f8f76087e">tempest-TaggedAttachmentsTest-1737511361</nova:project>
Nov 06 13:19:55 user nova-compute[74821]:   </nova:owner>
Nov 06 13:19:55 user nova-compute[74821]:   <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:19:55 user nova-compute[74821]:   <nova:ports>
Nov 06 13:19:55 user nova-compute[74821]:     <nova:port uuid="054bfb88-19a2-4241-ae8d-0eded559c233">
Nov 06 13:19:55 user nova-compute[74821]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 13:19:55 user nova-compute[74821]:     </nova:port>
Nov 06 13:19:55 user nova-compute[74821]:   </nova:ports>
Nov 06 13:19:55 user nova-compute[74821]: </nova:instance>
Nov 06 13:19:55 user nova-compute[74821]:   </metadata>
Nov 06 13:19:55 user nova-compute[74821]:   <memory unit='KiB'>524288</memory>
Nov 06 13:19:55 user nova-compute[74821]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 06 13:19:55 user nova-compute[74821]:   <vcpu placement='static'>1</vcpu>
Nov 06 13:19:55 user nova-compute[74821]:   <resource>
Nov 06 13:19:55 user nova-compute[74821]:     <partition>/machine</partition>
Nov 06 13:19:55 user nova-compute[74821]:   </resource>
Nov 06 13:19:55 user nova-compute[74821]:   <sysinfo type='smbios'>
Nov 06 13:19:55 user nova-compute[74821]:     <system>
Nov 06 13:19:55 user nova-compute[74821]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 06 13:19:55 user nova-compute[74821]:       <entry name='product'>OpenStack Nova</entry>
Nov 06 13:19:55 user nova-compute[74821]:       <entry name='version'>0.0.0</entry>
Nov 06 13:19:55 user nova-compute[74821]:       <entry name='serial'>bd32c388-aa78-43ef-ae93-8230b8eba8af</entry>
Nov 06 13:19:55 user nova-compute[74821]:       <entry name='uuid'>bd32c388-aa78-43ef-ae93-8230b8eba8af</entry>
Nov 06 13:19:55 user nova-compute[74821]:       <entry name='family'>Virtual Machine</entry>
Nov 06 13:19:55 user nova-compute[74821]:     </system>
Nov 06 13:19:55 user nova-compute[74821]:   </sysinfo>
Nov 06 13:19:55 user nova-compute[74821]:   <os>
Nov 06 13:19:55 user nova-compute[74821]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 06 13:19:55 user nova-compute[74821]:     <boot dev='hd'/>
Nov 06 13:19:55 user nova-compute[74821]:     <smbios mode='sysinfo'/>
Nov 06 13:19:55 user nova-compute[74821]:   </os>
Nov 06 13:19:55 user nova-compute[74821]:   <features>
Nov 06 13:19:55 user nova-compute[74821]:     <acpi/>
Nov 06 13:19:55 user nova-compute[74821]:     <apic/>
Nov 06 13:19:55 user nova-compute[74821]:     <vmcoreinfo state='on'/>
Nov 06 13:19:55 user nova-compute[74821]:   </features>
Nov 06 13:19:55 user nova-compute[74821]:   <cpu mode='custom' match='exact' check='full'>
Nov 06 13:19:55 user nova-compute[74821]:     <model fallback='forbid'>Nehalem</model>
Nov 06 13:19:55 user nova-compute[74821]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 06 13:19:55 user nova-compute[74821]:     <feature policy='require' name='vme'/>
Nov 06 13:19:55 user nova-compute[74821]:     <feature policy='require' name='x2apic'/>
Nov 06 13:19:55 user nova-compute[74821]:     <feature policy='require' name='hypervisor'/>
Nov 06 13:19:55 user nova-compute[74821]:   </cpu>
Nov 06 13:19:55 user nova-compute[74821]:   <clock offset='utc'>
Nov 06 13:19:55 user nova-compute[74821]:     <timer name='pit' tickpolicy='delay'/>
Nov 06 13:19:55 user nova-compute[74821]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 06 13:19:55 user nova-compute[74821]:     <timer name='hpet' present='no'/>
Nov 06 13:19:55 user nova-compute[74821]:   </clock>
Nov 06 13:19:55 user nova-compute[74821]:   <on_poweroff>destroy</on_poweroff>
Nov 06 13:19:55 user nova-compute[74821]:   <on_reboot>restart</on_reboot>
Nov 06 13:19:55 user nova-compute[74821]:   <on_crash>destroy</on_crash>
Nov 06 13:19:55 user nova-compute[74821]:   <devices>
Nov 06 13:19:55 user nova-compute[74821]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 06 13:19:55 user nova-compute[74821]:     <disk type='file' device='disk'>
Nov 06 13:19:55 user nova-compute[74821]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 06 13:19:55 user nova-compute[74821]:       <source file='/opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/disk' index='2'/>
Nov 06 13:19:55 user nova-compute[74821]:       <backingStore type='file' index='3'>
Nov 06 13:19:55 user nova-compute[74821]:         <format type='raw'/>
Nov 06 13:19:55 user nova-compute[74821]:         <source file='/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374'/>
Nov 06 13:19:55 user nova-compute[74821]:         <backingStore/>
Nov 06 13:19:55 user nova-compute[74821]:       </backingStore>
Nov 06 13:19:55 user nova-compute[74821]:       <target dev='vda' bus='virtio'/>
Nov 06 13:19:55 user nova-compute[74821]:       <alias name='virtio-disk0'/>
Nov 06 13:19:55 user nova-compute[74821]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 06 13:19:55 user nova-compute[74821]:     </disk>
Nov 06 13:19:55 user nova-compute[74821]:     <disk type='file' device='cdrom'>
Nov 06 13:19:55 user nova-compute[74821]:       <driver name='qemu' type='raw' cache='none'/>
Nov 06 13:19:55 user nova-compute[74821]:       <source file='/opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/disk.config' index='1'/>
Nov 06 13:19:55 user nova-compute[74821]:       <backingStore/>
Nov 06 13:19:55 user nova-compute[74821]:       <target dev='hda' bus='ide'/>
Nov 06 13:19:55 user nova-compute[74821]:       <readonly/>
Nov 06 13:19:55 user nova-compute[74821]:       <alias name='ide0-0-0'/>
Nov 06 13:19:55 user nova-compute[74821]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 06 13:19:55 user nova-compute[74821]:     </disk>
Nov 06 13:19:55 user nova-compute[74821]:     <controller type='usb' index='0' model='none'>
Nov 06 13:19:55 user nova-compute[74821]:       <alias name='usb'/>
Nov 06 13:19:55 user nova-compute[74821]:     </controller>
Nov 06 13:19:55 user nova-compute[74821]:     <controller type='pci' index='0' model='pci-root'>
Nov 06 13:19:55 user nova-compute[74821]:       <alias name='pci.0'/>
Nov 06 13:19:55 user nova-compute[74821]:     </controller>
Nov 06 13:19:55 user nova-compute[74821]:     <controller type='ide' index='0'>
Nov 06 13:19:55 user nova-compute[74821]:       <alias name='ide'/>
Nov 06 13:19:55 user nova-compute[74821]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 06 13:19:55 user nova-compute[74821]:     </controller>
Nov 06 13:19:55 user nova-compute[74821]:     <interface type='ethernet'>
Nov 06 13:19:55 user nova-compute[74821]:       <mac address='fa:16:3e:7e:2a:2d'/>
Nov 06 13:19:55 user nova-compute[74821]:       <target dev='tap054bfb88-19'/>
Nov 06 13:19:55 user nova-compute[74821]:       <model type='virtio'/>
Nov 06 13:19:55 user nova-compute[74821]:       <mtu size='1442'/>
Nov 06 13:19:55 user nova-compute[74821]:       <alias name='net0'/>
Nov 06 13:19:55 user nova-compute[74821]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 06 13:19:55 user nova-compute[74821]:     </interface>
Nov 06 13:19:55 user nova-compute[74821]:     <serial type='pty'>
Nov 06 13:19:55 user nova-compute[74821]:       <source path='/dev/pts/7'/>
Nov 06 13:19:55 user nova-compute[74821]:       <log file='/opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/console.log' append='off'/>
Nov 06 13:19:55 user nova-compute[74821]:       <target type='isa-serial' port='0'>
Nov 06 13:19:55 user nova-compute[74821]:         <model name='isa-serial'/>
Nov 06 13:19:55 user nova-compute[74821]:       </target>
Nov 06 13:19:55 user nova-compute[74821]:       <alias name='serial0'/>
Nov 06 13:19:55 user nova-compute[74821]:     </serial>
Nov 06 13:19:55 user nova-compute[74821]:     <console type='pty' tty='/dev/pts/7'>
Nov 06 13:19:55 user nova-compute[74821]:       <source path='/dev/pts/7'/>
Nov 06 13:19:55 user nova-compute[74821]:       <log file='/opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/console.log' append='off'/>
Nov 06 13:19:55 user nova-compute[74821]:       <target type='serial' port='0'/>
Nov 06 13:19:55 user nova-compute[74821]:       <alias name='serial0'/>
Nov 06 13:19:55 user nova-compute[74821]:     </console>
Nov 06 13:19:55 user nova-compute[74821]:     <input type='mouse' bus='ps2'>
Nov 06 13:19:55 user nova-compute[74821]:       <alias name='input0'/>
Nov 06 13:19:55 user nova-compute[74821]:     </input>
Nov 06 13:19:55 user nova-compute[74821]:     <input type='keyboard' bus='ps2'>
Nov 06 13:19:55 user nova-compute[74821]:       <alias name='input1'/>
Nov 06 13:19:55 user nova-compute[74821]:     </input>
Nov 06 13:19:55 user nova-compute[74821]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 06 13:19:55 user nova-compute[74821]:       <listen type='address' address='0.0.0.0'/>
Nov 06 13:19:55 user nova-compute[74821]:     </graphics>
Nov 06 13:19:55 user nova-compute[74821]:     <audio id='1' type='none'/>
Nov 06 13:19:55 user nova-compute[74821]:     <video>
Nov 06 13:19:55 user nova-compute[74821]:       <model type='virtio' heads='1' primary='yes'/>
Nov 06 13:19:55 user nova-compute[74821]:       <alias name='video0'/>
Nov 06 13:19:55 user nova-compute[74821]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 06 13:19:55 user nova-compute[74821]:     </video>
Nov 06 13:19:55 user nova-compute[74821]:     <memballoon model='virtio'>
Nov 06 13:19:55 user nova-compute[74821]:       <stats period='10'/>
Nov 06 13:19:55 user nova-compute[74821]:       <alias name='balloon0'/>
Nov 06 13:19:55 user nova-compute[74821]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 06 13:19:55 user nova-compute[74821]:     </memballoon>
Nov 06 13:19:55 user nova-compute[74821]:     <rng model='virtio'>
Nov 06 13:19:55 user nova-compute[74821]:       <backend model='random'>/dev/urandom</backend>
Nov 06 13:19:55 user nova-compute[74821]:       <alias name='rng0'/>
Nov 06 13:19:55 user nova-compute[74821]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 06 13:19:55 user nova-compute[74821]:     </rng>
Nov 06 13:19:55 user nova-compute[74821]:   </devices>
Nov 06 13:19:55 user nova-compute[74821]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 06 13:19:55 user nova-compute[74821]:     <label>libvirt-bd32c388-aa78-43ef-ae93-8230b8eba8af</label>
Nov 06 13:19:55 user nova-compute[74821]:     <imagelabel>libvirt-bd32c388-aa78-43ef-ae93-8230b8eba8af</imagelabel>
Nov 06 13:19:55 user nova-compute[74821]:   </seclabel>
Nov 06 13:19:55 user nova-compute[74821]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 06 13:19:55 user nova-compute[74821]:     <label>+64055:+108</label>
Nov 06 13:19:55 user nova-compute[74821]:     <imagelabel>+64055:+108</imagelabel>
Nov 06 13:19:55 user nova-compute[74821]:   </seclabel>
Nov 06 13:19:55 user nova-compute[74821]: </domain>
Nov 06 13:19:55 user nova-compute[74821]:  {{(pid=74821) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 06 13:19:55 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [req-cd7e9d99-ac70-40f5-8164-54e3efd22433 req-caf7c32a-d683-420e-8400-435d89922ce8 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fc:11:5e"/><model type="virtio"/><mtu size="1442"/><target dev="tap0cf4a358-eb"/></interface> {{(pid=74821) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 06 13:19:55 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [req-cd7e9d99-ac70-40f5-8164-54e3efd22433 req-caf7c32a-d683-420e-8400-435d89922ce8 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:fc:11:5e"/><model type="virtio"/><mtu size="1442"/><target dev="tap0cf4a358-eb"/></interface>not found in domain: <domain type='kvm' id='19'>
Nov 06 13:19:55 user nova-compute[74821]:   <name>instance-00000011</name>
Nov 06 13:19:55 user nova-compute[74821]:   <uuid>bd32c388-aa78-43ef-ae93-8230b8eba8af</uuid>
Nov 06 13:19:55 user nova-compute[74821]:   <metadata>
Nov 06 13:19:55 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:19:55 user nova-compute[74821]:   <nova:package version="0.0.0"/>
Nov 06 13:19:55 user nova-compute[74821]:   <nova:name>tempest-device-tagging-server-63051430</nova:name>
Nov 06 13:19:55 user nova-compute[74821]:   <nova:creationTime>2023-11-06 13:19:54</nova:creationTime>
Nov 06 13:19:55 user nova-compute[74821]:   <nova:flavor name="m1.tiny">
Nov 06 13:19:55 user nova-compute[74821]:     <nova:memory>512</nova:memory>
Nov 06 13:19:55 user nova-compute[74821]:     <nova:disk>1</nova:disk>
Nov 06 13:19:55 user nova-compute[74821]:     <nova:swap>0</nova:swap>
Nov 06 13:19:55 user nova-compute[74821]:     <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:19:55 user nova-compute[74821]:     <nova:vcpus>1</nova:vcpus>
Nov 06 13:19:55 user nova-compute[74821]:   </nova:flavor>
Nov 06 13:19:55 user nova-compute[74821]:   <nova:owner>
Nov 06 13:19:55 user nova-compute[74821]:     <nova:user uuid="63d66293fbbb4460a5e181687fc31fe7">tempest-TaggedAttachmentsTest-1737511361-project-member</nova:user>
Nov 06 13:19:55 user nova-compute[74821]:     <nova:project uuid="4287a7d278844ade94c8b38f8f76087e">tempest-TaggedAttachmentsTest-1737511361</nova:project>
Nov 06 13:19:55 user nova-compute[74821]:   </nova:owner>
Nov 06 13:19:55 user nova-compute[74821]:   <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:19:55 user nova-compute[74821]:   <nova:ports>
Nov 06 13:19:55 user nova-compute[74821]:     <nova:port uuid="054bfb88-19a2-4241-ae8d-0eded559c233">
Nov 06 13:19:55 user nova-compute[74821]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 13:19:55 user nova-compute[74821]:     </nova:port>
Nov 06 13:19:55 user nova-compute[74821]:   </nova:ports>
Nov 06 13:19:55 user nova-compute[74821]: </nova:instance>
Nov 06 13:19:55 user nova-compute[74821]:   </metadata>
Nov 06 13:19:55 user nova-compute[74821]:   <memory unit='KiB'>524288</memory>
Nov 06 13:19:55 user nova-compute[74821]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 06 13:19:55 user nova-compute[74821]:   <vcpu placement='static'>1</vcpu>
Nov 06 13:19:55 user nova-compute[74821]:   <resource>
Nov 06 13:19:55 user nova-compute[74821]:     <partition>/machine</partition>
Nov 06 13:19:55 user nova-compute[74821]:   </resource>
Nov 06 13:19:55 user nova-compute[74821]:   <sysinfo type='smbios'>
Nov 06 13:19:55 user nova-compute[74821]:     <system>
Nov 06 13:19:55 user nova-compute[74821]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 06 13:19:55 user nova-compute[74821]:       <entry name='product'>OpenStack Nova</entry>
Nov 06 13:19:55 user nova-compute[74821]:       <entry name='version'>0.0.0</entry>
Nov 06 13:19:55 user nova-compute[74821]:       <entry name='serial'>bd32c388-aa78-43ef-ae93-8230b8eba8af</entry>
Nov 06 13:19:55 user nova-compute[74821]:       <entry name='uuid'>bd32c388-aa78-43ef-ae93-8230b8eba8af</entry>
Nov 06 13:19:55 user nova-compute[74821]:       <entry name='family'>Virtual Machine</entry>
Nov 06 13:19:55 user nova-compute[74821]:     </system>
Nov 06 13:19:55 user nova-compute[74821]:   </sysinfo>
Nov 06 13:19:55 user nova-compute[74821]:   <os>
Nov 06 13:19:55 user nova-compute[74821]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 06 13:19:55 user nova-compute[74821]:     <boot dev='hd'/>
Nov 06 13:19:55 user nova-compute[74821]:     <smbios mode='sysinfo'/>
Nov 06 13:19:55 user nova-compute[74821]:   </os>
Nov 06 13:19:55 user nova-compute[74821]:   <features>
Nov 06 13:19:55 user nova-compute[74821]:     <acpi/>
Nov 06 13:19:55 user nova-compute[74821]:     <apic/>
Nov 06 13:19:55 user nova-compute[74821]:     <vmcoreinfo state='on'/>
Nov 06 13:19:55 user nova-compute[74821]:   </features>
Nov 06 13:19:55 user nova-compute[74821]:   <cpu mode='custom' match='exact' check='full'>
Nov 06 13:19:55 user nova-compute[74821]:     <model fallback='forbid'>Nehalem</model>
Nov 06 13:19:55 user nova-compute[74821]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 06 13:19:55 user nova-compute[74821]:     <feature policy='require' name='vme'/>
Nov 06 13:19:55 user nova-compute[74821]:     <feature policy='require' name='x2apic'/>
Nov 06 13:19:55 user nova-compute[74821]:     <feature policy='require' name='hypervisor'/>
Nov 06 13:19:55 user nova-compute[74821]:   </cpu>
Nov 06 13:19:55 user nova-compute[74821]:   <clock offset='utc'>
Nov 06 13:19:55 user nova-compute[74821]:     <timer name='pit' tickpolicy='delay'/>
Nov 06 13:19:55 user nova-compute[74821]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 06 13:19:55 user nova-compute[74821]:     <timer name='hpet' present='no'/>
Nov 06 13:19:55 user nova-compute[74821]:   </clock>
Nov 06 13:19:55 user nova-compute[74821]:   <on_poweroff>destroy</on_poweroff>
Nov 06 13:19:55 user nova-compute[74821]:   <on_reboot>restart</on_reboot>
Nov 06 13:19:55 user nova-compute[74821]:   <on_crash>destroy</on_crash>
Nov 06 13:19:55 user nova-compute[74821]:   <devices>
Nov 06 13:19:55 user nova-compute[74821]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 06 13:19:55 user nova-compute[74821]:     <disk type='file' device='disk'>
Nov 06 13:19:55 user nova-compute[74821]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 06 13:19:55 user nova-compute[74821]:       <source file='/opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/disk' index='2'/>
Nov 06 13:19:55 user nova-compute[74821]:       <backingStore type='file' index='3'>
Nov 06 13:19:55 user nova-compute[74821]:         <format type='raw'/>
Nov 06 13:19:55 user nova-compute[74821]:         <source file='/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374'/>
Nov 06 13:19:55 user nova-compute[74821]:         <backingStore/>
Nov 06 13:19:55 user nova-compute[74821]:       </backingStore>
Nov 06 13:19:55 user nova-compute[74821]:       <target dev='vda' bus='virtio'/>
Nov 06 13:19:55 user nova-compute[74821]:       <alias name='virtio-disk0'/>
Nov 06 13:19:55 user nova-compute[74821]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 06 13:19:55 user nova-compute[74821]:     </disk>
Nov 06 13:19:55 user nova-compute[74821]:     <disk type='file' device='cdrom'>
Nov 06 13:19:55 user nova-compute[74821]:       <driver name='qemu' type='raw' cache='none'/>
Nov 06 13:19:55 user nova-compute[74821]:       <source file='/opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/disk.config' index='1'/>
Nov 06 13:19:55 user nova-compute[74821]:       <backingStore/>
Nov 06 13:19:55 user nova-compute[74821]:       <target dev='hda' bus='ide'/>
Nov 06 13:19:55 user nova-compute[74821]:       <readonly/>
Nov 06 13:19:55 user nova-compute[74821]:       <alias name='ide0-0-0'/>
Nov 06 13:19:55 user nova-compute[74821]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 06 13:19:55 user nova-compute[74821]:     </disk>
Nov 06 13:19:55 user nova-compute[74821]:     <controller type='usb' index='0' model='none'>
Nov 06 13:19:55 user nova-compute[74821]:       <alias name='usb'/>
Nov 06 13:19:55 user nova-compute[74821]:     </controller>
Nov 06 13:19:55 user nova-compute[74821]:     <controller type='pci' index='0' model='pci-root'>
Nov 06 13:19:55 user nova-compute[74821]:       <alias name='pci.0'/>
Nov 06 13:19:55 user nova-compute[74821]:     </controller>
Nov 06 13:19:55 user nova-compute[74821]:     <controller type='ide' index='0'>
Nov 06 13:19:55 user nova-compute[74821]:       <alias name='ide'/>
Nov 06 13:19:55 user nova-compute[74821]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 06 13:19:55 user nova-compute[74821]:     </controller>
Nov 06 13:19:55 user nova-compute[74821]:     <interface type='ethernet'>
Nov 06 13:19:55 user nova-compute[74821]:       <mac address='fa:16:3e:7e:2a:2d'/>
Nov 06 13:19:55 user nova-compute[74821]:       <target dev='tap054bfb88-19'/>
Nov 06 13:19:55 user nova-compute[74821]:       <model type='virtio'/>
Nov 06 13:19:55 user nova-compute[74821]:       <mtu size='1442'/>
Nov 06 13:19:55 user nova-compute[74821]:       <alias name='net0'/>
Nov 06 13:19:55 user nova-compute[74821]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 06 13:19:55 user nova-compute[74821]:     </interface>
Nov 06 13:19:55 user nova-compute[74821]:     <serial type='pty'>
Nov 06 13:19:55 user nova-compute[74821]:       <source path='/dev/pts/7'/>
Nov 06 13:19:55 user nova-compute[74821]:       <log file='/opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/console.log' append='off'/>
Nov 06 13:19:55 user nova-compute[74821]:       <target type='isa-serial' port='0'>
Nov 06 13:19:55 user nova-compute[74821]:         <model name='isa-serial'/>
Nov 06 13:19:55 user nova-compute[74821]:       </target>
Nov 06 13:19:55 user nova-compute[74821]:       <alias name='serial0'/>
Nov 06 13:19:55 user nova-compute[74821]:     </serial>
Nov 06 13:19:55 user nova-compute[74821]:     <console type='pty' tty='/dev/pts/7'>
Nov 06 13:19:55 user nova-compute[74821]:       <source path='/dev/pts/7'/>
Nov 06 13:19:55 user nova-compute[74821]:       <log file='/opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af/console.log' append='off'/>
Nov 06 13:19:55 user nova-compute[74821]:       <target type='serial' port='0'/>
Nov 06 13:19:55 user nova-compute[74821]:       <alias name='serial0'/>
Nov 06 13:19:55 user nova-compute[74821]:     </console>
Nov 06 13:19:55 user nova-compute[74821]:     <input type='mouse' bus='ps2'>
Nov 06 13:19:55 user nova-compute[74821]:       <alias name='input0'/>
Nov 06 13:19:55 user nova-compute[74821]:     </input>
Nov 06 13:19:55 user nova-compute[74821]:     <input type='keyboard' bus='ps2'>
Nov 06 13:19:55 user nova-compute[74821]:       <alias name='input1'/>
Nov 06 13:19:55 user nova-compute[74821]:     </input>
Nov 06 13:19:55 user nova-compute[74821]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 06 13:19:55 user nova-compute[74821]:       <listen type='address' address='0.0.0.0'/>
Nov 06 13:19:55 user nova-compute[74821]:     </graphics>
Nov 06 13:19:55 user nova-compute[74821]:     <audio id='1' type='none'/>
Nov 06 13:19:55 user nova-compute[74821]:     <video>
Nov 06 13:19:55 user nova-compute[74821]:       <model type='virtio' heads='1' primary='yes'/>
Nov 06 13:19:55 user nova-compute[74821]:       <alias name='video0'/>
Nov 06 13:19:55 user nova-compute[74821]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 06 13:19:55 user nova-compute[74821]:     </video>
Nov 06 13:19:55 user nova-compute[74821]:     <memballoon model='virtio'>
Nov 06 13:19:55 user nova-compute[74821]:       <stats period='10'/>
Nov 06 13:19:55 user nova-compute[74821]:       <alias name='balloon0'/>
Nov 06 13:19:55 user nova-compute[74821]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 06 13:19:55 user nova-compute[74821]:     </memballoon>
Nov 06 13:19:55 user nova-compute[74821]:     <rng model='virtio'>
Nov 06 13:19:55 user nova-compute[74821]:       <backend model='random'>/dev/urandom</backend>
Nov 06 13:19:55 user nova-compute[74821]:       <alias name='rng0'/>
Nov 06 13:19:55 user nova-compute[74821]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 06 13:19:55 user nova-compute[74821]:     </rng>
Nov 06 13:19:55 user nova-compute[74821]:   </devices>
Nov 06 13:19:55 user nova-compute[74821]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 06 13:19:55 user nova-compute[74821]:     <label>libvirt-bd32c388-aa78-43ef-ae93-8230b8eba8af</label>
Nov 06 13:19:55 user nova-compute[74821]:     <imagelabel>libvirt-bd32c388-aa78-43ef-ae93-8230b8eba8af</imagelabel>
Nov 06 13:19:55 user nova-compute[74821]:   </seclabel>
Nov 06 13:19:55 user nova-compute[74821]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 06 13:19:55 user nova-compute[74821]:     <label>+64055:+108</label>
Nov 06 13:19:55 user nova-compute[74821]:     <imagelabel>+64055:+108</imagelabel>
Nov 06 13:19:55 user nova-compute[74821]:   </seclabel>
Nov 06 13:19:55 user nova-compute[74821]: </domain>
Nov 06 13:19:55 user nova-compute[74821]:  {{(pid=74821) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 06 13:19:55 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [req-cd7e9d99-ac70-40f5-8164-54e3efd22433 req-caf7c32a-d683-420e-8400-435d89922ce8 service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Detaching interface fa:16:3e:fc:11:5e failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap0cf4a358-eb' not found.
Nov 06 13:19:55 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [req-cd7e9d99-ac70-40f5-8164-54e3efd22433 req-caf7c32a-d683-420e-8400-435d89922ce8 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:16:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-63051430',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-63051430',id=17,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTKqcTwYkCQENDzProvGIMFtMqaS+G/n1Hbl3a5LzTI2xbz3a2W94HTVkp4RevkFUNv1QjLjHpnVGJBeVEJild17QwHehxxe7AL3LQT4P27u7Ru79l65cMDiX2/YAksMA==',key_name='tempest-keypair-1412532163',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:16:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4287a7d278844ade94c8b38f8f76087e',ramdisk_id='',reservation_id='r-fuumtn90',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1737511361',owner_user_name='tempest-TaggedAttachmentsTest-1737511361-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:16:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63d66293fbbb4460a5e181687fc31fe7',uuid=bd32c388-aa78-43ef-ae93-8230b8eba8af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0cf4a358-eb19-49f2-9ce1-9e4ee135805c", "address": "fa:16:3e:fc:11:5e", "network": {"id": "cc1ad5d0-5dc6-43a6-82ac-f94263c8fb20", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1465765696", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4287a7d278844ade94c8b38f8f76087e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf4a358-eb", "ovs_interfaceid": "0cf4a358-eb19-49f2-9ce1-9e4ee135805c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:19:55 user nova-compute[74821]: DEBUG nova.network.os_vif_util [req-cd7e9d99-ac70-40f5-8164-54e3efd22433 req-caf7c32a-d683-420e-8400-435d89922ce8 service nova] Converting VIF {"id": "0cf4a358-eb19-49f2-9ce1-9e4ee135805c", "address": "fa:16:3e:fc:11:5e", "network": {"id": "cc1ad5d0-5dc6-43a6-82ac-f94263c8fb20", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1465765696", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "4287a7d278844ade94c8b38f8f76087e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf4a358-eb", "ovs_interfaceid": "0cf4a358-eb19-49f2-9ce1-9e4ee135805c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:19:55 user nova-compute[74821]: DEBUG nova.network.os_vif_util [req-cd7e9d99-ac70-40f5-8164-54e3efd22433 req-caf7c32a-d683-420e-8400-435d89922ce8 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:11:5e,bridge_name='br-int',has_traffic_filtering=True,id=0cf4a358-eb19-49f2-9ce1-9e4ee135805c,network=Network(cc1ad5d0-5dc6-43a6-82ac-f94263c8fb20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cf4a358-eb') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:19:55 user nova-compute[74821]: DEBUG os_vif [req-cd7e9d99-ac70-40f5-8164-54e3efd22433 req-caf7c32a-d683-420e-8400-435d89922ce8 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:11:5e,bridge_name='br-int',has_traffic_filtering=True,id=0cf4a358-eb19-49f2-9ce1-9e4ee135805c,network=Network(cc1ad5d0-5dc6-43a6-82ac-f94263c8fb20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cf4a358-eb') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:19:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0cf4a358-eb, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:19:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:19:55 user nova-compute[74821]: INFO os_vif [req-cd7e9d99-ac70-40f5-8164-54e3efd22433 req-caf7c32a-d683-420e-8400-435d89922ce8 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:11:5e,bridge_name='br-int',has_traffic_filtering=True,id=0cf4a358-eb19-49f2-9ce1-9e4ee135805c,network=Network(cc1ad5d0-5dc6-43a6-82ac-f94263c8fb20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cf4a358-eb')
Nov 06 13:19:55 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [req-cd7e9d99-ac70-40f5-8164-54e3efd22433 req-caf7c32a-d683-420e-8400-435d89922ce8 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:19:55 user nova-compute[74821]:   <nova:package version="0.0.0"/>
Nov 06 13:19:55 user nova-compute[74821]:   <nova:name>tempest-device-tagging-server-63051430</nova:name>
Nov 06 13:19:55 user nova-compute[74821]:   <nova:creationTime>2023-11-06 13:19:55</nova:creationTime>
Nov 06 13:19:55 user nova-compute[74821]:   <nova:flavor name="m1.tiny">
Nov 06 13:19:55 user nova-compute[74821]:     <nova:memory>512</nova:memory>
Nov 06 13:19:55 user nova-compute[74821]:     <nova:disk>1</nova:disk>
Nov 06 13:19:55 user nova-compute[74821]:     <nova:swap>0</nova:swap>
Nov 06 13:19:55 user nova-compute[74821]:     <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:19:55 user nova-compute[74821]:     <nova:vcpus>1</nova:vcpus>
Nov 06 13:19:55 user nova-compute[74821]:   </nova:flavor>
Nov 06 13:19:55 user nova-compute[74821]:   <nova:owner>
Nov 06 13:19:55 user nova-compute[74821]:     <nova:user uuid="63d66293fbbb4460a5e181687fc31fe7">tempest-TaggedAttachmentsTest-1737511361-project-member</nova:user>
Nov 06 13:19:55 user nova-compute[74821]:     <nova:project uuid="4287a7d278844ade94c8b38f8f76087e">tempest-TaggedAttachmentsTest-1737511361</nova:project>
Nov 06 13:19:55 user nova-compute[74821]:   </nova:owner>
Nov 06 13:19:55 user nova-compute[74821]:   <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:19:55 user nova-compute[74821]:   <nova:ports>
Nov 06 13:19:55 user nova-compute[74821]:     <nova:port uuid="054bfb88-19a2-4241-ae8d-0eded559c233">
Nov 06 13:19:55 user nova-compute[74821]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 13:19:55 user nova-compute[74821]:     </nova:port>
Nov 06 13:19:55 user nova-compute[74821]:   </nova:ports>
Nov 06 13:19:55 user nova-compute[74821]: </nova:instance>
Nov 06 13:19:55 user nova-compute[74821]:  {{(pid=74821) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 06 13:19:55 user nova-compute[74821]: DEBUG nova.network.neutron [None req-b12363c1-637c-41cd-9905-5a176906dfce tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Updating instance_info_cache with network_info: [{"id": "054bfb88-19a2-4241-ae8d-0eded559c233", "address": "fa:16:3e:7e:2a:2d", "network": {"id": "f5b630ec-39d9-4d50-b25a-3d90038e8b32", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-950408673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4287a7d278844ade94c8b38f8f76087e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054bfb88-19", "ovs_interfaceid": "054bfb88-19a2-4241-ae8d-0eded559c233", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:19:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b12363c1-637c-41cd-9905-5a176906dfce tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Releasing lock "refresh_cache-bd32c388-aa78-43ef-ae93-8230b8eba8af" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:19:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b12363c1-637c-41cd-9905-5a176906dfce tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lock "interface-bd32c388-aa78-43ef-ae93-8230b8eba8af-0cf4a358-eb19-49f2-9ce1-9e4ee135805c" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.515s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:19:58 user nova-compute[74821]: DEBUG nova.compute.manager [req-6ec1dfda-08d2-4d89-80de-50f4c864df10 req-8baa823e-4652-481a-88dc-4ee38bfd4a8f service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Received event network-changed-e5ab685a-b1f3-4704-963f-e7db827c947c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:19:58 user nova-compute[74821]: DEBUG nova.compute.manager [req-6ec1dfda-08d2-4d89-80de-50f4c864df10 req-8baa823e-4652-481a-88dc-4ee38bfd4a8f service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Refreshing instance network info cache due to event network-changed-e5ab685a-b1f3-4704-963f-e7db827c947c. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:19:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6ec1dfda-08d2-4d89-80de-50f4c864df10 req-8baa823e-4652-481a-88dc-4ee38bfd4a8f service nova] Acquiring lock "refresh_cache-32e28c73-9e3c-483b-807e-6b286413fe85" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:19:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6ec1dfda-08d2-4d89-80de-50f4c864df10 req-8baa823e-4652-481a-88dc-4ee38bfd4a8f service nova] Acquired lock "refresh_cache-32e28c73-9e3c-483b-807e-6b286413fe85" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:19:58 user nova-compute[74821]: DEBUG nova.network.neutron [req-6ec1dfda-08d2-4d89-80de-50f4c864df10 req-8baa823e-4652-481a-88dc-4ee38bfd4a8f service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Refreshing network info cache for port e5ab685a-b1f3-4704-963f-e7db827c947c {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:19:58 user nova-compute[74821]: DEBUG nova.network.neutron [req-6ec1dfda-08d2-4d89-80de-50f4c864df10 req-8baa823e-4652-481a-88dc-4ee38bfd4a8f service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Updated VIF entry in instance network info cache for port e5ab685a-b1f3-4704-963f-e7db827c947c. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:19:58 user nova-compute[74821]: DEBUG nova.network.neutron [req-6ec1dfda-08d2-4d89-80de-50f4c864df10 req-8baa823e-4652-481a-88dc-4ee38bfd4a8f service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Updating instance_info_cache with network_info: [{"id": "e5ab685a-b1f3-4704-963f-e7db827c947c", "address": "fa:16:3e:d5:da:15", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5ab685a-b1", "ovs_interfaceid": "e5ab685a-b1f3-4704-963f-e7db827c947c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:19:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6ec1dfda-08d2-4d89-80de-50f4c864df10 req-8baa823e-4652-481a-88dc-4ee38bfd4a8f service nova] Releasing lock "refresh_cache-32e28c73-9e3c-483b-807e-6b286413fe85" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:19:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:19:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YQFHhKGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:20:04 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:20:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:20:04 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:20:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:20:04 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7053b4-89a0-4bfd-9ada-127ea6e8bd2e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:20:04 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca15c8b-fb37-4871-a5e1-6f33720eadff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac] added
Nov 06 13:20:04 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5e12fd-54bd-4ed8-b35c-0415d6466538]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de7b9f8-5dd1-44bc-9b17-68ed0dd18a5f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YQFHhKGv {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YQFHhKGv" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1561c6-e0a1-415b-a899-d89ff01a52d4]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YQFHhKGv'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[76351010-fa49-4829-befc-90bd9dd0adc4]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d6616c-581c-4b37-b55f-1079946d920d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 06 13:20:04 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 06 13:20:04 user nova-compute[74821]:  {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:20:04 user nova-compute[74821]: WARNING os_brick.initiator.connectors.iscsi [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 06 13:20:04 user nova-compute[74821]: 
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[24045773-0351-4443-885d-a617ca003109]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac, portal: 172.16.0.220,3260]
Nov 06 13:20:04 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac, portal: 172.16.0.220,3260] successful.
Nov 06 13:20:04 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd572d5-7922-43fb-945b-9d5e08e05cd2]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba92e256-2307-420a-bd55-00fa5ed84900]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac (non-flash)
Nov 06 13:20:04 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac (non-flash)
Nov 06 13:20:04 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8306f828-402b-4de1-990a-92c804ca9ed0]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YQFHhKGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4c6b9b57-c308-4fbc-b42c-a8fa7688aee9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Acquiring lock "f8c537c6-fa3e-4842-9471-7258a22c01f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4c6b9b57-c308-4fbc-b42c-a8fa7688aee9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Lock "f8c537c6-fa3e-4842-9471-7258a22c01f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4c6b9b57-c308-4fbc-b42c-a8fa7688aee9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Acquiring lock "f8c537c6-fa3e-4842-9471-7258a22c01f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4c6b9b57-c308-4fbc-b42c-a8fa7688aee9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Lock "f8c537c6-fa3e-4842-9471-7258a22c01f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4c6b9b57-c308-4fbc-b42c-a8fa7688aee9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Lock "f8c537c6-fa3e-4842-9471-7258a22c01f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:20:04 user nova-compute[74821]: INFO nova.compute.manager [None req-4c6b9b57-c308-4fbc-b42c-a8fa7688aee9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Terminating instance
Nov 06 13:20:04 user nova-compute[74821]: DEBUG nova.compute.manager [None req-4c6b9b57-c308-4fbc-b42c-a8fa7688aee9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:05 user nova-compute[74821]: DEBUG nova.compute.manager [req-24491509-4273-4d31-82ff-8a08bc7ecde9 req-7834191a-125a-4d05-9c01-786dfb7a0bf6 service nova] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Received event network-vif-unplugged-05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:20:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-24491509-4273-4d31-82ff-8a08bc7ecde9 req-7834191a-125a-4d05-9c01-786dfb7a0bf6 service nova] Acquiring lock "f8c537c6-fa3e-4842-9471-7258a22c01f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:20:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-24491509-4273-4d31-82ff-8a08bc7ecde9 req-7834191a-125a-4d05-9c01-786dfb7a0bf6 service nova] Lock "f8c537c6-fa3e-4842-9471-7258a22c01f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:20:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-24491509-4273-4d31-82ff-8a08bc7ecde9 req-7834191a-125a-4d05-9c01-786dfb7a0bf6 service nova] Lock "f8c537c6-fa3e-4842-9471-7258a22c01f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:20:05 user nova-compute[74821]: DEBUG nova.compute.manager [req-24491509-4273-4d31-82ff-8a08bc7ecde9 req-7834191a-125a-4d05-9c01-786dfb7a0bf6 service nova] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] No waiting events found dispatching network-vif-unplugged-05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:20:05 user nova-compute[74821]: DEBUG nova.compute.manager [req-24491509-4273-4d31-82ff-8a08bc7ecde9 req-7834191a-125a-4d05-9c01-786dfb7a0bf6 service nova] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Received event network-vif-unplugged-05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:20:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:05 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Instance destroyed successfully.
Nov 06 13:20:05 user nova-compute[74821]: DEBUG nova.objects.instance [None req-4c6b9b57-c308-4fbc-b42c-a8fa7688aee9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Lazy-loading 'resources' on Instance uuid f8c537c6-fa3e-4842-9471-7258a22c01f9 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:20:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-4c6b9b57-c308-4fbc-b42c-a8fa7688aee9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:10:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2113043381',display_name='tempest-ServersNegativeTestJSON-server-2113043381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2113043381',id=3,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:10:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86724840a9ba4cc486fd1d0d0477c778',ramdisk_id='',reservation_id='r-ur2yz6ar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-835160312',owner_user_name='tempest-ServersNegativeTestJSON-835160312-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:10:46Z,user_data=None,user_id='166c2e871760499ab517261aa874f8da',uuid=f8c537c6-fa3e-4842-9471-7258a22c01f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b", "address": "fa:16:3e:83:64:35", "network": {"id": "d5bae261-3db3-492a-a55e-df6c0fd01fe1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-60002553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86724840a9ba4cc486fd1d0d0477c778", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05f5a65e-3f", "ovs_interfaceid": "05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:20:05 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-4c6b9b57-c308-4fbc-b42c-a8fa7688aee9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Converting VIF {"id": "05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b", "address": "fa:16:3e:83:64:35", "network": {"id": "d5bae261-3db3-492a-a55e-df6c0fd01fe1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-60002553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86724840a9ba4cc486fd1d0d0477c778", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05f5a65e-3f", "ovs_interfaceid": "05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:20:05 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-4c6b9b57-c308-4fbc-b42c-a8fa7688aee9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:64:35,bridge_name='br-int',has_traffic_filtering=True,id=05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b,network=Network(d5bae261-3db3-492a-a55e-df6c0fd01fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05f5a65e-3f') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:20:05 user nova-compute[74821]: DEBUG os_vif [None req-4c6b9b57-c308-4fbc-b42c-a8fa7688aee9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:64:35,bridge_name='br-int',has_traffic_filtering=True,id=05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b,network=Network(d5bae261-3db3-492a-a55e-df6c0fd01fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05f5a65e-3f') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:20:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05f5a65e-3f, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:20:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e04782e1-4fde-4879-abce-8072094714c6) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:20:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:05 user nova-compute[74821]: INFO os_vif [None req-4c6b9b57-c308-4fbc-b42c-a8fa7688aee9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:64:35,bridge_name='br-int',has_traffic_filtering=True,id=05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b,network=Network(d5bae261-3db3-492a-a55e-df6c0fd01fe1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05f5a65e-3f')
Nov 06 13:20:05 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-4c6b9b57-c308-4fbc-b42c-a8fa7688aee9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Deleting instance files /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9_del
Nov 06 13:20:05 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-4c6b9b57-c308-4fbc-b42c-a8fa7688aee9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Deletion of /opt/stack/data/nova/instances/f8c537c6-fa3e-4842-9471-7258a22c01f9_del complete
Nov 06 13:20:05 user nova-compute[74821]: INFO nova.compute.manager [None req-4c6b9b57-c308-4fbc-b42c-a8fa7688aee9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Took 0.79 seconds to destroy the instance on the hypervisor.
Nov 06 13:20:05 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-4c6b9b57-c308-4fbc-b42c-a8fa7688aee9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:20:05 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:20:05 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:20:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:20:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23066333838613630', 'path': '/dev/sdb'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:20:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066333838613630', 'path': '/dev/sdb'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:20:05 user nova-compute[74821]: DEBUG nova.objects.instance [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lazy-loading 'flavor' on Instance uuid 107abf1d-96da-4406-8111-ef0bc09fb3e3 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:20:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 13:20:05 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:20:05 user nova-compute[74821]:   <source dev="/dev/sdb"/>
Nov 06 13:20:05 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:20:05 user nova-compute[74821]:   <serial>744517a5-fbdc-4bf2-bfb3-86217cb180ac</serial>
Nov 06 13:20:05 user nova-compute[74821]: </disk>
Nov 06 13:20:05 user nova-compute[74821]:  {{(pid=74821) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 13:20:06 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:20:06 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Took 0.68 seconds to deallocate network for instance.
Nov 06 13:20:06 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4c6b9b57-c308-4fbc-b42c-a8fa7688aee9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:20:06 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4c6b9b57-c308-4fbc-b42c-a8fa7688aee9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:20:06 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:20:06 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:20:06 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] No VIF found with MAC fa:16:3e:37:94:57, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:20:06 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-457a7db4-02e5-40f0-a151-069f0b9be3bb tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "107abf1d-96da-4406-8111-ef0bc09fb3e3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.459s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:20:06 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:20:06 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TOvStAnd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:20:06 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:20:06 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:20:06 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:20:06 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:20:06 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:20:06 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:20:06 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:20:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:06 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27f3c0f-88e4-473e-bc13-9474a7e36cc2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:06 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:20:06 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:20:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:06 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a88247-c67e-492d-bfe8-bc54af352ace]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:06 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5] added
Nov 06 13:20:06 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:20:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:06 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec41492-8936-48a7-a563-4c9fb87c92f5]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:06 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:20:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:06 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-4c6b9b57-c308-4fbc-b42c-a8fa7688aee9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:20:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:06 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7e178d-b0b2-4f0c-855f-0f2a55a4b04e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:06 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:20:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TOvStAnd {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:06 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-4c6b9b57-c308-4fbc-b42c-a8fa7688aee9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:20:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TOvStAnd" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:06 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0982f3-f496-4a31-9947-c333021857ce]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:06 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TOvStAnd'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:20:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6189a0da-08a4-4ed1-bf9c-f5078bd81221]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4c6b9b57-c308-4fbc-b42c-a8fa7688aee9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.732s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ab7f14-a54d-43ea-96eb-d97121d4c3c1]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac (non-flash)
Nov 06 13:20:07 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac (non-flash)
Nov 06 13:20:07 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:07 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-4c6b9b57-c308-4fbc-b42c-a8fa7688aee9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Deleted allocations for instance f8c537c6-fa3e-4842-9471-7258a22c01f9
Nov 06 13:20:07 user nova-compute[74821]: DEBUG nova.compute.manager [req-3cad7bea-9c84-4dd8-89bf-a407525ab0a7 req-3cfc63a1-bb53-46f4-bf3c-0a9472924ad6 service nova] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Received event network-vif-plugged-05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3cad7bea-9c84-4dd8-89bf-a407525ab0a7 req-3cfc63a1-bb53-46f4-bf3c-0a9472924ad6 service nova] Acquiring lock "f8c537c6-fa3e-4842-9471-7258a22c01f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3cad7bea-9c84-4dd8-89bf-a407525ab0a7 req-3cfc63a1-bb53-46f4-bf3c-0a9472924ad6 service nova] Lock "f8c537c6-fa3e-4842-9471-7258a22c01f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3cad7bea-9c84-4dd8-89bf-a407525ab0a7 req-3cfc63a1-bb53-46f4-bf3c-0a9472924ad6 service nova] Lock "f8c537c6-fa3e-4842-9471-7258a22c01f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG nova.compute.manager [req-3cad7bea-9c84-4dd8-89bf-a407525ab0a7 req-3cfc63a1-bb53-46f4-bf3c-0a9472924ad6 service nova] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] No waiting events found dispatching network-vif-plugged-05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:20:07 user nova-compute[74821]: WARNING nova.compute.manager [req-3cad7bea-9c84-4dd8-89bf-a407525ab0a7 req-3cfc63a1-bb53-46f4-bf3c-0a9472924ad6 service nova] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Received unexpected event network-vif-plugged-05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b for instance with vm_state deleted and task_state None.
Nov 06 13:20:07 user nova-compute[74821]: DEBUG nova.compute.manager [req-3cad7bea-9c84-4dd8-89bf-a407525ab0a7 req-3cfc63a1-bb53-46f4-bf3c-0a9472924ad6 service nova] [instance: f8c537c6-fa3e-4842-9471-7258a22c01f9] Received event network-vif-deleted-05f5a65e-3f00-4df2-8ab3-d7e31ee18d1b {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[795ead55-5ccc-4154-b581-bdec24c1b02c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5, portal: 172.16.0.220,3260]
Nov 06 13:20:07 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5, portal: 172.16.0.220,3260] successful.
Nov 06 13:20:07 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb62d14-71de-4a6e-b0f7-958ce0b79cfd]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e05ad02-7841-4a42-a27c-64df031bc57f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac (non-flash)
Nov 06 13:20:07 user nova-compute[74821]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:20:07 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac (non-flash)
Nov 06 13:20:07 user nova-compute[74821]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:20:07 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4c6b9b57-c308-4fbc-b42c-a8fa7688aee9 tempest-ServersNegativeTestJSON-835160312 tempest-ServersNegativeTestJSON-835160312-project-member] Lock "f8c537c6-fa3e-4842-9471-7258a22c01f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.497s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cd2d6b-f742-4f75-b3dd-dbd28c65f3df]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: None {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Acquiring lock "107abf1d-96da-4406-8111-ef0bc09fb3e3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:20:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "107abf1d-96da-4406-8111-ef0bc09fb3e3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:20:07 user nova-compute[74821]: INFO nova.compute.manager [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Detaching volume 744517a5-fbdc-4bf2-bfb3-86217cb180ac
Nov 06 13:20:08 user nova-compute[74821]: INFO nova.virt.block_device [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Attempting to driver detach volume 744517a5-fbdc-4bf2-bfb3-86217cb180ac from mountpoint /dev/vdb
Nov 06 13:20:08 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Attempting to detach device vdb from instance 107abf1d-96da-4406-8111-ef0bc09fb3e3 from the persistent domain config. {{(pid=74821) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 13:20:08 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:20:08 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:20:08 user nova-compute[74821]:   <source dev="/dev/sdb"/>
Nov 06 13:20:08 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:20:08 user nova-compute[74821]:   <serial>744517a5-fbdc-4bf2-bfb3-86217cb180ac</serial>
Nov 06 13:20:08 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:20:08 user nova-compute[74821]: </disk>
Nov 06 13:20:08 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:20:08 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Successfully detached device vdb from instance 107abf1d-96da-4406-8111-ef0bc09fb3e3 from the persistent domain config.
Nov 06 13:20:08 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 107abf1d-96da-4406-8111-ef0bc09fb3e3 from the live domain config. {{(pid=74821) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 13:20:08 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:20:08 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:20:08 user nova-compute[74821]:   <source dev="/dev/sdb"/>
Nov 06 13:20:08 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:20:08 user nova-compute[74821]:   <serial>744517a5-fbdc-4bf2-bfb3-86217cb180ac</serial>
Nov 06 13:20:08 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:20:08 user nova-compute[74821]: </disk>
Nov 06 13:20:08 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:20:08 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:20:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TOvStAnd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:20:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:20:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '23338383665653566', 'path': '/dev/sdc'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:20:08 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338383665653566', 'path': '/dev/sdc'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:20:08 user nova-compute[74821]: DEBUG nova.objects.instance [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lazy-loading 'flavor' on Instance uuid cc3c1518-c493-41b0-a748-a0ed933c2b1e {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:20:08 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 13:20:08 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:20:08 user nova-compute[74821]:   <source dev="/dev/sdc"/>
Nov 06 13:20:08 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:20:08 user nova-compute[74821]:   <serial>4f5f31c1-284d-4554-ac80-322ddb4146d5</serial>
Nov 06 13:20:08 user nova-compute[74821]: </disk>
Nov 06 13:20:08 user nova-compute[74821]:  {{(pid=74821) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 13:20:08 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 107abf1d-96da-4406-8111-ef0bc09fb3e3 {{(pid=74821) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 13:20:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:20:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:20:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] No VIF found with MAC fa:16:3e:b7:63:5d, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:20:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-17686ade-c955-4735-8f1f-6c5253183a08 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lock "cc3c1518-c493-41b0-a748-a0ed933c2b1e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:20:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c0530f11-602d-4476-9336-1ab7af49cd38 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "32e28c73-9e3c-483b-807e-6b286413fe85" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:20:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c0530f11-602d-4476-9336-1ab7af49cd38 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "32e28c73-9e3c-483b-807e-6b286413fe85" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:20:12 user nova-compute[74821]: INFO nova.compute.manager [None req-c0530f11-602d-4476-9336-1ab7af49cd38 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Shelving
Nov 06 13:20:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-3ce1e1da-f538-49ba-8aa1-d76439bc7de9 req-6f81769f-ea87-4450-9d77-b0f135994fa6 service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Received event network-vif-unplugged-e5ab685a-b1f3-4704-963f-e7db827c947c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:20:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3ce1e1da-f538-49ba-8aa1-d76439bc7de9 req-6f81769f-ea87-4450-9d77-b0f135994fa6 service nova] Acquiring lock "32e28c73-9e3c-483b-807e-6b286413fe85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:20:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3ce1e1da-f538-49ba-8aa1-d76439bc7de9 req-6f81769f-ea87-4450-9d77-b0f135994fa6 service nova] Lock "32e28c73-9e3c-483b-807e-6b286413fe85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:20:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3ce1e1da-f538-49ba-8aa1-d76439bc7de9 req-6f81769f-ea87-4450-9d77-b0f135994fa6 service nova] Lock "32e28c73-9e3c-483b-807e-6b286413fe85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:20:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-3ce1e1da-f538-49ba-8aa1-d76439bc7de9 req-6f81769f-ea87-4450-9d77-b0f135994fa6 service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] No waiting events found dispatching network-vif-unplugged-e5ab685a-b1f3-4704-963f-e7db827c947c {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:20:12 user nova-compute[74821]: WARNING nova.compute.manager [req-3ce1e1da-f538-49ba-8aa1-d76439bc7de9 req-6f81769f-ea87-4450-9d77-b0f135994fa6 service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Received unexpected event network-vif-unplugged-e5ab685a-b1f3-4704-963f-e7db827c947c for instance with vm_state active and task_state shelving.
Nov 06 13:20:13 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Instance destroyed successfully.
Nov 06 13:20:13 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-c0530f11-602d-4476-9336-1ab7af49cd38 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Beginning cold snapshot process
Nov 06 13:20:13 user nova-compute[74821]: DEBUG nova.privsep.utils [None req-c0530f11-602d-4476-9336-1ab7af49cd38 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74821) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 13:20:13 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-c0530f11-602d-4476-9336-1ab7af49cd38 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/disk /opt/stack/data/nova/instances/snapshots/tmpcmqynw9g/ce4ae2c48d504327a8d1c57be806347a {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d5a90086-30ac-476b-9ac9-e8ee7ae32789 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Acquiring lock "cc3c1518-c493-41b0-a748-a0ed933c2b1e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:20:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d5a90086-30ac-476b-9ac9-e8ee7ae32789 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lock "cc3c1518-c493-41b0-a748-a0ed933c2b1e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:20:13 user nova-compute[74821]: DEBUG nova.objects.instance [None req-d5a90086-30ac-476b-9ac9-e8ee7ae32789 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lazy-loading 'flavor' on Instance uuid cc3c1518-c493-41b0-a748-a0ed933c2b1e {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:20:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d5a90086-30ac-476b-9ac9-e8ee7ae32789 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lock "cc3c1518-c493-41b0-a748-a0ed933c2b1e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.165s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:20:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d5a90086-30ac-476b-9ac9-e8ee7ae32789 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Acquiring lock "cc3c1518-c493-41b0-a748-a0ed933c2b1e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:20:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d5a90086-30ac-476b-9ac9-e8ee7ae32789 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lock "cc3c1518-c493-41b0-a748-a0ed933c2b1e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:20:14 user nova-compute[74821]: INFO nova.compute.manager [None req-d5a90086-30ac-476b-9ac9-e8ee7ae32789 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Attaching volume 076a6552-9c88-47f5-990a-fe847fda7b71 to /dev/vdc
Nov 06 13:20:14 user nova-compute[74821]: DEBUG os_brick.utils [None req-d5a90086-30ac-476b-9ac9-e8ee7ae32789 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:20:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:14 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fb2437-0368-450a-9369-87b5d9e064cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:14 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b26298-833f-4344-8525-8e4e0142af44]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:14 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:14 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[078e02a5-7c96-4b42-92e6-43fa278431a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:14 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ca1853-9ed1-4c88-b672-06106fb3cd6e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-d5a90086-30ac-476b-9ac9-e8ee7ae32789 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-d5a90086-30ac-476b-9ac9-e8ee7ae32789 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:20:14 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5a90086-30ac-476b-9ac9-e8ee7ae32789 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:20:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:20:14 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:20:14 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7cfebe-4de7-4a1d-bae3-b0eb694ed30d]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:14 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-d5a90086-30ac-476b-9ac9-e8ee7ae32789 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:20:14 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-d5a90086-30ac-476b-9ac9-e8ee7ae32789 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:20:14 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-d5a90086-30ac-476b-9ac9-e8ee7ae32789 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:20:14 user nova-compute[74821]: DEBUG os_brick.utils [None req-d5a90086-30ac-476b-9ac9-e8ee7ae32789 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:20:14 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-d5a90086-30ac-476b-9ac9-e8ee7ae32789 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Updating existing volume attachment record: bccf5e3c-bc6a-4585-87b2-b265804277eb {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:20:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-c0530f11-602d-4476-9336-1ab7af49cd38 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/disk /opt/stack/data/nova/instances/snapshots/tmpcmqynw9g/ce4ae2c48d504327a8d1c57be806347a" returned: 0 in 1.183s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:14 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-c0530f11-602d-4476-9336-1ab7af49cd38 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Snapshot extracted, beginning image upload
Nov 06 13:20:14 user nova-compute[74821]: DEBUG nova.compute.manager [req-8749eae0-0fc8-450f-afee-cfe681a71a34 req-6fbde6dc-d32e-434b-b783-16e9b3e2ef4f service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Received event network-vif-plugged-e5ab685a-b1f3-4704-963f-e7db827c947c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:20:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8749eae0-0fc8-450f-afee-cfe681a71a34 req-6fbde6dc-d32e-434b-b783-16e9b3e2ef4f service nova] Acquiring lock "32e28c73-9e3c-483b-807e-6b286413fe85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:20:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8749eae0-0fc8-450f-afee-cfe681a71a34 req-6fbde6dc-d32e-434b-b783-16e9b3e2ef4f service nova] Lock "32e28c73-9e3c-483b-807e-6b286413fe85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:20:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8749eae0-0fc8-450f-afee-cfe681a71a34 req-6fbde6dc-d32e-434b-b783-16e9b3e2ef4f service nova] Lock "32e28c73-9e3c-483b-807e-6b286413fe85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:20:14 user nova-compute[74821]: DEBUG nova.compute.manager [req-8749eae0-0fc8-450f-afee-cfe681a71a34 req-6fbde6dc-d32e-434b-b783-16e9b3e2ef4f service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] No waiting events found dispatching network-vif-plugged-e5ab685a-b1f3-4704-963f-e7db827c947c {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:20:14 user nova-compute[74821]: WARNING nova.compute.manager [req-8749eae0-0fc8-450f-afee-cfe681a71a34 req-6fbde6dc-d32e-434b-b783-16e9b3e2ef4f service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Received unexpected event network-vif-plugged-e5ab685a-b1f3-4704-963f-e7db827c947c for instance with vm_state active and task_state shelving_image_uploading.
Nov 06 13:20:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG nova.compute.manager [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:20:15 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Creating image(s)
Nov 06 13:20:15 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Did not create local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Ensure instance console log exists: /opt/stack/data/nova/instances/496f8213-4b32-4211-a354-e33a4a088848/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Start _get_guest_xml network_info=[{"id": "0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc", "address": "fa:16:3e:de:d4:5d", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dbd0a11-07", "ovs_interfaceid": "0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gVPeKGMQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '496f8213-4b32-4211-a354-e33a4a088848', 'attached_at': '', 'detached_at': '', 'volume_id': '4739d8fa-3170-46f4-ac61-fa0fe6aa4979', 'serial': '4739d8fa-3170-46f4-ac61-fa0fe6aa4979'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '198cb9d2-0a76-4638-a87f-752ba260b760', 'volume_type': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:20:15 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:20:15 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:20:15 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gVPeKGMQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:20:15 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:20:15 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:20:15 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:20:15 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:20:15 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:20:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfed8a07-c869-44af-b40e-621b5c7d06f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:20:15 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b8610a-0d01-462b-a122-76b039de2a3d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979] added
Nov 06 13:20:15 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1a2e1f-0b4a-4e09-9b37-729bb8d8d791]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6241cb6-2f25-4630-98ac-f9f0ff0a61a2]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gVPeKGMQ {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gVPeKGMQ" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f61fe2-d6ff-4ff5-b787-ea42856ef3b5]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gVPeKGMQ'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b27ba1-0766-4756-883a-c55e9e217905]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d4611f-1405-429d-9448-e822e6604fac]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac (non-flash)
Nov 06 13:20:15 user nova-compute[74821]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:20:15 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac (non-flash)
Nov 06 13:20:15 user nova-compute[74821]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:20:15 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:20:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47033bc-265b-4a25-8af9-008e6e6f0c74]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979, portal: 172.16.0.220,3260]
Nov 06 13:20:16 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979, portal: 172.16.0.220,3260] successful.
Nov 06 13:20:16 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:20:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9975a114-9870-48e8-a4a6-3e3075f3bdcf]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:20:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d65765-3cdb-409a-a330-6e83b085f684]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac (non-flash)
Nov 06 13:20:16 user nova-compute[74821]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:20:16 user nova-compute[74821]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:20:16 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:20:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac (non-flash)
Nov 06 13:20:16 user nova-compute[74821]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:20:16 user nova-compute[74821]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:20:16 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:20:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:20:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:20:16 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:20:16 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:20:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d40ddf-f829-4863-9beb-1d832c6af591]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:16 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: None {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:20:17 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:20:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gVPeKGMQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:20:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:20:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23135386335313936', 'path': '/dev/sdd'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:20:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135386335313936', 'path': '/dev/sdd'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:20:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:19:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-980291330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-980291330',id=24,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f745a322931e4150b12d139bfb17b94c',ramdisk_id='',reservation_id='r-ed18rll4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1064633830',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:19:40Z,user_data=None,user_id='133932d1063241078d84731624e89216',uuid=496f8213-4b32-4211-a354-e33a4a088848,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc", "address": "fa:16:3e:de:d4:5d", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dbd0a11-07", "ovs_interfaceid": "0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:20:17 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Converting VIF {"id": "0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc", "address": "fa:16:3e:de:d4:5d", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dbd0a11-07", "ovs_interfaceid": "0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:20:17 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:d4:5d,bridge_name='br-int',has_traffic_filtering=True,id=0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc,network=Network(354bf335-0cac-46d9-acb8-5095411f5db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dbd0a11-07') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:20:17 user nova-compute[74821]: DEBUG nova.objects.instance [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lazy-loading 'pci_devices' on Instance uuid 496f8213-4b32-4211-a354-e33a4a088848 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:20:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:20:17 user nova-compute[74821]:   <uuid>496f8213-4b32-4211-a354-e33a4a088848</uuid>
Nov 06 13:20:17 user nova-compute[74821]:   <name>instance-00000018</name>
Nov 06 13:20:17 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:20:17 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:20:17 user nova-compute[74821]:   <metadata>
Nov 06 13:20:17 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:20:17 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:20:17 user nova-compute[74821]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-980291330</nova:name>
Nov 06 13:20:17 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:20:15</nova:creationTime>
Nov 06 13:20:17 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:20:17 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:20:17 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:20:17 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:20:17 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:20:17 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:20:17 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:20:17 user nova-compute[74821]:       <nova:owner>
Nov 06 13:20:17 user nova-compute[74821]:         <nova:user uuid="133932d1063241078d84731624e89216">tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member</nova:user>
Nov 06 13:20:17 user nova-compute[74821]:         <nova:project uuid="f745a322931e4150b12d139bfb17b94c">tempest-ServerBootFromVolumeStableRescueTest-1064633830</nova:project>
Nov 06 13:20:17 user nova-compute[74821]:       </nova:owner>
Nov 06 13:20:17 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:20:17 user nova-compute[74821]:       <nova:ports>
Nov 06 13:20:17 user nova-compute[74821]:         <nova:port uuid="0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc">
Nov 06 13:20:17 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 06 13:20:17 user nova-compute[74821]:         </nova:port>
Nov 06 13:20:17 user nova-compute[74821]:       </nova:ports>
Nov 06 13:20:17 user nova-compute[74821]:     </nova:instance>
Nov 06 13:20:17 user nova-compute[74821]:   </metadata>
Nov 06 13:20:17 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:20:17 user nova-compute[74821]:     <system>
Nov 06 13:20:17 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:20:17 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:20:17 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:20:17 user nova-compute[74821]:       <entry name="serial">496f8213-4b32-4211-a354-e33a4a088848</entry>
Nov 06 13:20:17 user nova-compute[74821]:       <entry name="uuid">496f8213-4b32-4211-a354-e33a4a088848</entry>
Nov 06 13:20:17 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:20:17 user nova-compute[74821]:     </system>
Nov 06 13:20:17 user nova-compute[74821]:   </sysinfo>
Nov 06 13:20:17 user nova-compute[74821]:   <os>
Nov 06 13:20:17 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:20:17 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:20:17 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:20:17 user nova-compute[74821]:   </os>
Nov 06 13:20:17 user nova-compute[74821]:   <features>
Nov 06 13:20:17 user nova-compute[74821]:     <acpi/>
Nov 06 13:20:17 user nova-compute[74821]:     <apic/>
Nov 06 13:20:17 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:20:17 user nova-compute[74821]:   </features>
Nov 06 13:20:17 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:20:17 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:20:17 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:20:17 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:20:17 user nova-compute[74821]:   </clock>
Nov 06 13:20:17 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:20:17 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:20:17 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:20:17 user nova-compute[74821]:   </cpu>
Nov 06 13:20:17 user nova-compute[74821]:   <devices>
Nov 06 13:20:17 user nova-compute[74821]:     <disk type="block" device="disk">
Nov 06 13:20:17 user nova-compute[74821]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:20:17 user nova-compute[74821]:       <source dev="/dev/sdd"/>
Nov 06 13:20:17 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:20:17 user nova-compute[74821]:       <serial>4739d8fa-3170-46f4-ac61-fa0fe6aa4979</serial>
Nov 06 13:20:17 user nova-compute[74821]:     </disk>
Nov 06 13:20:17 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:20:17 user nova-compute[74821]:       <mac address="fa:16:3e:de:d4:5d"/>
Nov 06 13:20:17 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:20:17 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:20:17 user nova-compute[74821]:       <target dev="tap0dbd0a11-07"/>
Nov 06 13:20:17 user nova-compute[74821]:     </interface>
Nov 06 13:20:17 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:20:17 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/496f8213-4b32-4211-a354-e33a4a088848/console.log" append="off"/>
Nov 06 13:20:17 user nova-compute[74821]:     </serial>
Nov 06 13:20:17 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:20:17 user nova-compute[74821]:     <video>
Nov 06 13:20:17 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:20:17 user nova-compute[74821]:     </video>
Nov 06 13:20:17 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:20:17 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:20:17 user nova-compute[74821]:     </rng>
Nov 06 13:20:17 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:20:17 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:20:17 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:20:17 user nova-compute[74821]:     </memballoon>
Nov 06 13:20:17 user nova-compute[74821]:   </devices>
Nov 06 13:20:17 user nova-compute[74821]: </domain>
Nov 06 13:20:17 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:20:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:19:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-980291330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-980291330',id=24,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f745a322931e4150b12d139bfb17b94c',ramdisk_id='',reservation_id='r-ed18rll4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1064633830',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:19:40Z,user_data=None,user_id='133932d1063241078d84731624e89216',uuid=496f8213-4b32-4211-a354-e33a4a088848,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc", "address": "fa:16:3e:de:d4:5d", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dbd0a11-07", "ovs_interfaceid": "0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:20:17 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Converting VIF {"id": "0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc", "address": "fa:16:3e:de:d4:5d", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dbd0a11-07", "ovs_interfaceid": "0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:20:17 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:d4:5d,bridge_name='br-int',has_traffic_filtering=True,id=0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc,network=Network(354bf335-0cac-46d9-acb8-5095411f5db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dbd0a11-07') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:20:17 user nova-compute[74821]: DEBUG os_vif [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:d4:5d,bridge_name='br-int',has_traffic_filtering=True,id=0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc,network=Network(354bf335-0cac-46d9-acb8-5095411f5db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dbd0a11-07') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:20:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:20:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:20:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8c479a5c-11b1-5f42-a371-5f7774c87da8', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:20:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:20:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0dbd0a11-07, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:20:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0dbd0a11-07, col_values=(('qos', UUID('b0e28180-2cc8-43cf-b8ef-f0bd539bb816')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:20:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0dbd0a11-07, col_values=(('external_ids', {'iface-id': '0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:d4:5d', 'vm-uuid': '496f8213-4b32-4211-a354-e33a4a088848'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:20:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:20:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:17 user nova-compute[74821]: INFO os_vif [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:d4:5d,bridge_name='br-int',has_traffic_filtering=True,id=0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc,network=Network(354bf335-0cac-46d9-acb8-5095411f5db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dbd0a11-07')
Nov 06 13:20:17 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-c0530f11-602d-4476-9336-1ab7af49cd38 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Snapshot image upload complete
Nov 06 13:20:17 user nova-compute[74821]: DEBUG nova.compute.manager [None req-c0530f11-602d-4476-9336-1ab7af49cd38 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:20:17 user nova-compute[74821]: INFO nova.compute.manager [None req-c0530f11-602d-4476-9336-1ab7af49cd38 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Shelve offloading
Nov 06 13:20:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:20:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] No VIF found with MAC fa:16:3e:de:d4:5d, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:20:17 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Instance destroyed successfully.
Nov 06 13:20:17 user nova-compute[74821]: DEBUG nova.compute.manager [None req-c0530f11-602d-4476-9336-1ab7af49cd38 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:20:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c0530f11-602d-4476-9336-1ab7af49cd38 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "refresh_cache-32e28c73-9e3c-483b-807e-6b286413fe85" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:20:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c0530f11-602d-4476-9336-1ab7af49cd38 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquired lock "refresh_cache-32e28c73-9e3c-483b-807e-6b286413fe85" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:20:17 user nova-compute[74821]: DEBUG nova.network.neutron [None req-c0530f11-602d-4476-9336-1ab7af49cd38 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:20:17 user nova-compute[74821]: DEBUG nova.network.neutron [None req-c0530f11-602d-4476-9336-1ab7af49cd38 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Updating instance_info_cache with network_info: [{"id": "e5ab685a-b1f3-4704-963f-e7db827c947c", "address": "fa:16:3e:d5:da:15", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5ab685a-b1", "ovs_interfaceid": "e5ab685a-b1f3-4704-963f-e7db827c947c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:20:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c0530f11-602d-4476-9336-1ab7af49cd38 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Releasing lock "refresh_cache-32e28c73-9e3c-483b-807e-6b286413fe85" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:20:18 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Instance destroyed successfully.
Nov 06 13:20:18 user nova-compute[74821]: DEBUG nova.objects.instance [None req-c0530f11-602d-4476-9336-1ab7af49cd38 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lazy-loading 'resources' on Instance uuid 32e28c73-9e3c-483b-807e-6b286413fe85 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:20:18 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-c0530f11-602d-4476-9336-1ab7af49cd38 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:18:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1563572892',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1563572892',id=20,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEKYnXFLTR+2m8MV2bSy0f782O0BpwK/RW9xjhqlDgMuS85GEfW33cGEVy0+mivD0qgHHUJxCnGxmI4hcaL9bxGOgc60B0tHzOrPILwiUdfVhUEozjAJjaiVLjCwtIusA==',key_name='tempest-keypair-724006026',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:18:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='07250ce4ef1b429f8a5c3c7763866763',ramdisk_id='',reservation_id='r-d03fj2ad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-374688010',owner_user_name='tempest-AttachVolumeShelveTestJSON-374688010-project-member',shelved_at='2023-11-06T13:20:17.262236',shelved_host='user',shelved_image_id='72dd78d5-3a17-4f1e-a15c-d0de40ace806'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:20:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c82a5e63234e40f6a8e63b3cb4dc97b3',uuid=32e28c73-9e3c-483b-807e-6b286413fe85,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "e5ab685a-b1f3-4704-963f-e7db827c947c", "address": "fa:16:3e:d5:da:15", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5ab685a-b1", "ovs_interfaceid": "e5ab685a-b1f3-4704-963f-e7db827c947c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:20:18 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-c0530f11-602d-4476-9336-1ab7af49cd38 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Converting VIF {"id": "e5ab685a-b1f3-4704-963f-e7db827c947c", "address": "fa:16:3e:d5:da:15", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5ab685a-b1", "ovs_interfaceid": "e5ab685a-b1f3-4704-963f-e7db827c947c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:20:18 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-c0530f11-602d-4476-9336-1ab7af49cd38 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:da:15,bridge_name='br-int',has_traffic_filtering=True,id=e5ab685a-b1f3-4704-963f-e7db827c947c,network=Network(5318228c-491a-4ea1-a2b2-49ea8e15dccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5ab685a-b1') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:20:18 user nova-compute[74821]: DEBUG os_vif [None req-c0530f11-602d-4476-9336-1ab7af49cd38 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:da:15,bridge_name='br-int',has_traffic_filtering=True,id=e5ab685a-b1f3-4704-963f-e7db827c947c,network=Network(5318228c-491a-4ea1-a2b2-49ea8e15dccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5ab685a-b1') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:20:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:18 user nova-compute[74821]: DEBUG nova.compute.manager [req-7d053b61-f310-48b3-b1c8-20730b6be30e req-517af2e6-16d7-4e89-a326-51c0e8c045b0 service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Received event network-changed-e5ab685a-b1f3-4704-963f-e7db827c947c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:20:18 user nova-compute[74821]: DEBUG nova.compute.manager [req-7d053b61-f310-48b3-b1c8-20730b6be30e req-517af2e6-16d7-4e89-a326-51c0e8c045b0 service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Refreshing instance network info cache due to event network-changed-e5ab685a-b1f3-4704-963f-e7db827c947c. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:20:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-7d053b61-f310-48b3-b1c8-20730b6be30e req-517af2e6-16d7-4e89-a326-51c0e8c045b0 service nova] Acquiring lock "refresh_cache-32e28c73-9e3c-483b-807e-6b286413fe85" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:20:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-7d053b61-f310-48b3-b1c8-20730b6be30e req-517af2e6-16d7-4e89-a326-51c0e8c045b0 service nova] Acquired lock "refresh_cache-32e28c73-9e3c-483b-807e-6b286413fe85" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:20:18 user nova-compute[74821]: DEBUG nova.network.neutron [req-7d053b61-f310-48b3-b1c8-20730b6be30e req-517af2e6-16d7-4e89-a326-51c0e8c045b0 service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Refreshing network info cache for port e5ab685a-b1f3-4704-963f-e7db827c947c {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:20:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5ab685a-b1, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:20:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:20:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ce6fea42-b615-4049-afec-ea64083947ea) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:20:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:20:18 user nova-compute[74821]: INFO os_vif [None req-c0530f11-602d-4476-9336-1ab7af49cd38 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:da:15,bridge_name='br-int',has_traffic_filtering=True,id=e5ab685a-b1f3-4704-963f-e7db827c947c,network=Network(5318228c-491a-4ea1-a2b2-49ea8e15dccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5ab685a-b1')
Nov 06 13:20:18 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-c0530f11-602d-4476-9336-1ab7af49cd38 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Deleting instance files /opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85_del
Nov 06 13:20:18 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-c0530f11-602d-4476-9336-1ab7af49cd38 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Deletion of /opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85_del complete
Nov 06 13:20:19 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-c0530f11-602d-4476-9336-1ab7af49cd38 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Deleted allocations for instance 32e28c73-9e3c-483b-807e-6b286413fe85
Nov 06 13:20:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c0530f11-602d-4476-9336-1ab7af49cd38 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:20:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c0530f11-602d-4476-9336-1ab7af49cd38 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:20:19 user nova-compute[74821]: DEBUG nova.objects.instance [None req-c0530f11-602d-4476-9336-1ab7af49cd38 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lazy-loading 'numa_topology' on Instance uuid 32e28c73-9e3c-483b-807e-6b286413fe85 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:20:19 user nova-compute[74821]: DEBUG nova.objects.base [None req-c0530f11-602d-4476-9336-1ab7af49cd38 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Object Instance<32e28c73-9e3c-483b-807e-6b286413fe85> lazy-loaded attributes: resources,numa_topology {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:20:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:19 user nova-compute[74821]: DEBUG nova.network.neutron [req-7d053b61-f310-48b3-b1c8-20730b6be30e req-517af2e6-16d7-4e89-a326-51c0e8c045b0 service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Updated VIF entry in instance network info cache for port e5ab685a-b1f3-4704-963f-e7db827c947c. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:20:19 user nova-compute[74821]: DEBUG nova.network.neutron [req-7d053b61-f310-48b3-b1c8-20730b6be30e req-517af2e6-16d7-4e89-a326-51c0e8c045b0 service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Updating instance_info_cache with network_info: [{"id": "e5ab685a-b1f3-4704-963f-e7db827c947c", "address": "fa:16:3e:d5:da:15", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tape5ab685a-b1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:20:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-7d053b61-f310-48b3-b1c8-20730b6be30e req-517af2e6-16d7-4e89-a326-51c0e8c045b0 service nova] Releasing lock "refresh_cache-32e28c73-9e3c-483b-807e-6b286413fe85" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:20:19 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-c0530f11-602d-4476-9336-1ab7af49cd38 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:20:19 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-c0530f11-602d-4476-9336-1ab7af49cd38 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:20:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c0530f11-602d-4476-9336-1ab7af49cd38 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.547s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:20:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c0530f11-602d-4476-9336-1ab7af49cd38 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "32e28c73-9e3c-483b-807e-6b286413fe85" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.369s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:20:20 user nova-compute[74821]: DEBUG nova.compute.manager [req-67a3a5d9-c821-4b08-994d-ecec0805b541 req-55a455c8-59c7-4fbe-9394-e833943c5686 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Received event network-vif-plugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:20:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-67a3a5d9-c821-4b08-994d-ecec0805b541 req-55a455c8-59c7-4fbe-9394-e833943c5686 service nova] Acquiring lock "496f8213-4b32-4211-a354-e33a4a088848-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:20:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-67a3a5d9-c821-4b08-994d-ecec0805b541 req-55a455c8-59c7-4fbe-9394-e833943c5686 service nova] Lock "496f8213-4b32-4211-a354-e33a4a088848-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:20:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-67a3a5d9-c821-4b08-994d-ecec0805b541 req-55a455c8-59c7-4fbe-9394-e833943c5686 service nova] Lock "496f8213-4b32-4211-a354-e33a4a088848-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:20:20 user nova-compute[74821]: DEBUG nova.compute.manager [req-67a3a5d9-c821-4b08-994d-ecec0805b541 req-55a455c8-59c7-4fbe-9394-e833943c5686 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] No waiting events found dispatching network-vif-plugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:20:20 user nova-compute[74821]: WARNING nova.compute.manager [req-67a3a5d9-c821-4b08-994d-ecec0805b541 req-55a455c8-59c7-4fbe-9394-e833943c5686 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Received unexpected event network-vif-plugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc for instance with vm_state building and task_state spawning.
Nov 06 13:20:20 user nova-compute[74821]: DEBUG nova.compute.manager [req-67a3a5d9-c821-4b08-994d-ecec0805b541 req-55a455c8-59c7-4fbe-9394-e833943c5686 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Received event network-vif-plugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:20:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-67a3a5d9-c821-4b08-994d-ecec0805b541 req-55a455c8-59c7-4fbe-9394-e833943c5686 service nova] Acquiring lock "496f8213-4b32-4211-a354-e33a4a088848-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:20:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-67a3a5d9-c821-4b08-994d-ecec0805b541 req-55a455c8-59c7-4fbe-9394-e833943c5686 service nova] Lock "496f8213-4b32-4211-a354-e33a4a088848-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:20:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-67a3a5d9-c821-4b08-994d-ecec0805b541 req-55a455c8-59c7-4fbe-9394-e833943c5686 service nova] Lock "496f8213-4b32-4211-a354-e33a4a088848-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:20:20 user nova-compute[74821]: DEBUG nova.compute.manager [req-67a3a5d9-c821-4b08-994d-ecec0805b541 req-55a455c8-59c7-4fbe-9394-e833943c5686 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] No waiting events found dispatching network-vif-plugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:20:20 user nova-compute[74821]: WARNING nova.compute.manager [req-67a3a5d9-c821-4b08-994d-ecec0805b541 req-55a455c8-59c7-4fbe-9394-e833943c5686 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Received unexpected event network-vif-plugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc for instance with vm_state building and task_state spawning.
Nov 06 13:20:21 user nova-compute[74821]: DEBUG nova.compute.manager [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:20:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:20:21 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Instance spawned successfully.
Nov 06 13:20:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:20:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:20:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:20:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:20:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:20:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:20:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:20:21 user nova-compute[74821]: INFO nova.compute.manager [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Took 5.61 seconds to spawn the instance on the hypervisor.
Nov 06 13:20:21 user nova-compute[74821]: DEBUG nova.compute.manager [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:20:21 user nova-compute[74821]: INFO nova.compute.manager [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Took 42.62 seconds to build instance.
Nov 06 13:20:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7ab68301-613d-4952-9ccb-a7ca527fe338 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "496f8213-4b32-4211-a354-e33a4a088848" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.838s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:20:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:24 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:20:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-709042cc-15f6-45fe-b1e8-7743667680bb tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Acquiring lock "bd32c388-aa78-43ef-ae93-8230b8eba8af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:20:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-709042cc-15f6-45fe-b1e8-7743667680bb tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lock "bd32c388-aa78-43ef-ae93-8230b8eba8af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:20:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-709042cc-15f6-45fe-b1e8-7743667680bb tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Acquiring lock "bd32c388-aa78-43ef-ae93-8230b8eba8af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:20:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-709042cc-15f6-45fe-b1e8-7743667680bb tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lock "bd32c388-aa78-43ef-ae93-8230b8eba8af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:20:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-709042cc-15f6-45fe-b1e8-7743667680bb tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lock "bd32c388-aa78-43ef-ae93-8230b8eba8af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:20:25 user nova-compute[74821]: INFO nova.compute.manager [None req-709042cc-15f6-45fe-b1e8-7743667680bb tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Terminating instance
Nov 06 13:20:25 user nova-compute[74821]: DEBUG nova.compute.manager [None req-709042cc-15f6-45fe-b1e8-7743667680bb tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:20:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:25 user nova-compute[74821]: DEBUG nova.compute.manager [req-409fb8a9-481d-422c-9078-d5ea75973baf req-f98b5071-5192-41f2-91bd-035bc5eb0f1f service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Received event network-vif-unplugged-054bfb88-19a2-4241-ae8d-0eded559c233 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:20:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-409fb8a9-481d-422c-9078-d5ea75973baf req-f98b5071-5192-41f2-91bd-035bc5eb0f1f service nova] Acquiring lock "bd32c388-aa78-43ef-ae93-8230b8eba8af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:20:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-409fb8a9-481d-422c-9078-d5ea75973baf req-f98b5071-5192-41f2-91bd-035bc5eb0f1f service nova] Lock "bd32c388-aa78-43ef-ae93-8230b8eba8af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:20:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-409fb8a9-481d-422c-9078-d5ea75973baf req-f98b5071-5192-41f2-91bd-035bc5eb0f1f service nova] Lock "bd32c388-aa78-43ef-ae93-8230b8eba8af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:20:25 user nova-compute[74821]: DEBUG nova.compute.manager [req-409fb8a9-481d-422c-9078-d5ea75973baf req-f98b5071-5192-41f2-91bd-035bc5eb0f1f service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] No waiting events found dispatching network-vif-unplugged-054bfb88-19a2-4241-ae8d-0eded559c233 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:20:25 user nova-compute[74821]: DEBUG nova.compute.manager [req-409fb8a9-481d-422c-9078-d5ea75973baf req-f98b5071-5192-41f2-91bd-035bc5eb0f1f service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Received event network-vif-unplugged-054bfb88-19a2-4241-ae8d-0eded559c233 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:20:25 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Instance destroyed successfully.
Nov 06 13:20:25 user nova-compute[74821]: DEBUG nova.objects.instance [None req-709042cc-15f6-45fe-b1e8-7743667680bb tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lazy-loading 'resources' on Instance uuid bd32c388-aa78-43ef-ae93-8230b8eba8af {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:20:25 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-709042cc-15f6-45fe-b1e8-7743667680bb tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-06T13:16:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-63051430',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-63051430',id=17,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTKqcTwYkCQENDzProvGIMFtMqaS+G/n1Hbl3a5LzTI2xbz3a2W94HTVkp4RevkFUNv1QjLjHpnVGJBeVEJild17QwHehxxe7AL3LQT4P27u7Ru79l65cMDiX2/YAksMA==',key_name='tempest-keypair-1412532163',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:16:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4287a7d278844ade94c8b38f8f76087e',ramdisk_id='',reservation_id='r-fuumtn90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1737511361',owner_user_name='tempest-TaggedAttachmentsTest-1737511361-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:16:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63d66293fbbb4460a5e181687fc31fe7',uuid=bd32c388-aa78-43ef-ae93-8230b8eba8af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "054bfb88-19a2-4241-ae8d-0eded559c233", "address": "fa:16:3e:7e:2a:2d", "network": {"id": "f5b630ec-39d9-4d50-b25a-3d90038e8b32", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-950408673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4287a7d278844ade94c8b38f8f76087e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054bfb88-19", "ovs_interfaceid": "054bfb88-19a2-4241-ae8d-0eded559c233", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:20:25 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-709042cc-15f6-45fe-b1e8-7743667680bb tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Converting VIF {"id": "054bfb88-19a2-4241-ae8d-0eded559c233", "address": "fa:16:3e:7e:2a:2d", "network": {"id": "f5b630ec-39d9-4d50-b25a-3d90038e8b32", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-950408673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4287a7d278844ade94c8b38f8f76087e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap054bfb88-19", "ovs_interfaceid": "054bfb88-19a2-4241-ae8d-0eded559c233", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:20:25 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-709042cc-15f6-45fe-b1e8-7743667680bb tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:2a:2d,bridge_name='br-int',has_traffic_filtering=True,id=054bfb88-19a2-4241-ae8d-0eded559c233,network=Network(f5b630ec-39d9-4d50-b25a-3d90038e8b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap054bfb88-19') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:20:25 user nova-compute[74821]: DEBUG os_vif [None req-709042cc-15f6-45fe-b1e8-7743667680bb tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:2a:2d,bridge_name='br-int',has_traffic_filtering=True,id=054bfb88-19a2-4241-ae8d-0eded559c233,network=Network(f5b630ec-39d9-4d50-b25a-3d90038e8b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap054bfb88-19') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:20:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap054bfb88-19, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:20:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9a420d35-a360-47aa-ab9f-ab00354402c3) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:20:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:25 user nova-compute[74821]: INFO os_vif [None req-709042cc-15f6-45fe-b1e8-7743667680bb tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:2a:2d,bridge_name='br-int',has_traffic_filtering=True,id=054bfb88-19a2-4241-ae8d-0eded559c233,network=Network(f5b630ec-39d9-4d50-b25a-3d90038e8b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap054bfb88-19')
Nov 06 13:20:25 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-709042cc-15f6-45fe-b1e8-7743667680bb tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Deleting instance files /opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af_del
Nov 06 13:20:25 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-709042cc-15f6-45fe-b1e8-7743667680bb tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Deletion of /opt/stack/data/nova/instances/bd32c388-aa78-43ef-ae93-8230b8eba8af_del complete
Nov 06 13:20:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Acquiring lock "be3cb35a-d45e-4e35-96fe-437a941c0244" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:20:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "be3cb35a-d45e-4e35-96fe-437a941c0244" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:20:26 user nova-compute[74821]: INFO nova.compute.manager [None req-709042cc-15f6-45fe-b1e8-7743667680bb tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 06 13:20:26 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-709042cc-15f6-45fe-b1e8-7743667680bb tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:20:26 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:20:26 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:20:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:20:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:20:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:20:26 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:20:26 user nova-compute[74821]: INFO nova.compute.claims [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Claim successful on node user
Nov 06 13:20:26 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:20:26 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:20:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.530s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:20:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:20:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:20:26 user nova-compute[74821]: DEBUG nova.network.neutron [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:20:26 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:20:26 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:20:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:20:26 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Took 0.78 seconds to deallocate network for instance.
Nov 06 13:20:26 user nova-compute[74821]: DEBUG nova.compute.manager [req-43d51c8c-689a-4796-b3d3-0b2d9476c518 req-a5fff04a-f639-48ee-afa7-f1011fd90973 service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Received event network-vif-deleted-054bfb88-19a2-4241-ae8d-0eded559c233 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:20:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-709042cc-15f6-45fe-b1e8-7743667680bb tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:20:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-709042cc-15f6-45fe-b1e8-7743667680bb tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:20:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:20:26 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:20:26 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Creating image(s)
Nov 06 13:20:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Acquiring lock "/opt/stack/data/nova/instances/be3cb35a-d45e-4e35-96fe-437a941c0244/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:20:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "/opt/stack/data/nova/instances/be3cb35a-d45e-4e35-96fe-437a941c0244/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:20:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "/opt/stack/data/nova/instances/be3cb35a-d45e-4e35-96fe-437a941c0244/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:20:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:26 user nova-compute[74821]: DEBUG nova.policy [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d34c030545b43f8a1ab4d071189d7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f25eb95045d145c99d728e5d007ec1b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:20:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.210s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:20:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:20:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:27 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-709042cc-15f6-45fe-b1e8-7743667680bb tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:20:27 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-709042cc-15f6-45fe-b1e8-7743667680bb tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:20:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.240s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/be3cb35a-d45e-4e35-96fe-437a941c0244/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-709042cc-15f6-45fe-b1e8-7743667680bb tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.584s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:20:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/be3cb35a-d45e-4e35-96fe-437a941c0244/disk 1073741824" returned: 0 in 0.072s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.317s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:20:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:27 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-709042cc-15f6-45fe-b1e8-7743667680bb tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Deleted allocations for instance bd32c388-aa78-43ef-ae93-8230b8eba8af
Nov 06 13:20:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-709042cc-15f6-45fe-b1e8-7743667680bb tempest-TaggedAttachmentsTest-1737511361 tempest-TaggedAttachmentsTest-1737511361-project-member] Lock "bd32c388-aa78-43ef-ae93-8230b8eba8af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.572s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:20:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.216s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:27 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Checking if we can resize image /opt/stack/data/nova/instances/be3cb35a-d45e-4e35-96fe-437a941c0244/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:20:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3cb35a-d45e-4e35-96fe-437a941c0244/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:27 user nova-compute[74821]: DEBUG nova.compute.manager [req-5722225c-b501-45fd-b620-b22c939e9c4d req-d86172af-d4ea-4c54-b973-680bdde35224 service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Received event network-vif-plugged-054bfb88-19a2-4241-ae8d-0eded559c233 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:20:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5722225c-b501-45fd-b620-b22c939e9c4d req-d86172af-d4ea-4c54-b973-680bdde35224 service nova] Acquiring lock "bd32c388-aa78-43ef-ae93-8230b8eba8af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:20:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5722225c-b501-45fd-b620-b22c939e9c4d req-d86172af-d4ea-4c54-b973-680bdde35224 service nova] Lock "bd32c388-aa78-43ef-ae93-8230b8eba8af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:20:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5722225c-b501-45fd-b620-b22c939e9c4d req-d86172af-d4ea-4c54-b973-680bdde35224 service nova] Lock "bd32c388-aa78-43ef-ae93-8230b8eba8af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:20:27 user nova-compute[74821]: DEBUG nova.compute.manager [req-5722225c-b501-45fd-b620-b22c939e9c4d req-d86172af-d4ea-4c54-b973-680bdde35224 service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] No waiting events found dispatching network-vif-plugged-054bfb88-19a2-4241-ae8d-0eded559c233 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:20:27 user nova-compute[74821]: WARNING nova.compute.manager [req-5722225c-b501-45fd-b620-b22c939e9c4d req-d86172af-d4ea-4c54-b973-680bdde35224 service nova] [instance: bd32c388-aa78-43ef-ae93-8230b8eba8af] Received unexpected event network-vif-plugged-054bfb88-19a2-4241-ae8d-0eded559c233 for instance with vm_state deleted and task_state None.
Nov 06 13:20:27 user nova-compute[74821]: DEBUG nova.network.neutron [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Successfully created port: 0a9f35be-92cb-4904-998d-213bac64ebc0 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:20:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3cb35a-d45e-4e35-96fe-437a941c0244/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:27 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Cannot resize image /opt/stack/data/nova/instances/be3cb35a-d45e-4e35-96fe-437a941c0244/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:20:27 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:20:27 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Ensure instance console log exists: /opt/stack/data/nova/instances/be3cb35a-d45e-4e35-96fe-437a941c0244/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:20:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:20:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:20:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:20:27 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:20:28 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 107abf1d-96da-4406-8111-ef0bc09fb3e3 is timed out.
Nov 06 13:20:28 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Successfully detached device vdb from instance 107abf1d-96da-4406-8111-ef0bc09fb3e3 from the live domain config.
Nov 06 13:20:28 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YQFHhKGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:20:28 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:20:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a231b25b-b0fd-4007-b937-f113ef8dbf56]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:20:28 user nova-compute[74821]: No targets found.
Nov 06 13:20:28 user nova-compute[74821]: iSNS:
Nov 06 13:20:28 user nova-compute[74821]: No targets found.
Nov 06 13:20:28 user nova-compute[74821]: STATIC:
Nov 06 13:20:28 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac
Nov 06 13:20:28 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:20:28 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:20:28 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5
Nov 06 13:20:28 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:20:28 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:20:28 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979
Nov 06 13:20:28 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:20:28 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:20:28 user nova-compute[74821]: FIRMWARE:
Nov 06 13:20:28 user nova-compute[74821]: No targets found.
Nov 06 13:20:28 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:20:28 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:20:28 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb83c09-7ec2-4e02-b46f-3a0ed1ca5382]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[86532129-8095-4aa3-bd11-bde6f168a1c6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac (non-flash)
Nov 06 13:20:28 user nova-compute[74821]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:20:28 user nova-compute[74821]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:20:28 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac (non-flash)
Nov 06 13:20:28 user nova-compute[74821]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:20:28 user nova-compute[74821]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:20:28 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e405ea0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac'): ({'sdb'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Removing single pathed devices sdb {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG nova.network.neutron [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Successfully updated port: 0a9f35be-92cb-4904-998d-213bac64ebc0 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Acquiring lock "refresh_cache-be3cb35a-d45e-4e35-96fe-437a941c0244" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Acquired lock "refresh_cache-be3cb35a-d45e-4e35-96fe-437a941c0244" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG nova.network.neutron [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3adaa2-7d90-4fbf-88fa-d07c325376b1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG nova.compute.manager [req-b0dafbb8-8d8f-42de-b03d-af2d415fe826 req-44e444b6-b12f-4769-b81f-3332128fb1f5 service nova] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Received event network-changed-0a9f35be-92cb-4904-998d-213bac64ebc0 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG nova.compute.manager [req-b0dafbb8-8d8f-42de-b03d-af2d415fe826 req-44e444b6-b12f-4769-b81f-3332128fb1f5 service nova] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Refreshing instance network info cache due to event network-changed-0a9f35be-92cb-4904-998d-213bac64ebc0. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b0dafbb8-8d8f-42de-b03d-af2d415fe826 req-44e444b6-b12f-4769-b81f-3332128fb1f5 service nova] Acquiring lock "refresh_cache-be3cb35a-d45e-4e35-96fe-437a941c0244" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51a9059-fdc7-4f80-952f-51e1b8e33c41]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Flushing IO for device /dev/sdb {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d06d4f-4318-4056-8367-87c31cbe0c9e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG nova.network.neutron [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd350a5a-fd76-4488-8399-a7ffbcd99cdd]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] SCSI volumes sdb have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6989d39-74f2-4015-ad78-315b16cc1080]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[76446f36-7f55-4f51-aeaa-400145f4866e]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac, portal: 172.16.0.220,3260]
Nov 06 13:20:28 user nova-compute[74821]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac, portal: 172.16.0.220,3260] successful.
Nov 06 13:20:28 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744517a5-fbdc-4bf2-bfb3-86217cb180ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[448dc8ae-5cf0-4363-8872-5c44543677da]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] <== disconnect_volume: return (329ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:20:28 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG nova.network.neutron [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Updating instance_info_cache with network_info: [{"id": "0a9f35be-92cb-4904-998d-213bac64ebc0", "address": "fa:16:3e:a8:3b:43", "network": {"id": "9fe30aa2-5c5b-448b-8bd5-cdeda2721e6b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2097801930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f25eb95045d145c99d728e5d007ec1b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a9f35be-92", "ovs_interfaceid": "0a9f35be-92cb-4904-998d-213bac64ebc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Releasing lock "refresh_cache-be3cb35a-d45e-4e35-96fe-437a941c0244" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG nova.compute.manager [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Instance network_info: |[{"id": "0a9f35be-92cb-4904-998d-213bac64ebc0", "address": "fa:16:3e:a8:3b:43", "network": {"id": "9fe30aa2-5c5b-448b-8bd5-cdeda2721e6b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2097801930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f25eb95045d145c99d728e5d007ec1b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a9f35be-92", "ovs_interfaceid": "0a9f35be-92cb-4904-998d-213bac64ebc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b0dafbb8-8d8f-42de-b03d-af2d415fe826 req-44e444b6-b12f-4769-b81f-3332128fb1f5 service nova] Acquired lock "refresh_cache-be3cb35a-d45e-4e35-96fe-437a941c0244" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG nova.network.neutron [req-b0dafbb8-8d8f-42de-b03d-af2d415fe826 req-44e444b6-b12f-4769-b81f-3332128fb1f5 service nova] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Refreshing network info cache for port 0a9f35be-92cb-4904-998d-213bac64ebc0 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Start _get_guest_xml network_info=[{"id": "0a9f35be-92cb-4904-998d-213bac64ebc0", "address": "fa:16:3e:a8:3b:43", "network": {"id": "9fe30aa2-5c5b-448b-8bd5-cdeda2721e6b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2097801930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f25eb95045d145c99d728e5d007ec1b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a9f35be-92", "ovs_interfaceid": "0a9f35be-92cb-4904-998d-213bac64ebc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:20:29 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:20:29 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:20:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:20:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-75962531',display_name='tempest-VolumesSnapshotTestJSON-instance-75962531',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-75962531',id=25,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDV2JFNQ4pExLc+A7YGfIw9+Y4bgVvRqXI21tJEatDX2l/abyhNM+UW5FvUQLsnRgL8Dm0hoAMzMm2+K1e+RcN/cagZViJ/7U/aNCuznZwnGcbMXTwT7nu/dndP62LKNWQ==',key_name='tempest-keypair-1439888578',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f25eb95045d145c99d728e5d007ec1b6',ramdisk_id='',reservation_id='r-26jtx0qj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1889603116',owner_user_name='tempest-VolumesSnapshotTestJSON-1889603116-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:20:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d34c030545b43f8a1ab4d071189d7fc',uuid=be3cb35a-d45e-4e35-96fe-437a941c0244,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a9f35be-92cb-4904-998d-213bac64ebc0", "address": "fa:16:3e:a8:3b:43", "network": {"id": "9fe30aa2-5c5b-448b-8bd5-cdeda2721e6b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2097801930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f25eb95045d145c99d728e5d007ec1b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a9f35be-92", "ovs_interfaceid": "0a9f35be-92cb-4904-998d-213bac64ebc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Converting VIF {"id": "0a9f35be-92cb-4904-998d-213bac64ebc0", "address": "fa:16:3e:a8:3b:43", "network": {"id": "9fe30aa2-5c5b-448b-8bd5-cdeda2721e6b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2097801930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f25eb95045d145c99d728e5d007ec1b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a9f35be-92", "ovs_interfaceid": "0a9f35be-92cb-4904-998d-213bac64ebc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:3b:43,bridge_name='br-int',has_traffic_filtering=True,id=0a9f35be-92cb-4904-998d-213bac64ebc0,network=Network(9fe30aa2-5c5b-448b-8bd5-cdeda2721e6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a9f35be-92') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG nova.objects.instance [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lazy-loading 'pci_devices' on Instance uuid be3cb35a-d45e-4e35-96fe-437a941c0244 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:20:29 user nova-compute[74821]:   <uuid>be3cb35a-d45e-4e35-96fe-437a941c0244</uuid>
Nov 06 13:20:29 user nova-compute[74821]:   <name>instance-00000019</name>
Nov 06 13:20:29 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:20:29 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:20:29 user nova-compute[74821]:   <metadata>
Nov 06 13:20:29 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:20:29 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:20:29 user nova-compute[74821]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-75962531</nova:name>
Nov 06 13:20:29 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:20:29</nova:creationTime>
Nov 06 13:20:29 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:20:29 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:20:29 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:20:29 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:20:29 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:20:29 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:20:29 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:20:29 user nova-compute[74821]:       <nova:owner>
Nov 06 13:20:29 user nova-compute[74821]:         <nova:user uuid="4d34c030545b43f8a1ab4d071189d7fc">tempest-VolumesSnapshotTestJSON-1889603116-project-member</nova:user>
Nov 06 13:20:29 user nova-compute[74821]:         <nova:project uuid="f25eb95045d145c99d728e5d007ec1b6">tempest-VolumesSnapshotTestJSON-1889603116</nova:project>
Nov 06 13:20:29 user nova-compute[74821]:       </nova:owner>
Nov 06 13:20:29 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:20:29 user nova-compute[74821]:       <nova:ports>
Nov 06 13:20:29 user nova-compute[74821]:         <nova:port uuid="0a9f35be-92cb-4904-998d-213bac64ebc0">
Nov 06 13:20:29 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 06 13:20:29 user nova-compute[74821]:         </nova:port>
Nov 06 13:20:29 user nova-compute[74821]:       </nova:ports>
Nov 06 13:20:29 user nova-compute[74821]:     </nova:instance>
Nov 06 13:20:29 user nova-compute[74821]:   </metadata>
Nov 06 13:20:29 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:20:29 user nova-compute[74821]:     <system>
Nov 06 13:20:29 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:20:29 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:20:29 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:20:29 user nova-compute[74821]:       <entry name="serial">be3cb35a-d45e-4e35-96fe-437a941c0244</entry>
Nov 06 13:20:29 user nova-compute[74821]:       <entry name="uuid">be3cb35a-d45e-4e35-96fe-437a941c0244</entry>
Nov 06 13:20:29 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:20:29 user nova-compute[74821]:     </system>
Nov 06 13:20:29 user nova-compute[74821]:   </sysinfo>
Nov 06 13:20:29 user nova-compute[74821]:   <os>
Nov 06 13:20:29 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:20:29 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:20:29 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:20:29 user nova-compute[74821]:   </os>
Nov 06 13:20:29 user nova-compute[74821]:   <features>
Nov 06 13:20:29 user nova-compute[74821]:     <acpi/>
Nov 06 13:20:29 user nova-compute[74821]:     <apic/>
Nov 06 13:20:29 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:20:29 user nova-compute[74821]:   </features>
Nov 06 13:20:29 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:20:29 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:20:29 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:20:29 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:20:29 user nova-compute[74821]:   </clock>
Nov 06 13:20:29 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:20:29 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:20:29 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:20:29 user nova-compute[74821]:   </cpu>
Nov 06 13:20:29 user nova-compute[74821]:   <devices>
Nov 06 13:20:29 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:20:29 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:20:29 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/be3cb35a-d45e-4e35-96fe-437a941c0244/disk"/>
Nov 06 13:20:29 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:20:29 user nova-compute[74821]:     </disk>
Nov 06 13:20:29 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:20:29 user nova-compute[74821]:       <mac address="fa:16:3e:a8:3b:43"/>
Nov 06 13:20:29 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:20:29 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:20:29 user nova-compute[74821]:       <target dev="tap0a9f35be-92"/>
Nov 06 13:20:29 user nova-compute[74821]:     </interface>
Nov 06 13:20:29 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:20:29 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/be3cb35a-d45e-4e35-96fe-437a941c0244/console.log" append="off"/>
Nov 06 13:20:29 user nova-compute[74821]:     </serial>
Nov 06 13:20:29 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:20:29 user nova-compute[74821]:     <video>
Nov 06 13:20:29 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:20:29 user nova-compute[74821]:     </video>
Nov 06 13:20:29 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:20:29 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:20:29 user nova-compute[74821]:     </rng>
Nov 06 13:20:29 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:20:29 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:20:29 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:20:29 user nova-compute[74821]:     </memballoon>
Nov 06 13:20:29 user nova-compute[74821]:   </devices>
Nov 06 13:20:29 user nova-compute[74821]: </domain>
Nov 06 13:20:29 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:20:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-75962531',display_name='tempest-VolumesSnapshotTestJSON-instance-75962531',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-75962531',id=25,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDV2JFNQ4pExLc+A7YGfIw9+Y4bgVvRqXI21tJEatDX2l/abyhNM+UW5FvUQLsnRgL8Dm0hoAMzMm2+K1e+RcN/cagZViJ/7U/aNCuznZwnGcbMXTwT7nu/dndP62LKNWQ==',key_name='tempest-keypair-1439888578',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f25eb95045d145c99d728e5d007ec1b6',ramdisk_id='',reservation_id='r-26jtx0qj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1889603116',owner_user_name='tempest-VolumesSnapshotTestJSON-1889603116-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:20:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d34c030545b43f8a1ab4d071189d7fc',uuid=be3cb35a-d45e-4e35-96fe-437a941c0244,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a9f35be-92cb-4904-998d-213bac64ebc0", "address": "fa:16:3e:a8:3b:43", "network": {"id": "9fe30aa2-5c5b-448b-8bd5-cdeda2721e6b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2097801930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f25eb95045d145c99d728e5d007ec1b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a9f35be-92", "ovs_interfaceid": "0a9f35be-92cb-4904-998d-213bac64ebc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Converting VIF {"id": "0a9f35be-92cb-4904-998d-213bac64ebc0", "address": "fa:16:3e:a8:3b:43", "network": {"id": "9fe30aa2-5c5b-448b-8bd5-cdeda2721e6b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2097801930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f25eb95045d145c99d728e5d007ec1b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a9f35be-92", "ovs_interfaceid": "0a9f35be-92cb-4904-998d-213bac64ebc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:3b:43,bridge_name='br-int',has_traffic_filtering=True,id=0a9f35be-92cb-4904-998d-213bac64ebc0,network=Network(9fe30aa2-5c5b-448b-8bd5-cdeda2721e6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a9f35be-92') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG os_vif [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:3b:43,bridge_name='br-int',has_traffic_filtering=True,id=0a9f35be-92cb-4904-998d-213bac64ebc0,network=Network(9fe30aa2-5c5b-448b-8bd5-cdeda2721e6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a9f35be-92') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41bb15c7-bf02-5b59-b8d6-4b197b15b8d0', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a9f35be-92, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0a9f35be-92, col_values=(('qos', UUID('ec166faf-c524-407e-a6bd-54ec8ece465c')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0a9f35be-92, col_values=(('external_ids', {'iface-id': '0a9f35be-92cb-4904-998d-213bac64ebc0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:3b:43', 'vm-uuid': 'be3cb35a-d45e-4e35-96fe-437a941c0244'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:29 user nova-compute[74821]: INFO os_vif [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:3b:43,bridge_name='br-int',has_traffic_filtering=True,id=0a9f35be-92cb-4904-998d-213bac64ebc0,network=Network(9fe30aa2-5c5b-448b-8bd5-cdeda2721e6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a9f35be-92')
Nov 06 13:20:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] No VIF found with MAC fa:16:3e:a8:3b:43, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG nova.network.neutron [req-b0dafbb8-8d8f-42de-b03d-af2d415fe826 req-44e444b6-b12f-4769-b81f-3332128fb1f5 service nova] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Updated VIF entry in instance network info cache for port 0a9f35be-92cb-4904-998d-213bac64ebc0. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG nova.network.neutron [req-b0dafbb8-8d8f-42de-b03d-af2d415fe826 req-44e444b6-b12f-4769-b81f-3332128fb1f5 service nova] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Updating instance_info_cache with network_info: [{"id": "0a9f35be-92cb-4904-998d-213bac64ebc0", "address": "fa:16:3e:a8:3b:43", "network": {"id": "9fe30aa2-5c5b-448b-8bd5-cdeda2721e6b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2097801930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f25eb95045d145c99d728e5d007ec1b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a9f35be-92", "ovs_interfaceid": "0a9f35be-92cb-4904-998d-213bac64ebc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:20:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b0dafbb8-8d8f-42de-b03d-af2d415fe826 req-44e444b6-b12f-4769-b81f-3332128fb1f5 service nova] Releasing lock "refresh_cache-be3cb35a-d45e-4e35-96fe-437a941c0244" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:20:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:30 user nova-compute[74821]: DEBUG nova.compute.manager [req-0e63941e-5908-475e-b886-a6e57f9b1fea req-24d04c6b-6216-4b1a-b5e7-1bc0e895a895 service nova] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Received event network-vif-plugged-0a9f35be-92cb-4904-998d-213bac64ebc0 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:20:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0e63941e-5908-475e-b886-a6e57f9b1fea req-24d04c6b-6216-4b1a-b5e7-1bc0e895a895 service nova] Acquiring lock "be3cb35a-d45e-4e35-96fe-437a941c0244-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:20:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0e63941e-5908-475e-b886-a6e57f9b1fea req-24d04c6b-6216-4b1a-b5e7-1bc0e895a895 service nova] Lock "be3cb35a-d45e-4e35-96fe-437a941c0244-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:20:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0e63941e-5908-475e-b886-a6e57f9b1fea req-24d04c6b-6216-4b1a-b5e7-1bc0e895a895 service nova] Lock "be3cb35a-d45e-4e35-96fe-437a941c0244-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:20:30 user nova-compute[74821]: DEBUG nova.compute.manager [req-0e63941e-5908-475e-b886-a6e57f9b1fea req-24d04c6b-6216-4b1a-b5e7-1bc0e895a895 service nova] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] No waiting events found dispatching network-vif-plugged-0a9f35be-92cb-4904-998d-213bac64ebc0 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:20:30 user nova-compute[74821]: WARNING nova.compute.manager [req-0e63941e-5908-475e-b886-a6e57f9b1fea req-24d04c6b-6216-4b1a-b5e7-1bc0e895a895 service nova] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Received unexpected event network-vif-plugged-0a9f35be-92cb-4904-998d-213bac64ebc0 for instance with vm_state building and task_state spawning.
Nov 06 13:20:30 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:20:31 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:31 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:31 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:31 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:31 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:20:31 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:20:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-311817c5-7b08-4da9-98eb-c685f37e6fd3" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:20:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-311817c5-7b08-4da9-98eb-c685f37e6fd3" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:20:32 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:20:32 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Updating instance_info_cache with network_info: [{"id": "be99c620-c497-4810-8aac-8793f2b2baa7", "address": "fa:16:3e:2e:e6:6b", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe99c620-c4", "ovs_interfaceid": "be99c620-c497-4810-8aac-8793f2b2baa7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:20:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-311817c5-7b08-4da9-98eb-c685f37e6fd3" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:20:32 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:20:32 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:20:32 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:20:32 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:20:33 user nova-compute[74821]: DEBUG nova.compute.manager [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:20:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:20:33 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Instance spawned successfully.
Nov 06 13:20:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:20:33 user nova-compute[74821]: DEBUG nova.compute.manager [req-d36689f6-5f21-425f-9cd1-8d1dceb7bc5e req-d566b9f2-12fc-48a4-92c7-879cabd9ca2a service nova] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Received event network-vif-plugged-0a9f35be-92cb-4904-998d-213bac64ebc0 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:20:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d36689f6-5f21-425f-9cd1-8d1dceb7bc5e req-d566b9f2-12fc-48a4-92c7-879cabd9ca2a service nova] Acquiring lock "be3cb35a-d45e-4e35-96fe-437a941c0244-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:20:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d36689f6-5f21-425f-9cd1-8d1dceb7bc5e req-d566b9f2-12fc-48a4-92c7-879cabd9ca2a service nova] Lock "be3cb35a-d45e-4e35-96fe-437a941c0244-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:20:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d36689f6-5f21-425f-9cd1-8d1dceb7bc5e req-d566b9f2-12fc-48a4-92c7-879cabd9ca2a service nova] Lock "be3cb35a-d45e-4e35-96fe-437a941c0244-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:20:33 user nova-compute[74821]: DEBUG nova.compute.manager [req-d36689f6-5f21-425f-9cd1-8d1dceb7bc5e req-d566b9f2-12fc-48a4-92c7-879cabd9ca2a service nova] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] No waiting events found dispatching network-vif-plugged-0a9f35be-92cb-4904-998d-213bac64ebc0 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:20:33 user nova-compute[74821]: WARNING nova.compute.manager [req-d36689f6-5f21-425f-9cd1-8d1dceb7bc5e req-d566b9f2-12fc-48a4-92c7-879cabd9ca2a service nova] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Received unexpected event network-vif-plugged-0a9f35be-92cb-4904-998d-213bac64ebc0 for instance with vm_state building and task_state spawning.
Nov 06 13:20:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:20:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:20:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:20:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:20:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:20:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:20:33 user nova-compute[74821]: INFO nova.compute.manager [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Took 6.22 seconds to spawn the instance on the hypervisor.
Nov 06 13:20:33 user nova-compute[74821]: DEBUG nova.compute.manager [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:20:33 user nova-compute[74821]: INFO nova.compute.manager [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Took 7.14 seconds to build instance.
Nov 06 13:20:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e20c46eb-45ae-44ca-817b-ed1faec09d10 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "be3cb35a-d45e-4e35-96fe-437a941c0244" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.254s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:20:33 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:20:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:34 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:20:34 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:20:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:20:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:20:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:20:34 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:20:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3cb35a-d45e-4e35-96fe-437a941c0244/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3cb35a-d45e-4e35-96fe-437a941c0244/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3cb35a-d45e-4e35-96fe-437a941c0244/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3cb35a-d45e-4e35-96fe-437a941c0244/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:37 user nova-compute[74821]: DEBUG nova.objects.instance [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lazy-loading 'flavor' on Instance uuid 107abf1d-96da-4406-8111-ef0bc09fb3e3 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:20:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cfe0bb4a-72e5-49b0-98cd-9a550538c345 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "107abf1d-96da-4406-8111-ef0bc09fb3e3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 29.518s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:20:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.volume.cinder [None req-d5a90086-30ac-476b-9ac9-e8ee7ae32789 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Update attachment failed for attachment bccf5e3c-bc6a-4585-87b2-b265804277eb. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-48ff0e61-345c-4ccc-a644-be50e440a642) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-48ff0e61-345c-4ccc-a644-be50e440a642)
Nov 06 13:20:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [None req-d5a90086-30ac-476b-9ac9-e8ee7ae32789 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Failed to attach 076a6552-9c88-47f5-990a-fe847fda7b71 at /dev/vdc: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-48ff0e61-345c-4ccc-a644-be50e440a642)
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Traceback (most recent call last):
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e]     ret_val = method(obj, context, *args, **kwargs)
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e]     self._do_attach(context, instance, volume, volume_api,
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e]     self._volume_attach(context, volume, connector, instance,
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e]     connection_info = volume_api.attachment_update(
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e]     res = method(self, ctx, *args, **kwargs)
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e]     with excutils.save_and_reraise_exception():
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e]     self.force_reraise()
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e]     raise self.value
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e]     context, '3.44', skip_version_check=True).attachments.update(
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e]     return method.func(obj, *args, **kwargs)
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e]     resp = self._update('/attachments/%s' % id, body)
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e]     return self._cs_request(url, 'PUT', **kwargs)
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e]     return self.request(url, method, **kwargs)
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e]     raise exceptions.from_response(resp, body)
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-48ff0e61-345c-4ccc-a644-be50e440a642)
Nov 06 13:20:37 user nova-compute[74821]: ERROR nova.compute.manager [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] 
Nov 06 13:20:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d5a90086-30ac-476b-9ac9-e8ee7ae32789 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lock "cc3c1518-c493-41b0-a748-a0ed933c2b1e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.727s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server [None req-d5a90086-30ac-476b-9ac9-e8ee7ae32789 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-48ff0e61-345c-4ccc-a644-be50e440a642)
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-48ff0e61-345c-4ccc-a644-be50e440a642)
Nov 06 13:20:37 user nova-compute[74821]: ERROR oslo_messaging.rpc.server 
Nov 06 13:20:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:38 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:20:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:39 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:20:40 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:20:40 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:20:40 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=7389MB free_disk=25.36395263671875GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:20:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:20:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:20:40 user nova-compute[74821]: DEBUG nova.compute.manager [req-eec4d483-ef33-44b1-ad6d-48a67c052970 req-a953584b-5262-4352-af25-ec65dc1e351f service nova] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Received event network-changed-741cb43d-19ba-4edc-92f0-5de562bf4c2c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:20:40 user nova-compute[74821]: DEBUG nova.compute.manager [req-eec4d483-ef33-44b1-ad6d-48a67c052970 req-a953584b-5262-4352-af25-ec65dc1e351f service nova] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Refreshing instance network info cache due to event network-changed-741cb43d-19ba-4edc-92f0-5de562bf4c2c. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:20:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-eec4d483-ef33-44b1-ad6d-48a67c052970 req-a953584b-5262-4352-af25-ec65dc1e351f service nova] Acquiring lock "refresh_cache-290cd798-a041-40c0-8ef9-319d3627ff82" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:20:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-eec4d483-ef33-44b1-ad6d-48a67c052970 req-a953584b-5262-4352-af25-ec65dc1e351f service nova] Acquired lock "refresh_cache-290cd798-a041-40c0-8ef9-319d3627ff82" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:20:40 user nova-compute[74821]: DEBUG nova.network.neutron [req-eec4d483-ef33-44b1-ad6d-48a67c052970 req-a953584b-5262-4352-af25-ec65dc1e351f service nova] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Refreshing network info cache for port 741cb43d-19ba-4edc-92f0-5de562bf4c2c {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:20:40 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 3e21d005-f190-478a-a911-e483e1235057 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:20:40 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 311817c5-7b08-4da9-98eb-c685f37e6fd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:20:40 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 2de346cb-9858-47b8-a86c-4fde720d6127 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:20:40 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 49c65aca-8392-46ba-8fa3-b47ff2416cb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:20:40 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 107abf1d-96da-4406-8111-ef0bc09fb3e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:20:40 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance cc3c1518-c493-41b0-a748-a0ed933c2b1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:20:40 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 290cd798-a041-40c0-8ef9-319d3627ff82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:20:40 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 5a07f64b-5b12-4e7d-a041-ad591141aa17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:20:40 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 61beb251-4345-44e6-a176-5c14c99c9a52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:20:40 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 496f8213-4b32-4211-a354-e33a4a088848 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:20:40 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance be3cb35a-d45e-4e35-96fe-437a941c0244 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:20:40 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:20:40 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:20:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "290cd798-a041-40c0-8ef9-319d3627ff82" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:20:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "290cd798-a041-40c0-8ef9-319d3627ff82" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:20:40 user nova-compute[74821]: DEBUG nova.objects.instance [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lazy-loading 'flavor' on Instance uuid 290cd798-a041-40c0-8ef9-319d3627ff82 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:20:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "290cd798-a041-40c0-8ef9-319d3627ff82" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:20:40 user nova-compute[74821]: DEBUG nova.network.neutron [req-eec4d483-ef33-44b1-ad6d-48a67c052970 req-a953584b-5262-4352-af25-ec65dc1e351f service nova] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Updated VIF entry in instance network info cache for port 741cb43d-19ba-4edc-92f0-5de562bf4c2c. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:20:40 user nova-compute[74821]: DEBUG nova.network.neutron [req-eec4d483-ef33-44b1-ad6d-48a67c052970 req-a953584b-5262-4352-af25-ec65dc1e351f service nova] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Updating instance_info_cache with network_info: [{"id": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "address": "fa:16:3e:6c:6c:87", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap741cb43d-19", "ovs_interfaceid": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:20:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-eec4d483-ef33-44b1-ad6d-48a67c052970 req-a953584b-5262-4352-af25-ec65dc1e351f service nova] Releasing lock "refresh_cache-290cd798-a041-40c0-8ef9-319d3627ff82" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:20:40 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:20:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "290cd798-a041-40c0-8ef9-319d3627ff82" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:20:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "290cd798-a041-40c0-8ef9-319d3627ff82" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:20:40 user nova-compute[74821]: INFO nova.compute.manager [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Attaching volume c27cae42-439c-4fd6-8c64-b7a0144f2116 to /dev/vdb
Nov 06 13:20:40 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:20:40 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:20:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.713s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:20:41 user nova-compute[74821]: DEBUG os_brick.utils [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:20:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:41 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[979ac1e5-ea22-4396-a01f-a8873c561615]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:41 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[196cbeef-1d58-4487-8aa6-74752924ec4b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:41 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc9fb84-2203-4c8b-b391-126ed736b23a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:41 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4f01f0-0516-48a0-9530-3e238d20b11f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:20:41 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:20:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:20:41 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:20:41 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6d88fd-3d54-416f-b038-a697bf747185]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:20:41 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:20:41 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:20:41 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:20:41 user nova-compute[74821]: DEBUG os_brick.utils [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:20:41 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Updating existing volume attachment record: ab85872e-790b-4c7c-834a-0fd74f912885 {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:20:41 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:20:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:20:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-ac90ae11-7ced-4def-83ed-d27dc09386db req-a385db4c-495f-469b-9907-160f8e8a5aa1 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received event network-changed-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:20:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-ac90ae11-7ced-4def-83ed-d27dc09386db req-a385db4c-495f-469b-9907-160f8e8a5aa1 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Refreshing instance network info cache due to event network-changed-db18095e-82aa-407a-b43f-5f060b8c64ec. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:20:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ac90ae11-7ced-4def-83ed-d27dc09386db req-a385db4c-495f-469b-9907-160f8e8a5aa1 service nova] Acquiring lock "refresh_cache-5a07f64b-5b12-4e7d-a041-ad591141aa17" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:20:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ac90ae11-7ced-4def-83ed-d27dc09386db req-a385db4c-495f-469b-9907-160f8e8a5aa1 service nova] Acquired lock "refresh_cache-5a07f64b-5b12-4e7d-a041-ad591141aa17" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:20:52 user nova-compute[74821]: DEBUG nova.network.neutron [req-ac90ae11-7ced-4def-83ed-d27dc09386db req-a385db4c-495f-469b-9907-160f8e8a5aa1 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Refreshing network info cache for port db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:20:52 user nova-compute[74821]: DEBUG nova.network.neutron [req-ac90ae11-7ced-4def-83ed-d27dc09386db req-a385db4c-495f-469b-9907-160f8e8a5aa1 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Updated VIF entry in instance network info cache for port db18095e-82aa-407a-b43f-5f060b8c64ec. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:20:52 user nova-compute[74821]: DEBUG nova.network.neutron [req-ac90ae11-7ced-4def-83ed-d27dc09386db req-a385db4c-495f-469b-9907-160f8e8a5aa1 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Updating instance_info_cache with network_info: [{"id": "db18095e-82aa-407a-b43f-5f060b8c64ec", "address": "fa:16:3e:30:ef:48", "network": {"id": "79eddc13-4e87-497c-af1f-ce215f23e831", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412663699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d867544bce424f90bcb0403e953f59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb18095e-82", "ovs_interfaceid": "db18095e-82aa-407a-b43f-5f060b8c64ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:20:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ac90ae11-7ced-4def-83ed-d27dc09386db req-a385db4c-495f-469b-9907-160f8e8a5aa1 service nova] Releasing lock "refresh_cache-5a07f64b-5b12-4e7d-a041-ad591141aa17" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:20:53 user nova-compute[74821]: DEBUG nova.compute.manager [None req-e50dac78-dfed-4b82-b16d-0cfdb295a098 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:20:53 user nova-compute[74821]: INFO nova.compute.manager [None req-e50dac78-dfed-4b82-b16d-0cfdb295a098 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] instance snapshotting
Nov 06 13:20:53 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-e50dac78-dfed-4b82-b16d-0cfdb295a098 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Beginning live snapshot process
Nov 06 13:20:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e50dac78-dfed-4b82-b16d-0cfdb295a098 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk --force-share --output=json -f qcow2 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e50dac78-dfed-4b82-b16d-0cfdb295a098 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk --force-share --output=json -f qcow2" returned: 0 in 0.206s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e50dac78-dfed-4b82-b16d-0cfdb295a098 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk --force-share --output=json -f qcow2 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e50dac78-dfed-4b82-b16d-0cfdb295a098 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk --force-share --output=json -f qcow2" returned: 0 in 0.205s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e50dac78-dfed-4b82-b16d-0cfdb295a098 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e50dac78-dfed-4b82-b16d-0cfdb295a098 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.190s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e50dac78-dfed-4b82-b16d-0cfdb295a098 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp3evr9qye/78bfebe4fde44257bb222500a05b3714.delta 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e50dac78-dfed-4b82-b16d-0cfdb295a098 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp3evr9qye/78bfebe4fde44257bb222500a05b3714.delta 1073741824" returned: 0 in 0.061s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:54 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-e50dac78-dfed-4b82-b16d-0cfdb295a098 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 06 13:20:55 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-e50dac78-dfed-4b82-b16d-0cfdb295a098 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74821) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 13:20:55 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-e50dac78-dfed-4b82-b16d-0cfdb295a098 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74821) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 13:20:55 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-e50dac78-dfed-4b82-b16d-0cfdb295a098 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 06 13:20:55 user nova-compute[74821]: DEBUG nova.privsep.utils [None req-e50dac78-dfed-4b82-b16d-0cfdb295a098 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74821) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 13:20:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e50dac78-dfed-4b82-b16d-0cfdb295a098 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp3evr9qye/78bfebe4fde44257bb222500a05b3714.delta /opt/stack/data/nova/instances/snapshots/tmp3evr9qye/78bfebe4fde44257bb222500a05b3714 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:20:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-e50dac78-dfed-4b82-b16d-0cfdb295a098 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp3evr9qye/78bfebe4fde44257bb222500a05b3714.delta /opt/stack/data/nova/instances/snapshots/tmp3evr9qye/78bfebe4fde44257bb222500a05b3714" returned: 0 in 0.535s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:20:56 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-e50dac78-dfed-4b82-b16d-0cfdb295a098 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Snapshot extracted, beginning image upload
Nov 06 13:20:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:20:59 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-e50dac78-dfed-4b82-b16d-0cfdb295a098 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Snapshot image upload complete
Nov 06 13:20:59 user nova-compute[74821]: INFO nova.compute.manager [None req-e50dac78-dfed-4b82-b16d-0cfdb295a098 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Took 5.92 seconds to snapshot the instance on the hypervisor.
Nov 06 13:20:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Acquiring lock "6a895162-eec9-4e5f-a7d3-bd36155da4b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:20:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "6a895162-eec9-4e5f-a7d3-bd36155da4b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:20:59 user nova-compute[74821]: DEBUG nova.compute.manager [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:20:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:20:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:20:59 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:20:59 user nova-compute[74821]: INFO nova.compute.claims [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Claim successful on node user
Nov 06 13:21:00 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:21:00 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:21:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.515s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:21:00 user nova-compute[74821]: DEBUG nova.compute.manager [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:21:00 user nova-compute[74821]: DEBUG nova.compute.manager [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:21:00 user nova-compute[74821]: DEBUG nova.network.neutron [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:21:00 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:21:00 user nova-compute[74821]: DEBUG nova.compute.manager [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:21:00 user nova-compute[74821]: DEBUG nova.policy [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0b7addf6de74979a206dfccac04f475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc877e77ae92437f8ae2f5e4d9b65947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:21:00 user nova-compute[74821]: DEBUG nova.compute.manager [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:21:00 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:21:00 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Creating image(s)
Nov 06 13:21:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a895162-eec9-4e5f-a7d3-bd36155da4b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:21:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "/opt/stack/data/nova/instances/6a895162-eec9-4e5f-a7d3-bd36155da4b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:21:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "/opt/stack/data/nova/instances/6a895162-eec9-4e5f-a7d3-bd36155da4b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:21:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.180s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:21:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:21:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.187s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/6a895162-eec9-4e5f-a7d3-bd36155da4b8/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/6a895162-eec9-4e5f-a7d3-bd36155da4b8/disk 1073741824" returned: 0 in 0.050s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:21:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:01 user nova-compute[74821]: DEBUG nova.network.neutron [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Successfully created port: c7d3274f-f84f-4e54-bd58-12ccd3e3aabc {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:21:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.190s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:01 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6a895162-eec9-4e5f-a7d3-bd36155da4b8/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:21:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a895162-eec9-4e5f-a7d3-bd36155da4b8/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a895162-eec9-4e5f-a7d3-bd36155da4b8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:01 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Cannot resize image /opt/stack/data/nova/instances/6a895162-eec9-4e5f-a7d3-bd36155da4b8/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:21:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:21:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Ensure instance console log exists: /opt/stack/data/nova/instances/6a895162-eec9-4e5f-a7d3-bd36155da4b8/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:21:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:21:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:21:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:21:01 user nova-compute[74821]: DEBUG nova.network.neutron [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Successfully updated port: c7d3274f-f84f-4e54-bd58-12ccd3e3aabc {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:21:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Acquiring lock "refresh_cache-6a895162-eec9-4e5f-a7d3-bd36155da4b8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:21:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Acquired lock "refresh_cache-6a895162-eec9-4e5f-a7d3-bd36155da4b8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:21:01 user nova-compute[74821]: DEBUG nova.network.neutron [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:21:01 user nova-compute[74821]: DEBUG nova.compute.manager [req-c4d5fe75-12ae-4e41-bbad-918710f97879 req-0ea39946-8f56-44ba-8a6b-5fd362f246d5 service nova] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Received event network-changed-c7d3274f-f84f-4e54-bd58-12ccd3e3aabc {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:21:01 user nova-compute[74821]: DEBUG nova.compute.manager [req-c4d5fe75-12ae-4e41-bbad-918710f97879 req-0ea39946-8f56-44ba-8a6b-5fd362f246d5 service nova] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Refreshing instance network info cache due to event network-changed-c7d3274f-f84f-4e54-bd58-12ccd3e3aabc. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:21:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c4d5fe75-12ae-4e41-bbad-918710f97879 req-0ea39946-8f56-44ba-8a6b-5fd362f246d5 service nova] Acquiring lock "refresh_cache-6a895162-eec9-4e5f-a7d3-bd36155da4b8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG nova.network.neutron [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG nova.network.neutron [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Updating instance_info_cache with network_info: [{"id": "c7d3274f-f84f-4e54-bd58-12ccd3e3aabc", "address": "fa:16:3e:f3:db:11", "network": {"id": "221da9ed-3df1-4f6c-91b0-ec4117f186f9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-999229259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc877e77ae92437f8ae2f5e4d9b65947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7d3274f-f8", "ovs_interfaceid": "c7d3274f-f84f-4e54-bd58-12ccd3e3aabc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Releasing lock "refresh_cache-6a895162-eec9-4e5f-a7d3-bd36155da4b8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG nova.compute.manager [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Instance network_info: |[{"id": "c7d3274f-f84f-4e54-bd58-12ccd3e3aabc", "address": "fa:16:3e:f3:db:11", "network": {"id": "221da9ed-3df1-4f6c-91b0-ec4117f186f9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-999229259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc877e77ae92437f8ae2f5e4d9b65947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7d3274f-f8", "ovs_interfaceid": "c7d3274f-f84f-4e54-bd58-12ccd3e3aabc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c4d5fe75-12ae-4e41-bbad-918710f97879 req-0ea39946-8f56-44ba-8a6b-5fd362f246d5 service nova] Acquired lock "refresh_cache-6a895162-eec9-4e5f-a7d3-bd36155da4b8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG nova.network.neutron [req-c4d5fe75-12ae-4e41-bbad-918710f97879 req-0ea39946-8f56-44ba-8a6b-5fd362f246d5 service nova] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Refreshing network info cache for port c7d3274f-f84f-4e54-bd58-12ccd3e3aabc {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Start _get_guest_xml network_info=[{"id": "c7d3274f-f84f-4e54-bd58-12ccd3e3aabc", "address": "fa:16:3e:f3:db:11", "network": {"id": "221da9ed-3df1-4f6c-91b0-ec4117f186f9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-999229259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc877e77ae92437f8ae2f5e4d9b65947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7d3274f-f8", "ovs_interfaceid": "c7d3274f-f84f-4e54-bd58-12ccd3e3aabc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:21:02 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:21:02 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:21:02 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:20:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-773710014',display_name='tempest-VolumesAdminNegativeTest-server-773710014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-773710014',id=26,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc877e77ae92437f8ae2f5e4d9b65947',ramdisk_id='',reservation_id='r-a7t3j59l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-610056100',owner_user_name='tempest-VolumesAdminNegativeTest-610056100-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:21:01Z,user_data=None,user_id='d0b7addf6de74979a206dfccac04f475',uuid=6a895162-eec9-4e5f-a7d3-bd36155da4b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7d3274f-f84f-4e54-bd58-12ccd3e3aabc", "address": "fa:16:3e:f3:db:11", "network": {"id": "221da9ed-3df1-4f6c-91b0-ec4117f186f9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-999229259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc877e77ae92437f8ae2f5e4d9b65947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7d3274f-f8", "ovs_interfaceid": "c7d3274f-f84f-4e54-bd58-12ccd3e3aabc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Converting VIF {"id": "c7d3274f-f84f-4e54-bd58-12ccd3e3aabc", "address": "fa:16:3e:f3:db:11", "network": {"id": "221da9ed-3df1-4f6c-91b0-ec4117f186f9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-999229259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc877e77ae92437f8ae2f5e4d9b65947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7d3274f-f8", "ovs_interfaceid": "c7d3274f-f84f-4e54-bd58-12ccd3e3aabc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:db:11,bridge_name='br-int',has_traffic_filtering=True,id=c7d3274f-f84f-4e54-bd58-12ccd3e3aabc,network=Network(221da9ed-3df1-4f6c-91b0-ec4117f186f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7d3274f-f8') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG nova.objects.instance [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a895162-eec9-4e5f-a7d3-bd36155da4b8 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:21:02 user nova-compute[74821]:   <uuid>6a895162-eec9-4e5f-a7d3-bd36155da4b8</uuid>
Nov 06 13:21:02 user nova-compute[74821]:   <name>instance-0000001a</name>
Nov 06 13:21:02 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:21:02 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:21:02 user nova-compute[74821]:   <metadata>
Nov 06 13:21:02 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:21:02 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:21:02 user nova-compute[74821]:       <nova:name>tempest-VolumesAdminNegativeTest-server-773710014</nova:name>
Nov 06 13:21:02 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:21:02</nova:creationTime>
Nov 06 13:21:02 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:21:02 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:21:02 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:21:02 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:21:02 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:21:02 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:21:02 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:21:02 user nova-compute[74821]:       <nova:owner>
Nov 06 13:21:02 user nova-compute[74821]:         <nova:user uuid="d0b7addf6de74979a206dfccac04f475">tempest-VolumesAdminNegativeTest-610056100-project-member</nova:user>
Nov 06 13:21:02 user nova-compute[74821]:         <nova:project uuid="cc877e77ae92437f8ae2f5e4d9b65947">tempest-VolumesAdminNegativeTest-610056100</nova:project>
Nov 06 13:21:02 user nova-compute[74821]:       </nova:owner>
Nov 06 13:21:02 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:21:02 user nova-compute[74821]:       <nova:ports>
Nov 06 13:21:02 user nova-compute[74821]:         <nova:port uuid="c7d3274f-f84f-4e54-bd58-12ccd3e3aabc">
Nov 06 13:21:02 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 06 13:21:02 user nova-compute[74821]:         </nova:port>
Nov 06 13:21:02 user nova-compute[74821]:       </nova:ports>
Nov 06 13:21:02 user nova-compute[74821]:     </nova:instance>
Nov 06 13:21:02 user nova-compute[74821]:   </metadata>
Nov 06 13:21:02 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:21:02 user nova-compute[74821]:     <system>
Nov 06 13:21:02 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:21:02 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:21:02 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:21:02 user nova-compute[74821]:       <entry name="serial">6a895162-eec9-4e5f-a7d3-bd36155da4b8</entry>
Nov 06 13:21:02 user nova-compute[74821]:       <entry name="uuid">6a895162-eec9-4e5f-a7d3-bd36155da4b8</entry>
Nov 06 13:21:02 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:21:02 user nova-compute[74821]:     </system>
Nov 06 13:21:02 user nova-compute[74821]:   </sysinfo>
Nov 06 13:21:02 user nova-compute[74821]:   <os>
Nov 06 13:21:02 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:21:02 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:21:02 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:21:02 user nova-compute[74821]:   </os>
Nov 06 13:21:02 user nova-compute[74821]:   <features>
Nov 06 13:21:02 user nova-compute[74821]:     <acpi/>
Nov 06 13:21:02 user nova-compute[74821]:     <apic/>
Nov 06 13:21:02 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:21:02 user nova-compute[74821]:   </features>
Nov 06 13:21:02 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:21:02 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:21:02 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:21:02 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:21:02 user nova-compute[74821]:   </clock>
Nov 06 13:21:02 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:21:02 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:21:02 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:21:02 user nova-compute[74821]:   </cpu>
Nov 06 13:21:02 user nova-compute[74821]:   <devices>
Nov 06 13:21:02 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:21:02 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:21:02 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/6a895162-eec9-4e5f-a7d3-bd36155da4b8/disk"/>
Nov 06 13:21:02 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:21:02 user nova-compute[74821]:     </disk>
Nov 06 13:21:02 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:21:02 user nova-compute[74821]:       <mac address="fa:16:3e:f3:db:11"/>
Nov 06 13:21:02 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:21:02 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:21:02 user nova-compute[74821]:       <target dev="tapc7d3274f-f8"/>
Nov 06 13:21:02 user nova-compute[74821]:     </interface>
Nov 06 13:21:02 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:21:02 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/6a895162-eec9-4e5f-a7d3-bd36155da4b8/console.log" append="off"/>
Nov 06 13:21:02 user nova-compute[74821]:     </serial>
Nov 06 13:21:02 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:21:02 user nova-compute[74821]:     <video>
Nov 06 13:21:02 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:21:02 user nova-compute[74821]:     </video>
Nov 06 13:21:02 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:21:02 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:21:02 user nova-compute[74821]:     </rng>
Nov 06 13:21:02 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:21:02 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:21:02 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:21:02 user nova-compute[74821]:     </memballoon>
Nov 06 13:21:02 user nova-compute[74821]:   </devices>
Nov 06 13:21:02 user nova-compute[74821]: </domain>
Nov 06 13:21:02 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:20:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-773710014',display_name='tempest-VolumesAdminNegativeTest-server-773710014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-773710014',id=26,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc877e77ae92437f8ae2f5e4d9b65947',ramdisk_id='',reservation_id='r-a7t3j59l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-610056100',owner_user_name='tempest-VolumesAdminNegativeTest-610056100-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:21:01Z,user_data=None,user_id='d0b7addf6de74979a206dfccac04f475',uuid=6a895162-eec9-4e5f-a7d3-bd36155da4b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7d3274f-f84f-4e54-bd58-12ccd3e3aabc", "address": "fa:16:3e:f3:db:11", "network": {"id": "221da9ed-3df1-4f6c-91b0-ec4117f186f9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-999229259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc877e77ae92437f8ae2f5e4d9b65947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7d3274f-f8", "ovs_interfaceid": "c7d3274f-f84f-4e54-bd58-12ccd3e3aabc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Converting VIF {"id": "c7d3274f-f84f-4e54-bd58-12ccd3e3aabc", "address": "fa:16:3e:f3:db:11", "network": {"id": "221da9ed-3df1-4f6c-91b0-ec4117f186f9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-999229259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc877e77ae92437f8ae2f5e4d9b65947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7d3274f-f8", "ovs_interfaceid": "c7d3274f-f84f-4e54-bd58-12ccd3e3aabc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:db:11,bridge_name='br-int',has_traffic_filtering=True,id=c7d3274f-f84f-4e54-bd58-12ccd3e3aabc,network=Network(221da9ed-3df1-4f6c-91b0-ec4117f186f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7d3274f-f8') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG os_vif [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:db:11,bridge_name='br-int',has_traffic_filtering=True,id=c7d3274f-f84f-4e54-bd58-12ccd3e3aabc,network=Network(221da9ed-3df1-4f6c-91b0-ec4117f186f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7d3274f-f8') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '00124d0a-c99d-58c1-83e6-f46fa4b728be', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7d3274f-f8, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc7d3274f-f8, col_values=(('qos', UUID('a8fca32d-ecca-4817-a141-98c1bfc93dbc')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc7d3274f-f8, col_values=(('external_ids', {'iface-id': 'c7d3274f-f84f-4e54-bd58-12ccd3e3aabc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:db:11', 'vm-uuid': '6a895162-eec9-4e5f-a7d3-bd36155da4b8'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:02 user nova-compute[74821]: INFO os_vif [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:db:11,bridge_name='br-int',has_traffic_filtering=True,id=c7d3274f-f84f-4e54-bd58-12ccd3e3aabc,network=Network(221da9ed-3df1-4f6c-91b0-ec4117f186f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7d3274f-f8')
Nov 06 13:21:02 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] No VIF found with MAC fa:16:3e:f3:db:11, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG nova.network.neutron [req-c4d5fe75-12ae-4e41-bbad-918710f97879 req-0ea39946-8f56-44ba-8a6b-5fd362f246d5 service nova] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Updated VIF entry in instance network info cache for port c7d3274f-f84f-4e54-bd58-12ccd3e3aabc. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG nova.network.neutron [req-c4d5fe75-12ae-4e41-bbad-918710f97879 req-0ea39946-8f56-44ba-8a6b-5fd362f246d5 service nova] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Updating instance_info_cache with network_info: [{"id": "c7d3274f-f84f-4e54-bd58-12ccd3e3aabc", "address": "fa:16:3e:f3:db:11", "network": {"id": "221da9ed-3df1-4f6c-91b0-ec4117f186f9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-999229259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc877e77ae92437f8ae2f5e4d9b65947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7d3274f-f8", "ovs_interfaceid": "c7d3274f-f84f-4e54-bd58-12ccd3e3aabc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:21:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c4d5fe75-12ae-4e41-bbad-918710f97879 req-0ea39946-8f56-44ba-8a6b-5fd362f246d5 service nova] Releasing lock "refresh_cache-6a895162-eec9-4e5f-a7d3-bd36155da4b8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:21:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:04 user nova-compute[74821]: DEBUG nova.compute.manager [req-312e223c-fc26-4148-8c12-4260fc68999e req-6e5b37eb-ac88-46f3-afe8-000d1dd191ff service nova] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Received event network-vif-plugged-c7d3274f-f84f-4e54-bd58-12ccd3e3aabc {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:21:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-312e223c-fc26-4148-8c12-4260fc68999e req-6e5b37eb-ac88-46f3-afe8-000d1dd191ff service nova] Acquiring lock "6a895162-eec9-4e5f-a7d3-bd36155da4b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:21:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-312e223c-fc26-4148-8c12-4260fc68999e req-6e5b37eb-ac88-46f3-afe8-000d1dd191ff service nova] Lock "6a895162-eec9-4e5f-a7d3-bd36155da4b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:21:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-312e223c-fc26-4148-8c12-4260fc68999e req-6e5b37eb-ac88-46f3-afe8-000d1dd191ff service nova] Lock "6a895162-eec9-4e5f-a7d3-bd36155da4b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:21:04 user nova-compute[74821]: DEBUG nova.compute.manager [req-312e223c-fc26-4148-8c12-4260fc68999e req-6e5b37eb-ac88-46f3-afe8-000d1dd191ff service nova] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] No waiting events found dispatching network-vif-plugged-c7d3274f-f84f-4e54-bd58-12ccd3e3aabc {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:21:04 user nova-compute[74821]: WARNING nova.compute.manager [req-312e223c-fc26-4148-8c12-4260fc68999e req-6e5b37eb-ac88-46f3-afe8-000d1dd191ff service nova] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Received unexpected event network-vif-plugged-c7d3274f-f84f-4e54-bd58-12ccd3e3aabc for instance with vm_state building and task_state spawning.
Nov 06 13:21:04 user nova-compute[74821]: DEBUG nova.compute.manager [req-c63dd06f-2c22-408e-8f53-0b315b94ca0e req-bcb87da1-a3fe-4cf1-833a-5f905c58cae0 service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received event network-changed-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:21:04 user nova-compute[74821]: DEBUG nova.compute.manager [req-c63dd06f-2c22-408e-8f53-0b315b94ca0e req-bcb87da1-a3fe-4cf1-833a-5f905c58cae0 service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Refreshing instance network info cache due to event network-changed-b5020053-395f-4341-99be-d522ebb938c7. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:21:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c63dd06f-2c22-408e-8f53-0b315b94ca0e req-bcb87da1-a3fe-4cf1-833a-5f905c58cae0 service nova] Acquiring lock "refresh_cache-61beb251-4345-44e6-a176-5c14c99c9a52" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:21:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c63dd06f-2c22-408e-8f53-0b315b94ca0e req-bcb87da1-a3fe-4cf1-833a-5f905c58cae0 service nova] Acquired lock "refresh_cache-61beb251-4345-44e6-a176-5c14c99c9a52" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:21:04 user nova-compute[74821]: DEBUG nova.network.neutron [req-c63dd06f-2c22-408e-8f53-0b315b94ca0e req-bcb87da1-a3fe-4cf1-833a-5f905c58cae0 service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Refreshing network info cache for port b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:21:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:21:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvHqMJOQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:21:04 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:21:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:21:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:21:04 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:21:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:21:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:21:04 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:21:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0b6c21-7eea-4d2a-9360-54d42f635662]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:21:04 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:21:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d80f5e-4fbc-4be3-89c6-c9d5af96aa2f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116] added
Nov 06 13:21:04 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:21:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e1d873-0e98-4330-b63f-80c764f97a67]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "61beb251-4345-44e6-a176-5c14c99c9a52" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "61beb251-4345-44e6-a176-5c14c99c9a52" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG nova.objects.instance [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lazy-loading 'flavor' on Instance uuid 61beb251-4345-44e6-a176-5c14c99c9a52 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f491f0a-00a3-4f63-9822-eac82996ac88]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TvHqMJOQ {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TvHqMJOQ" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51f22d8-4a7e-4caf-b043-2461b6d7a12b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TvHqMJOQ'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "61beb251-4345-44e6-a176-5c14c99c9a52" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[df596a79-78d6-44dc-a12f-c8c5175ece14]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2953e8b-3367-4b05-948d-23cd12090e8d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:21:05 user nova-compute[74821]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:21:05 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:21:05 user nova-compute[74821]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:21:05 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1554a531-838a-4bba-b053-e5133dd6cfac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116, portal: 172.16.0.220,3260]
Nov 06 13:21:05 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116, portal: 172.16.0.220,3260] successful.
Nov 06 13:21:05 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ca5451-5b8b-45b3-a8c9-f1d5cf1a8e89]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG nova.network.neutron [req-c63dd06f-2c22-408e-8f53-0b315b94ca0e req-bcb87da1-a3fe-4cf1-833a-5f905c58cae0 service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Updated VIF entry in instance network info cache for port b5020053-395f-4341-99be-d522ebb938c7. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG nova.network.neutron [req-c63dd06f-2c22-408e-8f53-0b315b94ca0e req-bcb87da1-a3fe-4cf1-833a-5f905c58cae0 service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Updating instance_info_cache with network_info: [{"id": "b5020053-395f-4341-99be-d522ebb938c7", "address": "fa:16:3e:d4:3e:f8", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5020053-39", "ovs_interfaceid": "b5020053-395f-4341-99be-d522ebb938c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed099c0-ce7c-41a7-a465-2b41b1389d63]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:21:05 user nova-compute[74821]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:21:05 user nova-compute[74821]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)
Nov 06 13:21:05 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:21:05 user nova-compute[74821]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:21:05 user nova-compute[74821]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)
Nov 06 13:21:05 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "61beb251-4345-44e6-a176-5c14c99c9a52" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "61beb251-4345-44e6-a176-5c14c99c9a52" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:21:05 user nova-compute[74821]: INFO nova.compute.manager [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Attaching volume 49867154-3b9b-4759-9ffc-dd03572f28f0 to /dev/vdb
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c63dd06f-2c22-408e-8f53-0b315b94ca0e req-bcb87da1-a3fe-4cf1-833a-5f905c58cae0 service nova] Releasing lock "refresh_cache-61beb251-4345-44e6-a176-5c14c99c9a52" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1a2b00-affa-4f06-b87f-f6924282a5ef]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvHqMJOQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG os_brick.utils [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0f57fe-4f41-4f3d-84d2-241c40b4883c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb816b59-b77d-4938-8bcd-364c73863542]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6d0778-3c28-41f6-93d7-542fc991ed38]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5de28d6-e81c-4810-af78-3a6687021d42]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:21:05 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:21:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fb1e20-2f69-4ca6-aeda-a17b5fb94327]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG os_brick.utils [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:21:05 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Updating existing volume attachment record: 4846732e-0497-46a7-a530-879e7af0bea4 {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:21:06 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:21:06 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23833653836313031', 'path': '/dev/sdb'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:21:06 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833653836313031', 'path': '/dev/sdb'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:21:06 user nova-compute[74821]: DEBUG nova.objects.instance [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lazy-loading 'flavor' on Instance uuid 290cd798-a041-40c0-8ef9-319d3627ff82 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:21:06 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 13:21:06 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:21:06 user nova-compute[74821]:   <source dev="/dev/sdb"/>
Nov 06 13:21:06 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:21:06 user nova-compute[74821]:   <serial>c27cae42-439c-4fd6-8c64-b7a0144f2116</serial>
Nov 06 13:21:06 user nova-compute[74821]: </disk>
Nov 06 13:21:06 user nova-compute[74821]:  {{(pid=74821) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 13:21:06 user nova-compute[74821]: DEBUG nova.compute.manager [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:21:06 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:21:06 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Instance spawned successfully.
Nov 06 13:21:06 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:21:06 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:21:06 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:21:06 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:21:06 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:21:06 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:21:06 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:21:06 user nova-compute[74821]: DEBUG nova.compute.manager [req-b10a9aa0-2999-42ff-94c1-23cf1c88ba95 req-d5e4216e-c87f-440a-addf-43d041c4ca1f service nova] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Received event network-vif-plugged-c7d3274f-f84f-4e54-bd58-12ccd3e3aabc {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:21:06 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b10a9aa0-2999-42ff-94c1-23cf1c88ba95 req-d5e4216e-c87f-440a-addf-43d041c4ca1f service nova] Acquiring lock "6a895162-eec9-4e5f-a7d3-bd36155da4b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:21:06 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b10a9aa0-2999-42ff-94c1-23cf1c88ba95 req-d5e4216e-c87f-440a-addf-43d041c4ca1f service nova] Lock "6a895162-eec9-4e5f-a7d3-bd36155da4b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:21:06 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b10a9aa0-2999-42ff-94c1-23cf1c88ba95 req-d5e4216e-c87f-440a-addf-43d041c4ca1f service nova] Lock "6a895162-eec9-4e5f-a7d3-bd36155da4b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:21:06 user nova-compute[74821]: DEBUG nova.compute.manager [req-b10a9aa0-2999-42ff-94c1-23cf1c88ba95 req-d5e4216e-c87f-440a-addf-43d041c4ca1f service nova] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] No waiting events found dispatching network-vif-plugged-c7d3274f-f84f-4e54-bd58-12ccd3e3aabc {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:21:06 user nova-compute[74821]: WARNING nova.compute.manager [req-b10a9aa0-2999-42ff-94c1-23cf1c88ba95 req-d5e4216e-c87f-440a-addf-43d041c4ca1f service nova] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Received unexpected event network-vif-plugged-c7d3274f-f84f-4e54-bd58-12ccd3e3aabc for instance with vm_state building and task_state spawning.
Nov 06 13:21:06 user nova-compute[74821]: INFO nova.compute.manager [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Took 6.02 seconds to spawn the instance on the hypervisor.
Nov 06 13:21:06 user nova-compute[74821]: DEBUG nova.compute.manager [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:21:06 user nova-compute[74821]: INFO nova.compute.manager [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Took 6.91 seconds to build instance.
Nov 06 13:21:06 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-79cfe63e-be9f-4b3f-bcff-757899703d75 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "6a895162-eec9-4e5f-a7d3-bd36155da4b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.019s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:21:06 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:21:06 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:21:06 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] No VIF found with MAC fa:16:3e:6c:6c:87, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:21:06 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c37ef2cc-11ed-4b13-8b9f-0884e41b388c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "290cd798-a041-40c0-8ef9-319d3627ff82" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.044s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:21:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:08 user nova-compute[74821]: INFO nova.compute.manager [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Rebuilding instance
Nov 06 13:21:08 user nova-compute[74821]: DEBUG nova.compute.manager [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:21:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:08 user nova-compute[74821]: DEBUG nova.compute.manager [req-fd0d965a-257d-4c0c-a465-9e9bbb8b9d57 req-efe50b4b-8a6e-489c-acf2-d2565b62769b service nova] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Received event network-vif-unplugged-741cb43d-19ba-4edc-92f0-5de562bf4c2c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:21:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fd0d965a-257d-4c0c-a465-9e9bbb8b9d57 req-efe50b4b-8a6e-489c-acf2-d2565b62769b service nova] Acquiring lock "290cd798-a041-40c0-8ef9-319d3627ff82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:21:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fd0d965a-257d-4c0c-a465-9e9bbb8b9d57 req-efe50b4b-8a6e-489c-acf2-d2565b62769b service nova] Lock "290cd798-a041-40c0-8ef9-319d3627ff82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:21:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fd0d965a-257d-4c0c-a465-9e9bbb8b9d57 req-efe50b4b-8a6e-489c-acf2-d2565b62769b service nova] Lock "290cd798-a041-40c0-8ef9-319d3627ff82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:21:08 user nova-compute[74821]: DEBUG nova.compute.manager [req-fd0d965a-257d-4c0c-a465-9e9bbb8b9d57 req-efe50b4b-8a6e-489c-acf2-d2565b62769b service nova] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] No waiting events found dispatching network-vif-unplugged-741cb43d-19ba-4edc-92f0-5de562bf4c2c {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:21:08 user nova-compute[74821]: WARNING nova.compute.manager [req-fd0d965a-257d-4c0c-a465-9e9bbb8b9d57 req-efe50b4b-8a6e-489c-acf2-d2565b62769b service nova] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Received unexpected event network-vif-unplugged-741cb43d-19ba-4edc-92f0-5de562bf4c2c for instance with vm_state active and task_state rebuilding.
Nov 06 13:21:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:09 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Instance destroyed successfully.
Nov 06 13:21:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:09 user nova-compute[74821]: INFO nova.compute.manager [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Detaching volume c27cae42-439c-4fd6-8c64-b7a0144f2116
Nov 06 13:21:09 user nova-compute[74821]: INFO nova.virt.block_device [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Attempting to driver detach volume c27cae42-439c-4fd6-8c64-b7a0144f2116 from mountpoint /dev/vdb
Nov 06 13:21:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Attempting to detach device vdb from instance 290cd798-a041-40c0-8ef9-319d3627ff82 from the persistent domain config. {{(pid=74821) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:21:09 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:21:09 user nova-compute[74821]:   <source dev="/dev/sdb"/>
Nov 06 13:21:09 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:21:09 user nova-compute[74821]:   <serial>c27cae42-439c-4fd6-8c64-b7a0144f2116</serial>
Nov 06 13:21:09 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:21:09 user nova-compute[74821]: </disk>
Nov 06 13:21:09 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:21:09 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Successfully detached device vdb from instance 290cd798-a041-40c0-8ef9-319d3627ff82 from the persistent domain config.
Nov 06 13:21:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvHqMJOQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:21:09 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 06 13:21:09 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dec6460-d3d1-4158-84e0-62174764c821]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:21:09 user nova-compute[74821]: No targets found.
Nov 06 13:21:09 user nova-compute[74821]: iSNS:
Nov 06 13:21:09 user nova-compute[74821]: No targets found.
Nov 06 13:21:09 user nova-compute[74821]: STATIC:
Nov 06 13:21:09 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116
Nov 06 13:21:09 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:21:09 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:21:09 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5
Nov 06 13:21:09 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:21:09 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:21:09 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979
Nov 06 13:21:09 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:21:09 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:21:09 user nova-compute[74821]: FIRMWARE:
Nov 06 13:21:09 user nova-compute[74821]: No targets found.
Nov 06 13:21:09 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:21:09 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:21:09 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c05e03-0dd1-4f4b-9063-a307f5617274]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f090584-5435-411c-9b9a-e234433d1f4a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:21:09 user nova-compute[74821]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:21:09 user nova-compute[74821]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)
Nov 06 13:21:09 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:21:09 user nova-compute[74821]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:21:09 user nova-compute[74821]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)
Nov 06 13:21:09 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e40586050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116'): ({'sdb'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Removing single pathed devices sdb {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1e46a8-ec93-4b40-b87f-de24bf3d2e8c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d626f98c-6a31-4f94-a862-c3a46477e85f]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Flushing IO for device /dev/sdb {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d92dfa7-bcd4-4a8d-beb0-9f815bac7efc]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8997bb53-3a4a-465a-b311-c12eb47b2cf6]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] SCSI volumes sdb have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4ce134-56de-4e6d-ae2d-a6c5d7c12d0f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f626b537-481d-46c5-87da-519850f30a16]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116, portal: 172.16.0.220,3260]
Nov 06 13:21:09 user nova-compute[74821]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116, portal: 172.16.0.220,3260] successful.
Nov 06 13:21:09 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed599b7b-13d4-4d5d-b4d7-f9a10fac4ee3]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] <== disconnect_volume: return (373ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:21:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:21:10 user nova-compute[74821]: DEBUG nova.compute.manager [req-b7a81f0b-d9a1-4bdc-8882-934aef13972d req-b8e8862d-e4ae-4447-b354-aa9ab83c667c service nova] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Received event network-vif-plugged-741cb43d-19ba-4edc-92f0-5de562bf4c2c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:21:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b7a81f0b-d9a1-4bdc-8882-934aef13972d req-b8e8862d-e4ae-4447-b354-aa9ab83c667c service nova] Acquiring lock "290cd798-a041-40c0-8ef9-319d3627ff82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:21:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b7a81f0b-d9a1-4bdc-8882-934aef13972d req-b8e8862d-e4ae-4447-b354-aa9ab83c667c service nova] Lock "290cd798-a041-40c0-8ef9-319d3627ff82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:21:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b7a81f0b-d9a1-4bdc-8882-934aef13972d req-b8e8862d-e4ae-4447-b354-aa9ab83c667c service nova] Lock "290cd798-a041-40c0-8ef9-319d3627ff82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:21:10 user nova-compute[74821]: DEBUG nova.compute.manager [req-b7a81f0b-d9a1-4bdc-8882-934aef13972d req-b8e8862d-e4ae-4447-b354-aa9ab83c667c service nova] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] No waiting events found dispatching network-vif-plugged-741cb43d-19ba-4edc-92f0-5de562bf4c2c {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:21:10 user nova-compute[74821]: WARNING nova.compute.manager [req-b7a81f0b-d9a1-4bdc-8882-934aef13972d req-b8e8862d-e4ae-4447-b354-aa9ab83c667c service nova] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Received unexpected event network-vif-plugged-741cb43d-19ba-4edc-92f0-5de562bf4c2c for instance with vm_state active and task_state rebuilding.
Nov 06 13:21:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:14 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:21:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:25 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:21:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:28 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:29 user nova-compute[74821]: INFO nova.compute.manager [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Rescuing
Nov 06 13:21:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "refresh_cache-496f8213-4b32-4211-a354-e33a4a088848" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquired lock "refresh_cache-496f8213-4b32-4211-a354-e33a4a088848" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG nova.network.neutron [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:21:29 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Instance destroyed successfully.
Nov 06 13:21:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:18:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-219751972',display_name='tempest-ServerActionsTestOtherA-server-1045248039',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-219751972',id=21,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGVJpgtmRZL9WKhOaXwD5m/EAyvGSguG6jTTT7b4IRvn135izX0urMafelC8vQXZBMR8O1HoZmDg8wWA0Bz8SPSg87ol6FREXNQzdTu5vhYkn54jvZdlsWdAb1XlCYP+3Q==',key_name='tempest-keypair-1473532461',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:18:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='77233758870b4fdfbb7ca76829f0f82e',ramdisk_id='',reservation_id='r-4lip00k3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1986828412',owner_user_name='tempest-ServerActionsTestOtherA-1986828412-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:21:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0620d1928d8d434fbe0bc1cdb31a2a89',uuid=290cd798-a041-40c0-8ef9-319d3627ff82,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "address": "fa:16:3e:6c:6c:87", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap741cb43d-19", "ovs_interfaceid": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Converting VIF {"id": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "address": "fa:16:3e:6c:6c:87", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap741cb43d-19", "ovs_interfaceid": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:6c:87,bridge_name='br-int',has_traffic_filtering=True,id=741cb43d-19ba-4edc-92f0-5de562bf4c2c,network=Network(a3838abe-b3bb-4878-9d5d-eb80a8cf60a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap741cb43d-19') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG os_vif [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:6c:87,bridge_name='br-int',has_traffic_filtering=True,id=741cb43d-19ba-4edc-92f0-5de562bf4c2c,network=Network(a3838abe-b3bb-4878-9d5d-eb80a8cf60a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap741cb43d-19') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap741cb43d-19, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fd612e67-2fa4-4555-92ac-b82a64f848bb) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:29 user nova-compute[74821]: INFO os_vif [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:6c:87,bridge_name='br-int',has_traffic_filtering=True,id=741cb43d-19ba-4edc-92f0-5de562bf4c2c,network=Network(a3838abe-b3bb-4878-9d5d-eb80a8cf60a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap741cb43d-19')
Nov 06 13:21:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvHqMJOQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:21:29 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 06 13:21:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ef9f9b-8630-469b-ad36-53f6b6b6bad0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:21:29 user nova-compute[74821]: No targets found.
Nov 06 13:21:29 user nova-compute[74821]: iSNS:
Nov 06 13:21:29 user nova-compute[74821]: No targets found.
Nov 06 13:21:29 user nova-compute[74821]: STATIC:
Nov 06 13:21:29 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5
Nov 06 13:21:29 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:21:29 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:21:29 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979
Nov 06 13:21:29 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:21:29 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:21:29 user nova-compute[74821]: FIRMWARE:
Nov 06 13:21:29 user nova-compute[74821]: No targets found.
Nov 06 13:21:29 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:21:29 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:21:29 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf3adf4-cdcd-47df-9492-0cb086b77710]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d32167-f416-4a19-a240-f76e1cfad3ec]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:21:29 user nova-compute[74821]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:21:29 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:21:29 user nova-compute[74821]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:21:29 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e404975b0>, {}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Disconnecting from: [] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.108s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] <== disconnect_volume: return (111ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:21:29 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Deleting instance files /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82_del
Nov 06 13:21:29 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Deletion of /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82_del complete
Nov 06 13:21:29 user nova-compute[74821]: INFO nova.virt.block_device [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Booting with volume c27cae42-439c-4fd6-8c64-b7a0144f2116 at /dev/vdb
Nov 06 13:21:29 user nova-compute[74821]: DEBUG os_brick.utils [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9698b85-c52b-487c-9c6d-6344af88d5f4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2341271f-875b-4b95-b14b-34415245683b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad373ec-c7fa-4993-9e6e-390af48bd8f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f6ba9e-a230-40b4-bc62-c1701b324a8c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ekCMXWZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:21:30 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:21:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:21:30 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:21:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:21:30 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:21:30 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[520acae8-a647-4730-a326-3053277ce40b]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG os_brick.utils [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Updating existing volume attachment record: 06a59f45-5cac-46e3-be3a-bb6ca6176201 {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e11e467-4c86-4dac-b065-29e2f8a2e591]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:21:30 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[937fe044-12e4-4659-ba35-dbe5080d0124]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0] added
Nov 06 13:21:30 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[767694e0-16e3-42bd-8c85-49aeb640c2aa]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[475cbd14-032c-4218-8148-18db65041285]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ekCMXWZf {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ekCMXWZf" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31db076-afea-4b2b-8daf-fe994cefb2fd]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ekCMXWZf'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ae5b9b-be59-497f-8a68-a5d22751e8c2]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG nova.network.neutron [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Updating instance_info_cache with network_info: [{"id": "0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc", "address": "fa:16:3e:de:d4:5d", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dbd0a11-07", "ovs_interfaceid": "0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[05127d85-dccb-4b71-a97c-1490aa27368d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Releasing lock "refresh_cache-496f8213-4b32-4211-a354-e33a4a088848" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:21:30 user nova-compute[74821]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:21:30 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:21:30 user nova-compute[74821]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:21:30 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdcad97-db7e-4c0b-9be7-e4320f58d8a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0, portal: 172.16.0.220,3260]
Nov 06 13:21:30 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0, portal: 172.16.0.220,3260] successful.
Nov 06 13:21:30 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc96631-9d2d-4442-b0e1-51b75ee7c675]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b57cc1-b6e5-4210-87a4-ad2a2e551183]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:21:30 user nova-compute[74821]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:21:30 user nova-compute[74821]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)
Nov 06 13:21:30 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:21:30 user nova-compute[74821]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:21:30 user nova-compute[74821]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)
Nov 06 13:21:30 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.038s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b28461-7715-4279-9889-95c11acb1ba2]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ekCMXWZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG nova.compute.manager [req-667a243f-1955-4b45-a090-641d57fa85cc req-665bf623-cdcc-4d1d-a08b-cd88a350f0d1 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Received event network-vif-unplugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-667a243f-1955-4b45-a090-641d57fa85cc req-665bf623-cdcc-4d1d-a08b-cd88a350f0d1 service nova] Acquiring lock "496f8213-4b32-4211-a354-e33a4a088848-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-667a243f-1955-4b45-a090-641d57fa85cc req-665bf623-cdcc-4d1d-a08b-cd88a350f0d1 service nova] Lock "496f8213-4b32-4211-a354-e33a4a088848-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-667a243f-1955-4b45-a090-641d57fa85cc req-665bf623-cdcc-4d1d-a08b-cd88a350f0d1 service nova] Lock "496f8213-4b32-4211-a354-e33a4a088848-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:21:30 user nova-compute[74821]: DEBUG nova.compute.manager [req-667a243f-1955-4b45-a090-641d57fa85cc req-665bf623-cdcc-4d1d-a08b-cd88a350f0d1 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] No waiting events found dispatching network-vif-unplugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:21:30 user nova-compute[74821]: WARNING nova.compute.manager [req-667a243f-1955-4b45-a090-641d57fa85cc req-665bf623-cdcc-4d1d-a08b-cd88a350f0d1 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Received unexpected event network-vif-unplugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc for instance with vm_state active and task_state rescuing.
Nov 06 13:21:30 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:21:31 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:31 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:31 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Instance destroyed successfully.
Nov 06 13:21:31 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Attempting a stable device rescue
Nov 06 13:21:31 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74821) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 06 13:21:31 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Instance directory exists: not creating {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 06 13:21:31 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Creating image(s)
Nov 06 13:21:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "/opt/stack/data/nova/instances/496f8213-4b32-4211-a354-e33a4a088848/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:21:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "/opt/stack/data/nova/instances/496f8213-4b32-4211-a354-e33a4a088848/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:21:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "/opt/stack/data/nova/instances/496f8213-4b32-4211-a354-e33a4a088848/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:21:31 user nova-compute[74821]: DEBUG nova.objects.instance [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lazy-loading 'trusted_certs' on Instance uuid 496f8213-4b32-4211-a354-e33a4a088848 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:21:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "98547e8463b3ef6269735b89a9ed2b90250539b7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:21:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "98547e8463b3ef6269735b89a9ed2b90250539b7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:21:31 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:31 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:31 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:21:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '26166303866343063', 'path': '/dev/sdb'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:21:31 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166303866343063', 'path': '/dev/sdb'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:21:31 user nova-compute[74821]: DEBUG nova.objects.instance [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lazy-loading 'flavor' on Instance uuid 61beb251-4345-44e6-a176-5c14c99c9a52 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:21:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98547e8463b3ef6269735b89a9ed2b90250539b7.part --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 13:21:32 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:21:32 user nova-compute[74821]:   <source dev="/dev/sdb"/>
Nov 06 13:21:32 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:21:32 user nova-compute[74821]:   <serial>49867154-3b9b-4759-9ffc-dd03572f28f0</serial>
Nov 06 13:21:32 user nova-compute[74821]: </disk>
Nov 06 13:21:32 user nova-compute[74821]:  {{(pid=74821) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 13:21:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98547e8463b3ef6269735b89a9ed2b90250539b7.part --force-share --output=json" returned: 0 in 0.183s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:32 user nova-compute[74821]: DEBUG nova.virt.images [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] f789e9c3-0f1e-4444-80c9-d08fa1352e4f was qcow2, converting to raw {{(pid=74821) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 13:21:32 user nova-compute[74821]: DEBUG nova.privsep.utils [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74821) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 13:21:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/98547e8463b3ef6269735b89a9ed2b90250539b7.part /opt/stack/data/nova/instances/_base/98547e8463b3ef6269735b89a9ed2b90250539b7.converted {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:32 user nova-compute[74821]: DEBUG nova.compute.manager [req-3b24c89d-e17a-49e5-94bc-5b7a12afa3b7 req-5b95504a-3b40-4784-8f81-6d49507957b3 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Received event network-vif-plugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:21:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3b24c89d-e17a-49e5-94bc-5b7a12afa3b7 req-5b95504a-3b40-4784-8f81-6d49507957b3 service nova] Acquiring lock "496f8213-4b32-4211-a354-e33a4a088848-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:21:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3b24c89d-e17a-49e5-94bc-5b7a12afa3b7 req-5b95504a-3b40-4784-8f81-6d49507957b3 service nova] Lock "496f8213-4b32-4211-a354-e33a4a088848-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:21:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3b24c89d-e17a-49e5-94bc-5b7a12afa3b7 req-5b95504a-3b40-4784-8f81-6d49507957b3 service nova] Lock "496f8213-4b32-4211-a354-e33a4a088848-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:21:32 user nova-compute[74821]: DEBUG nova.compute.manager [req-3b24c89d-e17a-49e5-94bc-5b7a12afa3b7 req-5b95504a-3b40-4784-8f81-6d49507957b3 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] No waiting events found dispatching network-vif-plugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:21:32 user nova-compute[74821]: WARNING nova.compute.manager [req-3b24c89d-e17a-49e5-94bc-5b7a12afa3b7 req-5b95504a-3b40-4784-8f81-6d49507957b3 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Received unexpected event network-vif-plugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc for instance with vm_state active and task_state rescuing.
Nov 06 13:21:32 user nova-compute[74821]: DEBUG nova.compute.manager [req-3b24c89d-e17a-49e5-94bc-5b7a12afa3b7 req-5b95504a-3b40-4784-8f81-6d49507957b3 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Received event network-vif-plugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:21:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3b24c89d-e17a-49e5-94bc-5b7a12afa3b7 req-5b95504a-3b40-4784-8f81-6d49507957b3 service nova] Acquiring lock "496f8213-4b32-4211-a354-e33a4a088848-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:21:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3b24c89d-e17a-49e5-94bc-5b7a12afa3b7 req-5b95504a-3b40-4784-8f81-6d49507957b3 service nova] Lock "496f8213-4b32-4211-a354-e33a4a088848-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:21:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3b24c89d-e17a-49e5-94bc-5b7a12afa3b7 req-5b95504a-3b40-4784-8f81-6d49507957b3 service nova] Lock "496f8213-4b32-4211-a354-e33a4a088848-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:21:32 user nova-compute[74821]: DEBUG nova.compute.manager [req-3b24c89d-e17a-49e5-94bc-5b7a12afa3b7 req-5b95504a-3b40-4784-8f81-6d49507957b3 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] No waiting events found dispatching network-vif-plugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:21:32 user nova-compute[74821]: WARNING nova.compute.manager [req-3b24c89d-e17a-49e5-94bc-5b7a12afa3b7 req-5b95504a-3b40-4784-8f81-6d49507957b3 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Received unexpected event network-vif-plugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc for instance with vm_state active and task_state rescuing.
Nov 06 13:21:32 user nova-compute[74821]: DEBUG nova.compute.manager [req-3b24c89d-e17a-49e5-94bc-5b7a12afa3b7 req-5b95504a-3b40-4784-8f81-6d49507957b3 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Received event network-vif-plugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:21:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3b24c89d-e17a-49e5-94bc-5b7a12afa3b7 req-5b95504a-3b40-4784-8f81-6d49507957b3 service nova] Acquiring lock "496f8213-4b32-4211-a354-e33a4a088848-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:21:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3b24c89d-e17a-49e5-94bc-5b7a12afa3b7 req-5b95504a-3b40-4784-8f81-6d49507957b3 service nova] Lock "496f8213-4b32-4211-a354-e33a4a088848-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:21:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3b24c89d-e17a-49e5-94bc-5b7a12afa3b7 req-5b95504a-3b40-4784-8f81-6d49507957b3 service nova] Lock "496f8213-4b32-4211-a354-e33a4a088848-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:21:32 user nova-compute[74821]: DEBUG nova.compute.manager [req-3b24c89d-e17a-49e5-94bc-5b7a12afa3b7 req-5b95504a-3b40-4784-8f81-6d49507957b3 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] No waiting events found dispatching network-vif-plugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:21:32 user nova-compute[74821]: WARNING nova.compute.manager [req-3b24c89d-e17a-49e5-94bc-5b7a12afa3b7 req-5b95504a-3b40-4784-8f81-6d49507957b3 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Received unexpected event network-vif-plugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc for instance with vm_state active and task_state rescuing.
Nov 06 13:21:32 user nova-compute[74821]: DEBUG nova.compute.manager [req-3b24c89d-e17a-49e5-94bc-5b7a12afa3b7 req-5b95504a-3b40-4784-8f81-6d49507957b3 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Received event network-vif-unplugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:21:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3b24c89d-e17a-49e5-94bc-5b7a12afa3b7 req-5b95504a-3b40-4784-8f81-6d49507957b3 service nova] Acquiring lock "496f8213-4b32-4211-a354-e33a4a088848-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:21:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3b24c89d-e17a-49e5-94bc-5b7a12afa3b7 req-5b95504a-3b40-4784-8f81-6d49507957b3 service nova] Lock "496f8213-4b32-4211-a354-e33a4a088848-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:21:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3b24c89d-e17a-49e5-94bc-5b7a12afa3b7 req-5b95504a-3b40-4784-8f81-6d49507957b3 service nova] Lock "496f8213-4b32-4211-a354-e33a4a088848-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:21:32 user nova-compute[74821]: DEBUG nova.compute.manager [req-3b24c89d-e17a-49e5-94bc-5b7a12afa3b7 req-5b95504a-3b40-4784-8f81-6d49507957b3 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] No waiting events found dispatching network-vif-unplugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:21:32 user nova-compute[74821]: WARNING nova.compute.manager [req-3b24c89d-e17a-49e5-94bc-5b7a12afa3b7 req-5b95504a-3b40-4784-8f81-6d49507957b3 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Received unexpected event network-vif-unplugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc for instance with vm_state active and task_state rescuing.
Nov 06 13:21:32 user nova-compute[74821]: DEBUG nova.compute.manager [req-3b24c89d-e17a-49e5-94bc-5b7a12afa3b7 req-5b95504a-3b40-4784-8f81-6d49507957b3 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Received event network-vif-plugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:21:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3b24c89d-e17a-49e5-94bc-5b7a12afa3b7 req-5b95504a-3b40-4784-8f81-6d49507957b3 service nova] Acquiring lock "496f8213-4b32-4211-a354-e33a4a088848-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:21:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3b24c89d-e17a-49e5-94bc-5b7a12afa3b7 req-5b95504a-3b40-4784-8f81-6d49507957b3 service nova] Lock "496f8213-4b32-4211-a354-e33a4a088848-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:21:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3b24c89d-e17a-49e5-94bc-5b7a12afa3b7 req-5b95504a-3b40-4784-8f81-6d49507957b3 service nova] Lock "496f8213-4b32-4211-a354-e33a4a088848-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:21:32 user nova-compute[74821]: DEBUG nova.compute.manager [req-3b24c89d-e17a-49e5-94bc-5b7a12afa3b7 req-5b95504a-3b40-4784-8f81-6d49507957b3 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] No waiting events found dispatching network-vif-plugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:21:32 user nova-compute[74821]: WARNING nova.compute.manager [req-3b24c89d-e17a-49e5-94bc-5b7a12afa3b7 req-5b95504a-3b40-4784-8f81-6d49507957b3 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Received unexpected event network-vif-plugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc for instance with vm_state active and task_state rescuing.
Nov 06 13:21:32 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:21:32 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:21:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:21:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:21:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] No VIF found with MAC fa:16:3e:d4:3e:f8, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:21:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-2de346cb-9858-47b8-a86c-4fde720d6127" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:21:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-2de346cb-9858-47b8-a86c-4fde720d6127" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:21:33 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:21:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/98547e8463b3ef6269735b89a9ed2b90250539b7.part /opt/stack/data/nova/instances/_base/98547e8463b3ef6269735b89a9ed2b90250539b7.converted" returned: 0 in 0.707s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98547e8463b3ef6269735b89a9ed2b90250539b7.converted --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-363fa86b-8dc7-42cc-9748-ca13827145a6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "61beb251-4345-44e6-a176-5c14c99c9a52" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.304s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:21:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98547e8463b3ef6269735b89a9ed2b90250539b7.converted --force-share --output=json" returned: 0 in 0.214s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "98547e8463b3ef6269735b89a9ed2b90250539b7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.483s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:21:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "98547e8463b3ef6269735b89a9ed2b90250539b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:21:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "98547e8463b3ef6269735b89a9ed2b90250539b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:21:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98547e8463b3ef6269735b89a9ed2b90250539b7 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/98547e8463b3ef6269735b89a9ed2b90250539b7 --force-share --output=json" returned: 0 in 0.202s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98547e8463b3ef6269735b89a9ed2b90250539b7,backing_fmt=raw /opt/stack/data/nova/instances/496f8213-4b32-4211-a354-e33a4a088848/disk.rescue {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/98547e8463b3ef6269735b89a9ed2b90250539b7,backing_fmt=raw /opt/stack/data/nova/instances/496f8213-4b32-4211-a354-e33a4a088848/disk.rescue" returned: 0 in 0.062s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "98547e8463b3ef6269735b89a9ed2b90250539b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:21:33 user nova-compute[74821]: DEBUG nova.objects.instance [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lazy-loading 'migration_context' on Instance uuid 496f8213-4b32-4211-a354-e33a4a088848 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.objects.base [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Object Instance<496f8213-4b32-4211-a354-e33a4a088848> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Start _get_guest_xml network_info=[{"id": "0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc", "address": "fa:16:3e:de:d4:5d", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "vif_mac": "fa:16:3e:de:d4:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dbd0a11-07", "ovs_interfaceid": "0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f789e9c3-0f1e-4444-80c9-d08fa1352e4f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gVPeKGMQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '496f8213-4b32-4211-a354-e33a4a088848', 'attached_at': '', 'detached_at': '', 'volume_id': '4739d8fa-3170-46f4-ac61-fa0fe6aa4979', 'serial': '4739d8fa-3170-46f4-ac61-fa0fe6aa4979'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '198cb9d2-0a76-4638-a87f-752ba260b760', 'volume_type': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.objects.instance [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lazy-loading 'resources' on Instance uuid 496f8213-4b32-4211-a354-e33a4a088848 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.objects.base [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Object Instance<496f8213-4b32-4211-a354-e33a4a088848> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.objects.instance [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lazy-loading 'numa_topology' on Instance uuid 496f8213-4b32-4211-a354-e33a4a088848 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.objects.base [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Object Instance<496f8213-4b32-4211-a354-e33a4a088848> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:21:34 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:21:34 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Updating instance_info_cache with network_info: [{"id": "364b4308-8730-4b11-90a1-48ea6ab3de60", "address": "fa:16:3e:48:8d:c6", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b4308-87", "ovs_interfaceid": "364b4308-8730-4b11-90a1-48ea6ab3de60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.objects.instance [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lazy-loading 'vcpu_model' on Instance uuid 496f8213-4b32-4211-a354-e33a4a088848 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.objects.base [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Object Instance<496f8213-4b32-4211-a354-e33a4a088848> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gVPeKGMQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:21:34 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:21:34 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:21:34 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:21:34 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:21:34 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:21:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-2de346cb-9858-47b8-a86c-4fde720d6127" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:21:34 user nova-compute[74821]: INFO nova.compute.manager [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Rescuing
Nov 06 13:21:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "refresh_cache-61beb251-4345-44e6-a176-5c14c99c9a52" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquired lock "refresh_cache-61beb251-4345-44e6-a176-5c14c99c9a52" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.network.neutron [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad64662-45c6-4df5-9cd7-20357dbe0321]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = gVPeKGMQ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 06 13:21:34 user nova-compute[74821]: node.name = iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979
Nov 06 13:21:34 user nova-compute[74821]: node.tpgt = -1
Nov 06 13:21:34 user nova-compute[74821]: node.startup = automatic
Nov 06 13:21:34 user nova-compute[74821]: node.leading_login = No
Nov 06 13:21:34 user nova-compute[74821]: iface.iscsi_ifacename = default
Nov 06 13:21:34 user nova-compute[74821]: iface.net_ifacename = <empty>
Nov 06 13:21:34 user nova-compute[74821]: iface.ipaddress = <empty>
Nov 06 13:21:34 user nova-compute[74821]: iface.prefix_len = 0
Nov 06 13:21:34 user nova-compute[74821]: iface.hwaddress = <empty>
Nov 06 13:21:34 user nova-compute[74821]: iface.transport_name = tcp
Nov 06 13:21:34 user nova-compute[74821]: iface.initiatorname = <empty>
Nov 06 13:21:34 user nova-compute[74821]: iface.state = <empty>
Nov 06 13:21:34 user nova-compute[74821]: iface.vlan_id = 0
Nov 06 13:21:34 user nova-compute[74821]: iface.vlan_priority = 0
Nov 06 13:21:34 user nova-compute[74821]: iface.vlan_state = <empty>
Nov 06 13:21:34 user nova-compute[74821]: iface.iface_num = 0
Nov 06 13:21:34 user nova-compute[74821]: iface.mtu = 0
Nov 06 13:21:34 user nova-compute[74821]: iface.port = 0
Nov 06 13:21:34 user nova-compute[74821]: iface.bootproto = <empty>
Nov 06 13:21:34 user nova-compute[74821]: iface.subnet_mask = <empty>
Nov 06 13:21:34 user nova-compute[74821]: iface.gateway = <empty>
Nov 06 13:21:34 user nova-compute[74821]: iface.dhcp_alt_client_id_state = <empty>
Nov 06 13:21:34 user nova-compute[74821]: iface.dhcp_alt_client_id = <empty>
Nov 06 13:21:34 user nova-compute[74821]: iface.dhcp_dns = <empty>
Nov 06 13:21:34 user nova-compute[74821]: iface.dhcp_learn_iqn = <empty>
Nov 06 13:21:34 user nova-compute[74821]: iface.dhcp_req_vendor_id_state = <empty>
Nov 06 13:21:34 user nova-compute[74821]: iface.dhcp_vendor_id_state = <empty>
Nov 06 13:21:34 user nova-compute[74821]: iface.dhcp_vendor_id = <empty>
Nov 06 13:21:34 user nova-compute[74821]: iface.dhcp_slp_da = <empty>
Nov 06 13:21:34 user nova-compute[74821]: iface.fragmentation = <empty>
Nov 06 13:21:34 user nova-compute[74821]: iface.gratuitous_arp = <empty>
Nov 06 13:21:34 user nova-compute[74821]: iface.incoming_forwarding = <empty>
Nov 06 13:21:34 user nova-compute[74821]: iface.tos_state = <empty>
Nov 06 13:21:34 user nova-compute[74821]: iface.tos = 0
Nov 06 13:21:34 user nova-compute[74821]: iface.ttl = 0
Nov 06 13:21:34 user nova-compute[74821]: iface.delayed_ack = <empty>
Nov 06 13:21:34 user nova-compute[74821]: iface.tcp_nagle = <empty>
Nov 06 13:21:34 user nova-compute[74821]: iface.tcp_wsf_state = <empty>
Nov 06 13:21:34 user nova-compute[74821]: iface.tcp_wsf = 0
Nov 06 13:21:34 user nova-compute[74821]: iface.tcp_timer_scale = 0
Nov 06 13:21:34 user nova-compute[74821]: iface.tcp_timestamp = <empty>
Nov 06 13:21:34 user nova-compute[74821]: iface.redirect = <empty>
Nov 06 13:21:34 user nova-compute[74821]: iface.def_task_mgmt_timeout = 0
Nov 06 13:21:34 user nova-compute[74821]: iface.header_digest = <empty>
Nov 06 13:21:34 user nova-compute[74821]: iface.data_digest = <empty>
Nov 06 13:21:34 user nova-compute[74821]: iface.immediate_data = <empty>
Nov 06 13:21:34 user nova-compute[74821]: iface.initial_r2t = <empty>
Nov 06 13:21:34 user nova-compute[74821]: iface.data_seq_inorder = <empty>
Nov 06 13:21:34 user nova-compute[74821]: iface.data_pdu_inorder = <empty>
Nov 06 13:21:34 user nova-compute[74821]: iface.erl = 0
Nov 06 13:21:34 user nova-compute[74821]: iface.max_receive_data_len = 0
Nov 06 13:21:34 user nova-compute[74821]: iface.first_burst_len = 0
Nov 06 13:21:34 user nova-compute[74821]: iface.max_outstanding_r2t = 0
Nov 06 13:21:34 user nova-compute[74821]: iface.max_burst_len = 0
Nov 06 13:21:34 user nova-compute[74821]: iface.chap_auth = <empty>
Nov 06 13:21:34 user nova-compute[74821]: iface.bidi_chap = <empty>
Nov 06 13:21:34 user nova-compute[74821]: iface.strict_login_compliance = <empty>
Nov 06 13:21:34 user nova-compute[74821]: iface.discovery_auth = <empty>
Nov 06 13:21:34 user nova-compute[74821]: iface.discovery_logout = <empty>
Nov 06 13:21:34 user nova-compute[74821]: node.discovery_address = <empty>
Nov 06 13:21:34 user nova-compute[74821]: node.discovery_port = 0
Nov 06 13:21:34 user nova-compute[74821]: node.discovery_type = static
Nov 06 13:21:34 user nova-compute[74821]: node.session.initial_cmdsn = 0
Nov 06 13:21:34 user nova-compute[74821]: node.session.initial_login_retry_max = 8
Nov 06 13:21:34 user nova-compute[74821]: node.session.xmit_thread_priority = -20
Nov 06 13:21:34 user nova-compute[74821]: node.session.cmds_max = 128
Nov 06 13:21:34 user nova-compute[74821]: node.session.queue_depth = 32
Nov 06 13:21:34 user nova-compute[74821]: node.session.nr_sessions = 1
Nov 06 13:21:34 user nova-compute[74821]: node.session.auth.authmethod = CHAP
Nov 06 13:21:34 user nova-compute[74821]: node.session.auth.username = gVPeKGMQ
Nov 06 13:21:34 user nova-compute[74821]: node.session.auth.password = ***
Nov 06 13:21:34 user nova-compute[74821]: node.session.auth.username_in = <empty>
Nov 06 13:21:34 user nova-compute[74821]: node.session.auth.password_in = <empty>
Nov 06 13:21:34 user nova-compute[74821]: node.session.auth.chap_algs = MD5
Nov 06 13:21:34 user nova-compute[74821]: node.session.timeo.replacement_timeout = 120
Nov 06 13:21:34 user nova-compute[74821]: node.session.err_timeo.abort_timeout = 15
Nov 06 13:21:34 user nova-compute[74821]: node.session.err_timeo.lu_reset_timeout = 30
Nov 06 13:21:34 user nova-compute[74821]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 06 13:21:34 user nova-compute[74821]: node.session.err_timeo.host_reset_timeout = 60
Nov 06 13:21:34 user nova-compute[74821]: node.session.iscsi.FastAbort = Yes
Nov 06 13:21:34 user nova-compute[74821]: node.session.iscsi.InitialR2T = No
Nov 06 13:21:34 user nova-compute[74821]: node.session.iscsi.ImmediateData = Yes
Nov 06 13:21:34 user nova-compute[74821]: node.session.iscsi.FirstBurstLength = 262144
Nov 06 13:21:34 user nova-compute[74821]: node.session.iscsi.MaxBurstLength = 16776192
Nov 06 13:21:34 user nova-compute[74821]: node.session.iscsi.DefaultTime2Retain = 0
Nov 06 13:21:34 user nova-compute[74821]: node.session.iscsi.DefaultTime2Wait = 2
Nov 06 13:21:34 user nova-compute[74821]: node.session.iscsi.MaxConnections = 1
Nov 06 13:21:34 user nova-compute[74821]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 06 13:21:34 user nova-compute[74821]: node.session.iscsi.ERL = 0
Nov 06 13:21:34 user nova-compute[74821]: node.session.scan = manual
Nov 06 13:21:34 user nova-compute[74821]: node.session.reopen_max = 0
Nov 06 13:21:34 user nova-compute[74821]: node.conn[0].address = 172.16.0.220
Nov 06 13:21:34 user nova-compute[74821]: node.conn[0].port = 3260
Nov 06 13:21:34 user nova-compute[74821]: node.conn[0].startup = manual
Nov 06 13:21:34 user nova-compute[74821]: node.conn[0].tcp.window_size = 524288
Nov 06 13:21:34 user nova-compute[74821]: node.conn[0].tcp.type_of_service = 0
Nov 06 13:21:34 user nova-compute[74821]: node.conn[0].timeo.logout_timeout = 15
Nov 06 13:21:34 user nova-compute[74821]: node.conn[0].timeo.login_timeout = 15
Nov 06 13:21:34 user nova-compute[74821]: node.conn[0].timeo.auth_timeout = 45
Nov 06 13:21:34 user nova-compute[74821]: node.conn[0].timeo.noop_out_interval = 5
Nov 06 13:21:34 user nova-compute[74821]: node.conn[0].timeo.noop_out_timeout = 5
Nov 06 13:21:34 user nova-compute[74821]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 06 13:21:34 user nova-compute[74821]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 06 13:21:34 user nova-compute[74821]: node.conn[0].iscsi.HeaderDigest = None
Nov 06 13:21:34 user nova-compute[74821]: node.conn[0].iscsi.DataDigest = None
Nov 06 13:21:34 user nova-compute[74821]: node.conn[0].iscsi.IFMarker = No
Nov 06 13:21:34 user nova-compute[74821]: node.conn[0].iscsi.OFMarker = No
Nov 06 13:21:34 user nova-compute[74821]: # END RECORD
Nov 06 13:21:34 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc319c4-70e7-4598-a9fe-652625c6de1d]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b37f26-31b6-4435-98bc-eb930721d1b3]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gVPeKGMQ {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gVPeKGMQ" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd94441a-b685-4a8b-bf36-41174ac1c0d3]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gVPeKGMQ'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[34af3757-7026-4c6a-b3bd-ec53bc22f00a]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[778fdfa8-6e65-4971-a20e-cb21bdc6ecbc]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:21:34 user nova-compute[74821]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:21:34 user nova-compute[74821]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)
Nov 06 13:21:34 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:21:34 user nova-compute[74821]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:21:34 user nova-compute[74821]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)
Nov 06 13:21:34 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.198s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] HCTL ('35', '0', '0', 0) found on session 18 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b319989a-e70b-45a5-ac13-9da9b5748948]: (4, ('0 0 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Searching for a device in session 18 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gVPeKGMQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.223s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] <== connect_volume: return (224ms) {'type': 'block', 'scsi_wwn': '23135386335313936', 'path': '/dev/sdd'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135386335313936', 'path': '/dev/sdd'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:19:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-980291330',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-980291330',id=24,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:20:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f745a322931e4150b12d139bfb17b94c',ramdisk_id='',reservation_id='r-ed18rll4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1064633830',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:20:21Z,user_data=None,user_id='133932d1063241078d84731624e89216',uuid=496f8213-4b32-4211-a354-e33a4a088848,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc", "address": "fa:16:3e:de:d4:5d", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "vif_mac": "fa:16:3e:de:d4:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dbd0a11-07", "ovs_interfaceid": "0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Converting VIF {"id": "0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc", "address": "fa:16:3e:de:d4:5d", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "vif_mac": "fa:16:3e:de:d4:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dbd0a11-07", "ovs_interfaceid": "0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:d4:5d,bridge_name='br-int',has_traffic_filtering=True,id=0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc,network=Network(354bf335-0cac-46d9-acb8-5095411f5db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dbd0a11-07') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.objects.instance [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lazy-loading 'pci_devices' on Instance uuid 496f8213-4b32-4211-a354-e33a4a088848 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.objects.base [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Object Instance<496f8213-4b32-4211-a354-e33a4a088848> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:21:34 user nova-compute[74821]:   <uuid>496f8213-4b32-4211-a354-e33a4a088848</uuid>
Nov 06 13:21:34 user nova-compute[74821]:   <name>instance-00000018</name>
Nov 06 13:21:34 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:21:34 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:21:34 user nova-compute[74821]:   <metadata>
Nov 06 13:21:34 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:21:34 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:21:34 user nova-compute[74821]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-980291330</nova:name>
Nov 06 13:21:34 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:21:34</nova:creationTime>
Nov 06 13:21:34 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:21:34 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:21:34 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:21:34 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:21:34 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:21:34 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:21:34 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:21:34 user nova-compute[74821]:       <nova:owner>
Nov 06 13:21:34 user nova-compute[74821]:         <nova:user uuid="133932d1063241078d84731624e89216">tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member</nova:user>
Nov 06 13:21:34 user nova-compute[74821]:         <nova:project uuid="f745a322931e4150b12d139bfb17b94c">tempest-ServerBootFromVolumeStableRescueTest-1064633830</nova:project>
Nov 06 13:21:34 user nova-compute[74821]:       </nova:owner>
Nov 06 13:21:34 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:21:34 user nova-compute[74821]:       <nova:ports>
Nov 06 13:21:34 user nova-compute[74821]:         <nova:port uuid="0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc">
Nov 06 13:21:34 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 06 13:21:34 user nova-compute[74821]:         </nova:port>
Nov 06 13:21:34 user nova-compute[74821]:       </nova:ports>
Nov 06 13:21:34 user nova-compute[74821]:     </nova:instance>
Nov 06 13:21:34 user nova-compute[74821]:   </metadata>
Nov 06 13:21:34 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:21:34 user nova-compute[74821]:     <system>
Nov 06 13:21:34 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:21:34 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:21:34 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:21:34 user nova-compute[74821]:       <entry name="serial">496f8213-4b32-4211-a354-e33a4a088848</entry>
Nov 06 13:21:34 user nova-compute[74821]:       <entry name="uuid">496f8213-4b32-4211-a354-e33a4a088848</entry>
Nov 06 13:21:34 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:21:34 user nova-compute[74821]:     </system>
Nov 06 13:21:34 user nova-compute[74821]:   </sysinfo>
Nov 06 13:21:34 user nova-compute[74821]:   <os>
Nov 06 13:21:34 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:21:34 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:21:34 user nova-compute[74821]:   </os>
Nov 06 13:21:34 user nova-compute[74821]:   <features>
Nov 06 13:21:34 user nova-compute[74821]:     <acpi/>
Nov 06 13:21:34 user nova-compute[74821]:     <apic/>
Nov 06 13:21:34 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:21:34 user nova-compute[74821]:   </features>
Nov 06 13:21:34 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:21:34 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:21:34 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:21:34 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:21:34 user nova-compute[74821]:   </clock>
Nov 06 13:21:34 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:21:34 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:21:34 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:21:34 user nova-compute[74821]:   </cpu>
Nov 06 13:21:34 user nova-compute[74821]:   <devices>
Nov 06 13:21:34 user nova-compute[74821]:     <disk type="block" device="disk">
Nov 06 13:21:34 user nova-compute[74821]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:21:34 user nova-compute[74821]:       <source dev="/dev/sdd"/>
Nov 06 13:21:34 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:21:34 user nova-compute[74821]:       <serial>4739d8fa-3170-46f4-ac61-fa0fe6aa4979</serial>
Nov 06 13:21:34 user nova-compute[74821]:     </disk>
Nov 06 13:21:34 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:21:34 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:21:34 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/496f8213-4b32-4211-a354-e33a4a088848/disk.rescue"/>
Nov 06 13:21:34 user nova-compute[74821]:       <target dev="vdb" bus="virtio"/>
Nov 06 13:21:34 user nova-compute[74821]:       <boot order="1"/>
Nov 06 13:21:34 user nova-compute[74821]:     </disk>
Nov 06 13:21:34 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:21:34 user nova-compute[74821]:       <mac address="fa:16:3e:de:d4:5d"/>
Nov 06 13:21:34 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:21:34 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:21:34 user nova-compute[74821]:       <target dev="tap0dbd0a11-07"/>
Nov 06 13:21:34 user nova-compute[74821]:     </interface>
Nov 06 13:21:34 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:21:34 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/496f8213-4b32-4211-a354-e33a4a088848/console.log" append="off"/>
Nov 06 13:21:34 user nova-compute[74821]:     </serial>
Nov 06 13:21:34 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:21:34 user nova-compute[74821]:     <video>
Nov 06 13:21:34 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:21:34 user nova-compute[74821]:     </video>
Nov 06 13:21:34 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:21:34 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:21:34 user nova-compute[74821]:     </rng>
Nov 06 13:21:34 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:21:34 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:21:34 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:21:34 user nova-compute[74821]:     </memballoon>
Nov 06 13:21:34 user nova-compute[74821]:   </devices>
Nov 06 13:21:34 user nova-compute[74821]: </domain>
Nov 06 13:21:34 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:21:34 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Instance destroyed successfully.
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] No VIF found with MAC fa:16:3e:de:d4:5d, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG nova.network.neutron [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Updating instance_info_cache with network_info: [{"id": "b5020053-395f-4341-99be-d522ebb938c7", "address": "fa:16:3e:d4:3e:f8", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5020053-39", "ovs_interfaceid": "b5020053-395f-4341-99be-d522ebb938c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:21:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Releasing lock "refresh_cache-61beb251-4345-44e6-a176-5c14c99c9a52" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:21:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:35 user nova-compute[74821]: DEBUG nova.compute.manager [req-61b3046d-e906-4634-8b48-78c091fe71eb req-980de81e-a02e-461e-ba74-cad2e7bd7bee service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received event network-vif-unplugged-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:21:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-61b3046d-e906-4634-8b48-78c091fe71eb req-980de81e-a02e-461e-ba74-cad2e7bd7bee service nova] Acquiring lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:21:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-61b3046d-e906-4634-8b48-78c091fe71eb req-980de81e-a02e-461e-ba74-cad2e7bd7bee service nova] Lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:21:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-61b3046d-e906-4634-8b48-78c091fe71eb req-980de81e-a02e-461e-ba74-cad2e7bd7bee service nova] Lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:21:35 user nova-compute[74821]: DEBUG nova.compute.manager [req-61b3046d-e906-4634-8b48-78c091fe71eb req-980de81e-a02e-461e-ba74-cad2e7bd7bee service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] No waiting events found dispatching network-vif-unplugged-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:21:35 user nova-compute[74821]: WARNING nova.compute.manager [req-61b3046d-e906-4634-8b48-78c091fe71eb req-980de81e-a02e-461e-ba74-cad2e7bd7bee service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received unexpected event network-vif-unplugged-b5020053-395f-4341-99be-d522ebb938c7 for instance with vm_state active and task_state rescuing.
Nov 06 13:21:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:35 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:21:35 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:21:35 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Cleaning up deleted instances {{(pid=74821) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 13:21:35 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] There are 0 instances to clean {{(pid=74821) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:36 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Instance destroyed successfully.
Nov 06 13:21:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:36 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Attempting rescue
Nov 06 13:21:36 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74821) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Instance directory exists: not creating {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 06 13:21:36 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Creating image(s)
Nov 06 13:21:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "/opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "/opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "/opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG nova.objects.instance [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lazy-loading 'trusted_certs' on Instance uuid 61beb251-4345-44e6-a176-5c14c99c9a52 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.201s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk.rescue {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG nova.compute.manager [req-8fedaa02-a325-4e93-8dd1-ddc102f40eef req-9bb4f9a6-d95d-4984-9e69-b2e0f44b7015 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Received event network-vif-plugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8fedaa02-a325-4e93-8dd1-ddc102f40eef req-9bb4f9a6-d95d-4984-9e69-b2e0f44b7015 service nova] Acquiring lock "496f8213-4b32-4211-a354-e33a4a088848-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8fedaa02-a325-4e93-8dd1-ddc102f40eef req-9bb4f9a6-d95d-4984-9e69-b2e0f44b7015 service nova] Lock "496f8213-4b32-4211-a354-e33a4a088848-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8fedaa02-a325-4e93-8dd1-ddc102f40eef req-9bb4f9a6-d95d-4984-9e69-b2e0f44b7015 service nova] Lock "496f8213-4b32-4211-a354-e33a4a088848-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG nova.compute.manager [req-8fedaa02-a325-4e93-8dd1-ddc102f40eef req-9bb4f9a6-d95d-4984-9e69-b2e0f44b7015 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] No waiting events found dispatching network-vif-plugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:21:36 user nova-compute[74821]: WARNING nova.compute.manager [req-8fedaa02-a325-4e93-8dd1-ddc102f40eef req-9bb4f9a6-d95d-4984-9e69-b2e0f44b7015 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Received unexpected event network-vif-plugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc for instance with vm_state active and task_state rescuing.
Nov 06 13:21:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk.rescue" returned: 0 in 0.153s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.359s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG nova.objects.instance [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lazy-loading 'migration_context' on Instance uuid 61beb251-4345-44e6-a176-5c14c99c9a52 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG nova.objects.base [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Object Instance<61beb251-4345-44e6-a176-5c14c99c9a52> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Start _get_guest_xml network_info=[{"id": "b5020053-395f-4341-99be-d522ebb938c7", "address": "fa:16:3e:d4:3e:f8", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "vif_mac": "fa:16:3e:d4:3e:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5020053-39", "ovs_interfaceid": "b5020053-395f-4341-99be-d522ebb938c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG nova.objects.instance [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lazy-loading 'resources' on Instance uuid 61beb251-4345-44e6-a176-5c14c99c9a52 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG nova.objects.base [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Object Instance<61beb251-4345-44e6-a176-5c14c99c9a52> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG nova.objects.instance [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lazy-loading 'numa_topology' on Instance uuid 61beb251-4345-44e6-a176-5c14c99c9a52 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG nova.objects.base [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Object Instance<61beb251-4345-44e6-a176-5c14c99c9a52> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:21:36 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:21:36 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:21:36 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG nova.objects.instance [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lazy-loading 'vcpu_model' on Instance uuid 61beb251-4345-44e6-a176-5c14c99c9a52 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG nova.objects.base [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Object Instance<61beb251-4345-44e6-a176-5c14c99c9a52> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:19:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-654751200',display_name='tempest-ServerRescueNegativeTestJSON-server-654751200',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-654751200',id=23,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG84x+NylQWBd2g1pTgN6nYOGcxuM7ptMYLF1iYUf4C/EmePaiAY94KGATgiwZv/MCDbgtJ1U0U0tBBU4OAE3ODDx+p2CM+mUmjEW5IGA4t+YMPmSLPcZoG14d2vm4joFQ==',key_name='tempest-keypair-200545764',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:19:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e246e1fd12054401988f9d49f6ad9373',ramdisk_id='',reservation_id='r-2f5gtrij',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1107947568',owner_user_name='tempest-ServerRescueNegativeTestJSON-1107947568-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:19:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a0f35998b664c32990f079ca1cd5e6d',uuid=61beb251-4345-44e6-a176-5c14c99c9a52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5020053-395f-4341-99be-d522ebb938c7", "address": "fa:16:3e:d4:3e:f8", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "vif_mac": "fa:16:3e:d4:3e:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5020053-39", "ovs_interfaceid": "b5020053-395f-4341-99be-d522ebb938c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Converting VIF {"id": "b5020053-395f-4341-99be-d522ebb938c7", "address": "fa:16:3e:d4:3e:f8", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "vif_mac": "fa:16:3e:d4:3e:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5020053-39", "ovs_interfaceid": "b5020053-395f-4341-99be-d522ebb938c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:3e:f8,bridge_name='br-int',has_traffic_filtering=True,id=b5020053-395f-4341-99be-d522ebb938c7,network=Network(45ec1f7e-dbfa-4746-8d35-e32f7c938a0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5020053-39') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:21:36 user nova-compute[74821]: DEBUG nova.objects.instance [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lazy-loading 'pci_devices' on Instance uuid 61beb251-4345-44e6-a176-5c14c99c9a52 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:21:37 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:21:37 user nova-compute[74821]: DEBUG nova.objects.base [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Object Instance<61beb251-4345-44e6-a176-5c14c99c9a52> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:21:37 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:21:37 user nova-compute[74821]:   <uuid>61beb251-4345-44e6-a176-5c14c99c9a52</uuid>
Nov 06 13:21:37 user nova-compute[74821]:   <name>instance-00000017</name>
Nov 06 13:21:37 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:21:37 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:21:37 user nova-compute[74821]:   <metadata>
Nov 06 13:21:37 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:21:37 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:21:37 user nova-compute[74821]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-654751200</nova:name>
Nov 06 13:21:37 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:21:36</nova:creationTime>
Nov 06 13:21:37 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:21:37 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:21:37 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:21:37 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:21:37 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:21:37 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:21:37 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:21:37 user nova-compute[74821]:       <nova:owner>
Nov 06 13:21:37 user nova-compute[74821]:         <nova:user uuid="4a0f35998b664c32990f079ca1cd5e6d">tempest-ServerRescueNegativeTestJSON-1107947568-project-member</nova:user>
Nov 06 13:21:37 user nova-compute[74821]:         <nova:project uuid="e246e1fd12054401988f9d49f6ad9373">tempest-ServerRescueNegativeTestJSON-1107947568</nova:project>
Nov 06 13:21:37 user nova-compute[74821]:       </nova:owner>
Nov 06 13:21:37 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:21:37 user nova-compute[74821]:       <nova:ports>
Nov 06 13:21:37 user nova-compute[74821]:         <nova:port uuid="b5020053-395f-4341-99be-d522ebb938c7">
Nov 06 13:21:37 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 06 13:21:37 user nova-compute[74821]:         </nova:port>
Nov 06 13:21:37 user nova-compute[74821]:       </nova:ports>
Nov 06 13:21:37 user nova-compute[74821]:     </nova:instance>
Nov 06 13:21:37 user nova-compute[74821]:   </metadata>
Nov 06 13:21:37 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:21:37 user nova-compute[74821]:     <system>
Nov 06 13:21:37 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:21:37 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:21:37 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:21:37 user nova-compute[74821]:       <entry name="serial">61beb251-4345-44e6-a176-5c14c99c9a52</entry>
Nov 06 13:21:37 user nova-compute[74821]:       <entry name="uuid">61beb251-4345-44e6-a176-5c14c99c9a52</entry>
Nov 06 13:21:37 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:21:37 user nova-compute[74821]:     </system>
Nov 06 13:21:37 user nova-compute[74821]:   </sysinfo>
Nov 06 13:21:37 user nova-compute[74821]:   <os>
Nov 06 13:21:37 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:21:37 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:21:37 user nova-compute[74821]:   </os>
Nov 06 13:21:37 user nova-compute[74821]:   <features>
Nov 06 13:21:37 user nova-compute[74821]:     <acpi/>
Nov 06 13:21:37 user nova-compute[74821]:     <apic/>
Nov 06 13:21:37 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:21:37 user nova-compute[74821]:   </features>
Nov 06 13:21:37 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:21:37 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:21:37 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:21:37 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:21:37 user nova-compute[74821]:   </clock>
Nov 06 13:21:37 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:21:37 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:21:37 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:21:37 user nova-compute[74821]:   </cpu>
Nov 06 13:21:37 user nova-compute[74821]:   <devices>
Nov 06 13:21:37 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:21:37 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:21:37 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk.rescue"/>
Nov 06 13:21:37 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:21:37 user nova-compute[74821]:     </disk>
Nov 06 13:21:37 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:21:37 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:21:37 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk"/>
Nov 06 13:21:37 user nova-compute[74821]:       <target dev="vdb" bus="virtio"/>
Nov 06 13:21:37 user nova-compute[74821]:     </disk>
Nov 06 13:21:37 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:21:37 user nova-compute[74821]:       <mac address="fa:16:3e:d4:3e:f8"/>
Nov 06 13:21:37 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:21:37 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:21:37 user nova-compute[74821]:       <target dev="tapb5020053-39"/>
Nov 06 13:21:37 user nova-compute[74821]:     </interface>
Nov 06 13:21:37 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:21:37 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/console.log" append="off"/>
Nov 06 13:21:37 user nova-compute[74821]:     </serial>
Nov 06 13:21:37 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:21:37 user nova-compute[74821]:     <video>
Nov 06 13:21:37 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:21:37 user nova-compute[74821]:     </video>
Nov 06 13:21:37 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:21:37 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:21:37 user nova-compute[74821]:     </rng>
Nov 06 13:21:37 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:21:37 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:21:37 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:21:37 user nova-compute[74821]:     </memballoon>
Nov 06 13:21:37 user nova-compute[74821]:   </devices>
Nov 06 13:21:37 user nova-compute[74821]: </domain>
Nov 06 13:21:37 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:21:37 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Instance destroyed successfully.
Nov 06 13:21:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:21:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:21:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:21:37 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:21:37 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:21:37 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:21:37 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] No VIF found with MAC fa:16:3e:d4:3e:f8, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:21:37 user nova-compute[74821]: DEBUG nova.compute.manager [req-ab6e214f-0125-4989-8cbb-a1464412a949 req-1a2cb463-1f8e-4d67-a07a-674c37e55349 service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received event network-vif-plugged-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:21:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ab6e214f-0125-4989-8cbb-a1464412a949 req-1a2cb463-1f8e-4d67-a07a-674c37e55349 service nova] Acquiring lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:21:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ab6e214f-0125-4989-8cbb-a1464412a949 req-1a2cb463-1f8e-4d67-a07a-674c37e55349 service nova] Lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:21:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ab6e214f-0125-4989-8cbb-a1464412a949 req-1a2cb463-1f8e-4d67-a07a-674c37e55349 service nova] Lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:21:37 user nova-compute[74821]: DEBUG nova.compute.manager [req-ab6e214f-0125-4989-8cbb-a1464412a949 req-1a2cb463-1f8e-4d67-a07a-674c37e55349 service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] No waiting events found dispatching network-vif-plugged-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:21:37 user nova-compute[74821]: WARNING nova.compute.manager [req-ab6e214f-0125-4989-8cbb-a1464412a949 req-1a2cb463-1f8e-4d67-a07a-674c37e55349 service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received unexpected event network-vif-plugged-b5020053-395f-4341-99be-d522ebb938c7 for instance with vm_state active and task_state rescuing.
Nov 06 13:21:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:38 user nova-compute[74821]: DEBUG nova.compute.manager [req-4b137435-6bfa-4cc6-ab91-67e72f2e8c45 req-3e094213-e011-4a57-a8a3-10405ec56b21 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Received event network-vif-plugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:21:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4b137435-6bfa-4cc6-ab91-67e72f2e8c45 req-3e094213-e011-4a57-a8a3-10405ec56b21 service nova] Acquiring lock "496f8213-4b32-4211-a354-e33a4a088848-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:21:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4b137435-6bfa-4cc6-ab91-67e72f2e8c45 req-3e094213-e011-4a57-a8a3-10405ec56b21 service nova] Lock "496f8213-4b32-4211-a354-e33a4a088848-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:21:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4b137435-6bfa-4cc6-ab91-67e72f2e8c45 req-3e094213-e011-4a57-a8a3-10405ec56b21 service nova] Lock "496f8213-4b32-4211-a354-e33a4a088848-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:21:38 user nova-compute[74821]: DEBUG nova.compute.manager [req-4b137435-6bfa-4cc6-ab91-67e72f2e8c45 req-3e094213-e011-4a57-a8a3-10405ec56b21 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] No waiting events found dispatching network-vif-plugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:21:38 user nova-compute[74821]: WARNING nova.compute.manager [req-4b137435-6bfa-4cc6-ab91-67e72f2e8c45 req-3e094213-e011-4a57-a8a3-10405ec56b21 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Received unexpected event network-vif-plugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc for instance with vm_state active and task_state rescuing.
Nov 06 13:21:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3cb35a-d45e-4e35-96fe-437a941c0244/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:39 user nova-compute[74821]: DEBUG nova.compute.manager [None req-30aa8da3-4dff-47ae-aec9-97f17275a5e1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:21:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:39 user nova-compute[74821]: DEBUG nova.compute.manager [req-e98e2d04-0ddd-4e58-b4ca-57cc380aa452 req-c844d7b6-2d2e-4c89-af03-25432f35afba service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received event network-vif-plugged-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:21:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e98e2d04-0ddd-4e58-b4ca-57cc380aa452 req-c844d7b6-2d2e-4c89-af03-25432f35afba service nova] Acquiring lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:21:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e98e2d04-0ddd-4e58-b4ca-57cc380aa452 req-c844d7b6-2d2e-4c89-af03-25432f35afba service nova] Lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:21:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e98e2d04-0ddd-4e58-b4ca-57cc380aa452 req-c844d7b6-2d2e-4c89-af03-25432f35afba service nova] Lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:21:39 user nova-compute[74821]: DEBUG nova.compute.manager [req-e98e2d04-0ddd-4e58-b4ca-57cc380aa452 req-c844d7b6-2d2e-4c89-af03-25432f35afba service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] No waiting events found dispatching network-vif-plugged-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:21:39 user nova-compute[74821]: WARNING nova.compute.manager [req-e98e2d04-0ddd-4e58-b4ca-57cc380aa452 req-c844d7b6-2d2e-4c89-af03-25432f35afba service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received unexpected event network-vif-plugged-b5020053-395f-4341-99be-d522ebb938c7 for instance with vm_state active and task_state rescuing.
Nov 06 13:21:39 user nova-compute[74821]: DEBUG nova.compute.manager [req-e98e2d04-0ddd-4e58-b4ca-57cc380aa452 req-c844d7b6-2d2e-4c89-af03-25432f35afba service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received event network-vif-plugged-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:21:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e98e2d04-0ddd-4e58-b4ca-57cc380aa452 req-c844d7b6-2d2e-4c89-af03-25432f35afba service nova] Acquiring lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:21:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e98e2d04-0ddd-4e58-b4ca-57cc380aa452 req-c844d7b6-2d2e-4c89-af03-25432f35afba service nova] Lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:21:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e98e2d04-0ddd-4e58-b4ca-57cc380aa452 req-c844d7b6-2d2e-4c89-af03-25432f35afba service nova] Lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:21:39 user nova-compute[74821]: DEBUG nova.compute.manager [req-e98e2d04-0ddd-4e58-b4ca-57cc380aa452 req-c844d7b6-2d2e-4c89-af03-25432f35afba service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] No waiting events found dispatching network-vif-plugged-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:21:39 user nova-compute[74821]: WARNING nova.compute.manager [req-e98e2d04-0ddd-4e58-b4ca-57cc380aa452 req-c844d7b6-2d2e-4c89-af03-25432f35afba service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received unexpected event network-vif-plugged-b5020053-395f-4341-99be-d522ebb938c7 for instance with vm_state active and task_state rescuing.
Nov 06 13:21:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3cb35a-d45e-4e35-96fe-437a941c0244/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3cb35a-d45e-4e35-96fe-437a941c0244/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3cb35a-d45e-4e35-96fe-437a941c0244/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:41 user nova-compute[74821]: DEBUG nova.compute.manager [None req-eeebf71e-0d73-49ca-a63d-371da4f892e6 tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:21:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:42 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:21:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a895162-eec9-4e5f-a7d3-bd36155da4b8/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a895162-eec9-4e5f-a7d3-bd36155da4b8/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a895162-eec9-4e5f-a7d3-bd36155da4b8/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a895162-eec9-4e5f-a7d3-bd36155da4b8/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:43 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:21:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json" returned: 0 in 0.310s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json" returned: 0 in 0.280s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:44 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:21:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/496f8213-4b32-4211-a354-e33a4a088848/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/496f8213-4b32-4211-a354-e33a4a088848/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/496f8213-4b32-4211-a354-e33a4a088848/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:21:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/496f8213-4b32-4211-a354-e33a4a088848/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:21:45 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:21:45 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:21:45 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=7618MB free_disk=25.170818328857422GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:21:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:21:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:21:46 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 3e21d005-f190-478a-a911-e483e1235057 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:21:46 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 311817c5-7b08-4da9-98eb-c685f37e6fd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:21:46 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 2de346cb-9858-47b8-a86c-4fde720d6127 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:21:46 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 49c65aca-8392-46ba-8fa3-b47ff2416cb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:21:46 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 107abf1d-96da-4406-8111-ef0bc09fb3e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:21:46 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance cc3c1518-c493-41b0-a748-a0ed933c2b1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:21:46 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 290cd798-a041-40c0-8ef9-319d3627ff82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:21:46 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 5a07f64b-5b12-4e7d-a041-ad591141aa17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:21:46 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 61beb251-4345-44e6-a176-5c14c99c9a52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:21:46 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 496f8213-4b32-4211-a354-e33a4a088848 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:21:46 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance be3cb35a-d45e-4e35-96fe-437a941c0244 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:21:46 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 6a895162-eec9-4e5f-a7d3-bd36155da4b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:21:46 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:21:46 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:21:46 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Refreshing inventories for resource provider a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 13:21:46 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Updating ProviderTree inventory for provider a45ec519-15f5-48fe-877b-466db09f8afe from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 13:21:46 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Updating inventory in ProviderTree for provider a45ec519-15f5-48fe-877b-466db09f8afe with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 13:21:46 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Refreshing aggregate associations for resource provider a45ec519-15f5-48fe-877b-466db09f8afe, aggregates: None {{(pid=74821) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 13:21:46 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Refreshing trait associations for resource provider a45ec519-15f5-48fe-877b-466db09f8afe, traits: COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42 {{(pid=74821) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 13:21:46 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:21:46 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:21:46 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:21:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.996s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:21:46 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:21:46 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Cleaning up deleted instances with incomplete migration  {{(pid=74821) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 13:21:46 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:21:47 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:21:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4992-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:21:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:21:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "32e28c73-9e3c-483b-807e-6b286413fe85" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:22:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "32e28c73-9e3c-483b-807e-6b286413fe85" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:22:05 user nova-compute[74821]: INFO nova.compute.manager [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Unshelving
Nov 06 13:22:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:22:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:22:05 user nova-compute[74821]: DEBUG nova.objects.instance [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lazy-loading 'pci_requests' on Instance uuid 32e28c73-9e3c-483b-807e-6b286413fe85 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:22:06 user nova-compute[74821]: DEBUG nova.objects.instance [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lazy-loading 'numa_topology' on Instance uuid 32e28c73-9e3c-483b-807e-6b286413fe85 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:22:06 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:22:06 user nova-compute[74821]: INFO nova.compute.claims [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Claim successful on node user
Nov 06 13:22:06 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:22:06 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:22:06 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.582s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:22:06 user nova-compute[74821]: INFO nova.network.neutron [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Updating port e5ab685a-b1f3-4704-963f-e7db827c947c with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 06 13:22:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "refresh_cache-32e28c73-9e3c-483b-807e-6b286413fe85" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:22:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquired lock "refresh_cache-32e28c73-9e3c-483b-807e-6b286413fe85" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:22:07 user nova-compute[74821]: DEBUG nova.network.neutron [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:22:07 user nova-compute[74821]: DEBUG nova.compute.manager [req-02148bda-33a0-48aa-b9a2-94bee8ffa79c req-3ce1551e-336c-48a9-a31f-4e81962986d6 service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Received event network-changed-e5ab685a-b1f3-4704-963f-e7db827c947c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:22:07 user nova-compute[74821]: DEBUG nova.compute.manager [req-02148bda-33a0-48aa-b9a2-94bee8ffa79c req-3ce1551e-336c-48a9-a31f-4e81962986d6 service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Refreshing instance network info cache due to event network-changed-e5ab685a-b1f3-4704-963f-e7db827c947c. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:22:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-02148bda-33a0-48aa-b9a2-94bee8ffa79c req-3ce1551e-336c-48a9-a31f-4e81962986d6 service nova] Acquiring lock "refresh_cache-32e28c73-9e3c-483b-807e-6b286413fe85" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:22:07 user nova-compute[74821]: DEBUG nova.network.neutron [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Updating instance_info_cache with network_info: [{"id": "e5ab685a-b1f3-4704-963f-e7db827c947c", "address": "fa:16:3e:d5:da:15", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5ab685a-b1", "ovs_interfaceid": "e5ab685a-b1f3-4704-963f-e7db827c947c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:22:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Releasing lock "refresh_cache-32e28c73-9e3c-483b-807e-6b286413fe85" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:22:07 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:22:07 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Creating image(s)
Nov 06 13:22:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "/opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:22:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "/opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:22:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "/opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:22:07 user nova-compute[74821]: DEBUG nova.objects.instance [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lazy-loading 'trusted_certs' on Instance uuid 32e28c73-9e3c-483b-807e-6b286413fe85 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:22:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-02148bda-33a0-48aa-b9a2-94bee8ffa79c req-3ce1551e-336c-48a9-a31f-4e81962986d6 service nova] Acquired lock "refresh_cache-32e28c73-9e3c-483b-807e-6b286413fe85" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:22:07 user nova-compute[74821]: DEBUG nova.network.neutron [req-02148bda-33a0-48aa-b9a2-94bee8ffa79c req-3ce1551e-336c-48a9-a31f-4e81962986d6 service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Refreshing network info cache for port e5ab685a-b1f3-4704-963f-e7db827c947c {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:22:07 user nova-compute[74821]: DEBUG nova.objects.base [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Object Instance<32e28c73-9e3c-483b-807e-6b286413fe85> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:22:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "7ce5db5cb702e712465a6c2e92d774b15ed5c534" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:22:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "7ce5db5cb702e712465a6c2e92d774b15ed5c534" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:22:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7ce5db5cb702e712465a6c2e92d774b15ed5c534.part --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7ce5db5cb702e712465a6c2e92d774b15ed5c534.part --force-share --output=json" returned: 0 in 0.198s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:09 user nova-compute[74821]: DEBUG nova.virt.images [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] 72dd78d5-3a17-4f1e-a15c-d0de40ace806 was qcow2, converting to raw {{(pid=74821) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 13:22:09 user nova-compute[74821]: DEBUG nova.privsep.utils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74821) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 13:22:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7ce5db5cb702e712465a6c2e92d774b15ed5c534.part /opt/stack/data/nova/instances/_base/7ce5db5cb702e712465a6c2e92d774b15ed5c534.converted {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:09 user nova-compute[74821]: DEBUG nova.network.neutron [req-02148bda-33a0-48aa-b9a2-94bee8ffa79c req-3ce1551e-336c-48a9-a31f-4e81962986d6 service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Updated VIF entry in instance network info cache for port e5ab685a-b1f3-4704-963f-e7db827c947c. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:22:09 user nova-compute[74821]: DEBUG nova.network.neutron [req-02148bda-33a0-48aa-b9a2-94bee8ffa79c req-3ce1551e-336c-48a9-a31f-4e81962986d6 service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Updating instance_info_cache with network_info: [{"id": "e5ab685a-b1f3-4704-963f-e7db827c947c", "address": "fa:16:3e:d5:da:15", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5ab685a-b1", "ovs_interfaceid": "e5ab685a-b1f3-4704-963f-e7db827c947c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:22:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-02148bda-33a0-48aa-b9a2-94bee8ffa79c req-3ce1551e-336c-48a9-a31f-4e81962986d6 service nova] Releasing lock "refresh_cache-32e28c73-9e3c-483b-807e-6b286413fe85" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:22:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7ce5db5cb702e712465a6c2e92d774b15ed5c534.part /opt/stack/data/nova/instances/_base/7ce5db5cb702e712465a6c2e92d774b15ed5c534.converted" returned: 0 in 0.371s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7ce5db5cb702e712465a6c2e92d774b15ed5c534.converted --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7ce5db5cb702e712465a6c2e92d774b15ed5c534.converted --force-share --output=json" returned: 0 in 0.214s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "7ce5db5cb702e712465a6c2e92d774b15ed5c534" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.901s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:22:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7ce5db5cb702e712465a6c2e92d774b15ed5c534 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7ce5db5cb702e712465a6c2e92d774b15ed5c534 --force-share --output=json" returned: 0 in 0.203s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "7ce5db5cb702e712465a6c2e92d774b15ed5c534" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:22:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "7ce5db5cb702e712465a6c2e92d774b15ed5c534" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:22:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7ce5db5cb702e712465a6c2e92d774b15ed5c534 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7ce5db5cb702e712465a6c2e92d774b15ed5c534 --force-share --output=json" returned: 0 in 0.186s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7ce5db5cb702e712465a6c2e92d774b15ed5c534,backing_fmt=raw /opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7ce5db5cb702e712465a6c2e92d774b15ed5c534,backing_fmt=raw /opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/disk 1073741824" returned: 0 in 0.056s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "7ce5db5cb702e712465a6c2e92d774b15ed5c534" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:22:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7ce5db5cb702e712465a6c2e92d774b15ed5c534 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7ce5db5cb702e712465a6c2e92d774b15ed5c534 --force-share --output=json" returned: 0 in 0.183s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:10 user nova-compute[74821]: DEBUG nova.objects.instance [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lazy-loading 'migration_context' on Instance uuid 32e28c73-9e3c-483b-807e-6b286413fe85 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:22:10 user nova-compute[74821]: DEBUG nova.objects.base [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Object Instance<32e28c73-9e3c-483b-807e-6b286413fe85> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:22:10 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Rebasing disk image.
Nov 06 13:22:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.192s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 -F raw /opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/disk {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 -F raw /opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/disk" returned: 0 in 2.472s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Ensure instance console log exists: /opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Start _get_guest_xml network_info=[{"id": "e5ab685a-b1f3-4704-963f-e7db827c947c", "address": "fa:16:3e:d5:da:15", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5ab685a-b1", "ovs_interfaceid": "e5ab685a-b1f3-4704-963f-e7db827c947c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='367c1d09222fa17c21b4bdfa1b29f16e',container_format='bare',created_at=2023-11-06T13:20:12Z,direct_url=<?>,disk_format='qcow2',id=72dd78d5-3a17-4f1e-a15c-d0de40ace806,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1563572892-shelved',owner='07250ce4ef1b429f8a5c3c7763866763',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-06T13:20:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:22:13 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:22:13 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:22:13 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='367c1d09222fa17c21b4bdfa1b29f16e',container_format='bare',created_at=2023-11-06T13:20:12Z,direct_url=<?>,disk_format='qcow2',id=72dd78d5-3a17-4f1e-a15c-d0de40ace806,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1563572892-shelved',owner='07250ce4ef1b429f8a5c3c7763866763',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-06T13:20:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG nova.objects.instance [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lazy-loading 'vcpu_model' on Instance uuid 32e28c73-9e3c-483b-807e-6b286413fe85 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG nova.objects.base [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Object Instance<32e28c73-9e3c-483b-807e-6b286413fe85> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T13:18:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1563572892',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1563572892',id=20,image_ref='72dd78d5-3a17-4f1e-a15c-d0de40ace806',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-724006026',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:18:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='07250ce4ef1b429f8a5c3c7763866763',ramdisk_id='',reservation_id='r-d03fj2ad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-374688010',owner_user_name='tempest-AttachVolumeShelveTestJSON-374688010-project-member',shelved_at='2023-11-06T13:20:17.262236',shelved_host='user',shelved_image_id='72dd78d5-3a17-4f1e-a15c-d0de40ace806'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:22:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c82a5e63234e40f6a8e63b3cb4dc97b3',uuid=32e28c73-9e3c-483b-807e-6b286413fe85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e5ab685a-b1f3-4704-963f-e7db827c947c", "address": "fa:16:3e:d5:da:15", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5ab685a-b1", "ovs_interfaceid": "e5ab685a-b1f3-4704-963f-e7db827c947c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Converting VIF {"id": "e5ab685a-b1f3-4704-963f-e7db827c947c", "address": "fa:16:3e:d5:da:15", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5ab685a-b1", "ovs_interfaceid": "e5ab685a-b1f3-4704-963f-e7db827c947c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:da:15,bridge_name='br-int',has_traffic_filtering=True,id=e5ab685a-b1f3-4704-963f-e7db827c947c,network=Network(5318228c-491a-4ea1-a2b2-49ea8e15dccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5ab685a-b1') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG nova.objects.instance [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lazy-loading 'pci_devices' on Instance uuid 32e28c73-9e3c-483b-807e-6b286413fe85 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG nova.objects.base [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Object Instance<32e28c73-9e3c-483b-807e-6b286413fe85> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:22:13 user nova-compute[74821]:   <uuid>32e28c73-9e3c-483b-807e-6b286413fe85</uuid>
Nov 06 13:22:13 user nova-compute[74821]:   <name>instance-00000014</name>
Nov 06 13:22:13 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:22:13 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:22:13 user nova-compute[74821]:   <metadata>
Nov 06 13:22:13 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:22:13 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:22:13 user nova-compute[74821]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1563572892</nova:name>
Nov 06 13:22:13 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:22:13</nova:creationTime>
Nov 06 13:22:13 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:22:13 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:22:13 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:22:13 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:22:13 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:22:13 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:22:13 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:22:13 user nova-compute[74821]:       <nova:owner>
Nov 06 13:22:13 user nova-compute[74821]:         <nova:user uuid="c82a5e63234e40f6a8e63b3cb4dc97b3">tempest-AttachVolumeShelveTestJSON-374688010-project-member</nova:user>
Nov 06 13:22:13 user nova-compute[74821]:         <nova:project uuid="07250ce4ef1b429f8a5c3c7763866763">tempest-AttachVolumeShelveTestJSON-374688010</nova:project>
Nov 06 13:22:13 user nova-compute[74821]:       </nova:owner>
Nov 06 13:22:13 user nova-compute[74821]:       <nova:root type="image" uuid="72dd78d5-3a17-4f1e-a15c-d0de40ace806"/>
Nov 06 13:22:13 user nova-compute[74821]:       <nova:ports>
Nov 06 13:22:13 user nova-compute[74821]:         <nova:port uuid="e5ab685a-b1f3-4704-963f-e7db827c947c">
Nov 06 13:22:13 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 06 13:22:13 user nova-compute[74821]:         </nova:port>
Nov 06 13:22:13 user nova-compute[74821]:       </nova:ports>
Nov 06 13:22:13 user nova-compute[74821]:     </nova:instance>
Nov 06 13:22:13 user nova-compute[74821]:   </metadata>
Nov 06 13:22:13 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:22:13 user nova-compute[74821]:     <system>
Nov 06 13:22:13 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:22:13 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:22:13 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:22:13 user nova-compute[74821]:       <entry name="serial">32e28c73-9e3c-483b-807e-6b286413fe85</entry>
Nov 06 13:22:13 user nova-compute[74821]:       <entry name="uuid">32e28c73-9e3c-483b-807e-6b286413fe85</entry>
Nov 06 13:22:13 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:22:13 user nova-compute[74821]:     </system>
Nov 06 13:22:13 user nova-compute[74821]:   </sysinfo>
Nov 06 13:22:13 user nova-compute[74821]:   <os>
Nov 06 13:22:13 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:22:13 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:22:13 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:22:13 user nova-compute[74821]:   </os>
Nov 06 13:22:13 user nova-compute[74821]:   <features>
Nov 06 13:22:13 user nova-compute[74821]:     <acpi/>
Nov 06 13:22:13 user nova-compute[74821]:     <apic/>
Nov 06 13:22:13 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:22:13 user nova-compute[74821]:   </features>
Nov 06 13:22:13 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:22:13 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:22:13 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:22:13 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:22:13 user nova-compute[74821]:   </clock>
Nov 06 13:22:13 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:22:13 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:22:13 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:22:13 user nova-compute[74821]:   </cpu>
Nov 06 13:22:13 user nova-compute[74821]:   <devices>
Nov 06 13:22:13 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:22:13 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:22:13 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/disk"/>
Nov 06 13:22:13 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:22:13 user nova-compute[74821]:     </disk>
Nov 06 13:22:13 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:22:13 user nova-compute[74821]:       <mac address="fa:16:3e:d5:da:15"/>
Nov 06 13:22:13 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:22:13 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:22:13 user nova-compute[74821]:       <target dev="tape5ab685a-b1"/>
Nov 06 13:22:13 user nova-compute[74821]:     </interface>
Nov 06 13:22:13 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:22:13 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/console.log" append="off"/>
Nov 06 13:22:13 user nova-compute[74821]:     </serial>
Nov 06 13:22:13 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:22:13 user nova-compute[74821]:     <video>
Nov 06 13:22:13 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:22:13 user nova-compute[74821]:     </video>
Nov 06 13:22:13 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:22:13 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:22:13 user nova-compute[74821]:     </rng>
Nov 06 13:22:13 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:22:13 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:22:13 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:22:13 user nova-compute[74821]:     </memballoon>
Nov 06 13:22:13 user nova-compute[74821]:   </devices>
Nov 06 13:22:13 user nova-compute[74821]: </domain>
Nov 06 13:22:13 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T13:18:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1563572892',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1563572892',id=20,image_ref='72dd78d5-3a17-4f1e-a15c-d0de40ace806',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-724006026',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:18:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='07250ce4ef1b429f8a5c3c7763866763',ramdisk_id='',reservation_id='r-d03fj2ad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-374688010',owner_user_name='tempest-AttachVolumeShelveTestJSON-374688010-project-member',shelved_at='2023-11-06T13:20:17.262236',shelved_host='user',shelved_image_id='72dd78d5-3a17-4f1e-a15c-d0de40ace806'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:22:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c82a5e63234e40f6a8e63b3cb4dc97b3',uuid=32e28c73-9e3c-483b-807e-6b286413fe85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e5ab685a-b1f3-4704-963f-e7db827c947c", "address": "fa:16:3e:d5:da:15", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5ab685a-b1", "ovs_interfaceid": "e5ab685a-b1f3-4704-963f-e7db827c947c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Converting VIF {"id": "e5ab685a-b1f3-4704-963f-e7db827c947c", "address": "fa:16:3e:d5:da:15", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5ab685a-b1", "ovs_interfaceid": "e5ab685a-b1f3-4704-963f-e7db827c947c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:da:15,bridge_name='br-int',has_traffic_filtering=True,id=e5ab685a-b1f3-4704-963f-e7db827c947c,network=Network(5318228c-491a-4ea1-a2b2-49ea8e15dccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5ab685a-b1') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG os_vif [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:da:15,bridge_name='br-int',has_traffic_filtering=True,id=e5ab685a-b1f3-4704-963f-e7db827c947c,network=Network(5318228c-491a-4ea1-a2b2-49ea8e15dccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5ab685a-b1') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9bc22cd1-492d-5e6d-abbc-b3cbbec0a229', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5ab685a-b1, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape5ab685a-b1, col_values=(('qos', UUID('16242dac-a5ed-48d9-849e-aee6620fc412')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape5ab685a-b1, col_values=(('external_ids', {'iface-id': 'e5ab685a-b1f3-4704-963f-e7db827c947c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:da:15', 'vm-uuid': '32e28c73-9e3c-483b-807e-6b286413fe85'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:13 user nova-compute[74821]: INFO os_vif [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:da:15,bridge_name='br-int',has_traffic_filtering=True,id=e5ab685a-b1f3-4704-963f-e7db827c947c,network=Network(5318228c-491a-4ea1-a2b2-49ea8e15dccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5ab685a-b1')
Nov 06 13:22:13 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:22:13 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] No VIF found with MAC fa:16:3e:d5:da:15, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:22:14 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:14 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:14 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:14 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:14 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:15 user nova-compute[74821]: DEBUG nova.compute.manager [req-713e1c73-c7de-48a2-a699-7fa49895f746 req-b1d99588-22ce-4453-a9a7-f0de6e94035d service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Received event network-vif-plugged-e5ab685a-b1f3-4704-963f-e7db827c947c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:22:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-713e1c73-c7de-48a2-a699-7fa49895f746 req-b1d99588-22ce-4453-a9a7-f0de6e94035d service nova] Acquiring lock "32e28c73-9e3c-483b-807e-6b286413fe85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:22:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-713e1c73-c7de-48a2-a699-7fa49895f746 req-b1d99588-22ce-4453-a9a7-f0de6e94035d service nova] Lock "32e28c73-9e3c-483b-807e-6b286413fe85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:22:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-713e1c73-c7de-48a2-a699-7fa49895f746 req-b1d99588-22ce-4453-a9a7-f0de6e94035d service nova] Lock "32e28c73-9e3c-483b-807e-6b286413fe85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:22:15 user nova-compute[74821]: DEBUG nova.compute.manager [req-713e1c73-c7de-48a2-a699-7fa49895f746 req-b1d99588-22ce-4453-a9a7-f0de6e94035d service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] No waiting events found dispatching network-vif-plugged-e5ab685a-b1f3-4704-963f-e7db827c947c {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:22:15 user nova-compute[74821]: WARNING nova.compute.manager [req-713e1c73-c7de-48a2-a699-7fa49895f746 req-b1d99588-22ce-4453-a9a7-f0de6e94035d service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Received unexpected event network-vif-plugged-e5ab685a-b1f3-4704-963f-e7db827c947c for instance with vm_state shelved_offloaded and task_state spawning.
Nov 06 13:22:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:17 user nova-compute[74821]: DEBUG nova.compute.manager [req-e8a7fcb3-f216-4d13-a2bb-62300068eba0 req-8bda767b-8a00-4403-8ba1-bf9ea01c8fb4 service nova] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Received event network-changed-0a9f35be-92cb-4904-998d-213bac64ebc0 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:22:17 user nova-compute[74821]: DEBUG nova.compute.manager [req-e8a7fcb3-f216-4d13-a2bb-62300068eba0 req-8bda767b-8a00-4403-8ba1-bf9ea01c8fb4 service nova] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Refreshing instance network info cache due to event network-changed-0a9f35be-92cb-4904-998d-213bac64ebc0. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:22:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e8a7fcb3-f216-4d13-a2bb-62300068eba0 req-8bda767b-8a00-4403-8ba1-bf9ea01c8fb4 service nova] Acquiring lock "refresh_cache-be3cb35a-d45e-4e35-96fe-437a941c0244" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:22:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e8a7fcb3-f216-4d13-a2bb-62300068eba0 req-8bda767b-8a00-4403-8ba1-bf9ea01c8fb4 service nova] Acquired lock "refresh_cache-be3cb35a-d45e-4e35-96fe-437a941c0244" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:22:17 user nova-compute[74821]: DEBUG nova.network.neutron [req-e8a7fcb3-f216-4d13-a2bb-62300068eba0 req-8bda767b-8a00-4403-8ba1-bf9ea01c8fb4 service nova] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Refreshing network info cache for port 0a9f35be-92cb-4904-998d-213bac64ebc0 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:22:17 user nova-compute[74821]: DEBUG nova.compute.manager [req-4185c026-bde4-4ea6-840a-558ddf30a365 req-7e4a5ce2-75d2-42b1-bdbb-7031a679c002 service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Received event network-vif-plugged-e5ab685a-b1f3-4704-963f-e7db827c947c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:22:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4185c026-bde4-4ea6-840a-558ddf30a365 req-7e4a5ce2-75d2-42b1-bdbb-7031a679c002 service nova] Acquiring lock "32e28c73-9e3c-483b-807e-6b286413fe85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:22:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4185c026-bde4-4ea6-840a-558ddf30a365 req-7e4a5ce2-75d2-42b1-bdbb-7031a679c002 service nova] Lock "32e28c73-9e3c-483b-807e-6b286413fe85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:22:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4185c026-bde4-4ea6-840a-558ddf30a365 req-7e4a5ce2-75d2-42b1-bdbb-7031a679c002 service nova] Lock "32e28c73-9e3c-483b-807e-6b286413fe85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:22:17 user nova-compute[74821]: DEBUG nova.compute.manager [req-4185c026-bde4-4ea6-840a-558ddf30a365 req-7e4a5ce2-75d2-42b1-bdbb-7031a679c002 service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] No waiting events found dispatching network-vif-plugged-e5ab685a-b1f3-4704-963f-e7db827c947c {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:22:17 user nova-compute[74821]: WARNING nova.compute.manager [req-4185c026-bde4-4ea6-840a-558ddf30a365 req-7e4a5ce2-75d2-42b1-bdbb-7031a679c002 service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Received unexpected event network-vif-plugged-e5ab685a-b1f3-4704-963f-e7db827c947c for instance with vm_state shelved_offloaded and task_state spawning.
Nov 06 13:22:17 user nova-compute[74821]: DEBUG nova.compute.manager [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:22:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:22:17 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Instance spawned successfully.
Nov 06 13:22:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Acquiring lock "be3cb35a-d45e-4e35-96fe-437a941c0244" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:22:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "be3cb35a-d45e-4e35-96fe-437a941c0244" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:22:17 user nova-compute[74821]: DEBUG nova.objects.instance [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lazy-loading 'flavor' on Instance uuid be3cb35a-d45e-4e35-96fe-437a941c0244 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:22:17 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Ignoring supplied device name: /dev/vdb
Nov 06 13:22:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "be3cb35a-d45e-4e35-96fe-437a941c0244" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:22:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:22:17 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Creating image(s)
Nov 06 13:22:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "/opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:22:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "/opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:22:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "/opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:22:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.182s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:22:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:22:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:17 user nova-compute[74821]: DEBUG nova.compute.manager [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:22:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.172s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk 1073741824" returned: 0 in 0.063s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:22:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Acquiring lock "be3cb35a-d45e-4e35-96fe-437a941c0244" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:22:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "be3cb35a-d45e-4e35-96fe-437a941c0244" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:22:17 user nova-compute[74821]: INFO nova.compute.manager [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Attaching volume 56e8f341-6fcd-4f3e-8fa0-e4415103d97e to /dev/vdb
Nov 06 13:22:17 user nova-compute[74821]: DEBUG nova.network.neutron [req-e8a7fcb3-f216-4d13-a2bb-62300068eba0 req-8bda767b-8a00-4403-8ba1-bf9ea01c8fb4 service nova] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Updated VIF entry in instance network info cache for port 0a9f35be-92cb-4904-998d-213bac64ebc0. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:22:17 user nova-compute[74821]: DEBUG nova.network.neutron [req-e8a7fcb3-f216-4d13-a2bb-62300068eba0 req-8bda767b-8a00-4403-8ba1-bf9ea01c8fb4 service nova] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Updating instance_info_cache with network_info: [{"id": "0a9f35be-92cb-4904-998d-213bac64ebc0", "address": "fa:16:3e:a8:3b:43", "network": {"id": "9fe30aa2-5c5b-448b-8bd5-cdeda2721e6b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2097801930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f25eb95045d145c99d728e5d007ec1b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a9f35be-92", "ovs_interfaceid": "0a9f35be-92cb-4904-998d-213bac64ebc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:22:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8ec8b6ce-f13d-4f03-a20c-8cefeac61031 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "32e28c73-9e3c-483b-807e-6b286413fe85" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.057s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:22:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e8a7fcb3-f216-4d13-a2bb-62300068eba0 req-8bda767b-8a00-4403-8ba1-bf9ea01c8fb4 service nova] Releasing lock "refresh_cache-be3cb35a-d45e-4e35-96fe-437a941c0244" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:22:17 user nova-compute[74821]: DEBUG os_brick.utils [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:22:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3988598e-fe89-4912-be63-3d5540031d54]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[059bfa6c-b17d-48b0-817a-faad5d3abc04]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c9cf50-c5bd-48c4-8021-847215e48576]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8fec1d-1a20-4446-af89-296382483675]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.264s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Checking if we can resize image /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:22:18 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf318bc6-ed96-4bf5-81a9-b444d48aae41]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG os_brick.utils [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] <== get_connector_properties: return (196ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Updating existing volume attachment record: bfb7ae90-8f1d-43da-a083-ad05ac0f7d72 {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Cannot resize image /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Ensure instance console log exists: /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Start _get_guest_xml network_info=[{"id": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "address": "fa:16:3e:6c:6c:87", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap741cb43d-19", "ovs_interfaceid": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvHqMJOQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '290cd798-a041-40c0-8ef9-319d3627ff82', 'attached_at': '', 'detached_at': '', 'volume_id': 'c27cae42-439c-4fd6-8c64-b7a0144f2116', 'serial': 'c27cae42-439c-4fd6-8c64-b7a0144f2116'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '06a59f45-5cac-46e3-be3a-bb6ca6176201', 'volume_type': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:22:18 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 06 13:22:18 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 06 13:22:18 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG nova.objects.instance [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lazy-loading 'vcpu_model' on Instance uuid 290cd798-a041-40c0-8ef9-319d3627ff82 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvHqMJOQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:22:18 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 06 13:22:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:22:18 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 06 13:22:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:22:18 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f1b8d2-14c5-4daa-aed8-6acdc52134ca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:22:18 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca019222-350a-479d-b2ca-392e5201709c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116] added
Nov 06 13:22:18 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c477ae3-10e0-4efb-9f00-1130e6596a0b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb80b1d-d1e6-4492-b48c-1c3becd8a01b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TvHqMJOQ {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TvHqMJOQ" returned: 0 in 0.031s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6bc24e-b904-4dd4-9cf7-5a0cf680b1de]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TvHqMJOQ'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f1ea37-175a-40b3-9ae7-f694e4ddc4cb]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdab7072-4528-408b-bdb8-fbffd5473b03]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:22:18 user nova-compute[74821]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:22:18 user nova-compute[74821]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)
Nov 06 13:22:18 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:22:18 user nova-compute[74821]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:22:18 user nova-compute[74821]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)
Nov 06 13:22:18 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd28183e-36a5-4ed6-ad41-ca3aa5c6806d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116, portal: 172.16.0.220,3260]
Nov 06 13:22:18 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116, portal: 172.16.0.220,3260] successful.
Nov 06 13:22:18 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d86d053-951c-49f2-9d0d-438040909599]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8e318c-8e4a-4fe0-9599-a7177ed5de55]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:22:18 user nova-compute[74821]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:22:18 user nova-compute[74821]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)
Nov 06 13:22:18 user nova-compute[74821]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)
Nov 06 13:22:18 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:22:18 user nova-compute[74821]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:22:18 user nova-compute[74821]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)
Nov 06 13:22:18 user nova-compute[74821]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)
Nov 06 13:22:18 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] HCTL ('36', '-', '-', 0) found on session 21 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1261a6ad-1c8e-4cd2-8cf7-2edb7b09226f]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:22:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvHqMJOQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:22:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:19 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:22:19 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] <== connect_volume: return (1410ms) {'type': 'block', 'scsi_wwn': '23833653836313031', 'path': '/dev/sde'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:22:19 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833653836313031', 'path': '/dev/sde'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:22:19 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T13:18:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-219751972',display_name='tempest-ServerActionsTestOtherA-server-1045248039',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-219751972',id=21,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGVJpgtmRZL9WKhOaXwD5m/EAyvGSguG6jTTT7b4IRvn135izX0urMafelC8vQXZBMR8O1HoZmDg8wWA0Bz8SPSg87ol6FREXNQzdTu5vhYkn54jvZdlsWdAb1XlCYP+3Q==',key_name='tempest-keypair-1473532461',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:18:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='77233758870b4fdfbb7ca76829f0f82e',ramdisk_id='',reservation_id='r-4lip00k3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1986828412',owner_user_name='tempest-ServerActionsTestOtherA-1986828412-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:21:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0620d1928d8d434fbe0bc1cdb31a2a89',uuid=290cd798-a041-40c0-8ef9-319d3627ff82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "address": "fa:16:3e:6c:6c:87", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap741cb43d-19", "ovs_interfaceid": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:22:19 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Converting VIF {"id": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "address": "fa:16:3e:6c:6c:87", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap741cb43d-19", "ovs_interfaceid": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:22:19 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:6c:87,bridge_name='br-int',has_traffic_filtering=True,id=741cb43d-19ba-4edc-92f0-5de562bf4c2c,network=Network(a3838abe-b3bb-4878-9d5d-eb80a8cf60a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap741cb43d-19') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:22:19 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:22:19 user nova-compute[74821]:   <uuid>290cd798-a041-40c0-8ef9-319d3627ff82</uuid>
Nov 06 13:22:19 user nova-compute[74821]:   <name>instance-00000015</name>
Nov 06 13:22:19 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:22:19 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:22:19 user nova-compute[74821]:   <metadata>
Nov 06 13:22:19 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:22:19 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:22:19 user nova-compute[74821]:       <nova:name>tempest-ServerActionsTestOtherA-server-1045248039</nova:name>
Nov 06 13:22:19 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:22:18</nova:creationTime>
Nov 06 13:22:19 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:22:19 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:22:19 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:22:19 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:22:19 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:22:19 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:22:19 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:22:19 user nova-compute[74821]:       <nova:owner>
Nov 06 13:22:19 user nova-compute[74821]:         <nova:user uuid="0620d1928d8d434fbe0bc1cdb31a2a89">tempest-ServerActionsTestOtherA-1986828412-project-member</nova:user>
Nov 06 13:22:19 user nova-compute[74821]:         <nova:project uuid="77233758870b4fdfbb7ca76829f0f82e">tempest-ServerActionsTestOtherA-1986828412</nova:project>
Nov 06 13:22:19 user nova-compute[74821]:       </nova:owner>
Nov 06 13:22:19 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:22:19 user nova-compute[74821]:       <nova:ports>
Nov 06 13:22:19 user nova-compute[74821]:         <nova:port uuid="741cb43d-19ba-4edc-92f0-5de562bf4c2c">
Nov 06 13:22:19 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 06 13:22:19 user nova-compute[74821]:         </nova:port>
Nov 06 13:22:19 user nova-compute[74821]:       </nova:ports>
Nov 06 13:22:19 user nova-compute[74821]:     </nova:instance>
Nov 06 13:22:19 user nova-compute[74821]:   </metadata>
Nov 06 13:22:19 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:22:19 user nova-compute[74821]:     <system>
Nov 06 13:22:19 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:22:19 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:22:19 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:22:19 user nova-compute[74821]:       <entry name="serial">290cd798-a041-40c0-8ef9-319d3627ff82</entry>
Nov 06 13:22:19 user nova-compute[74821]:       <entry name="uuid">290cd798-a041-40c0-8ef9-319d3627ff82</entry>
Nov 06 13:22:19 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:22:19 user nova-compute[74821]:     </system>
Nov 06 13:22:19 user nova-compute[74821]:   </sysinfo>
Nov 06 13:22:19 user nova-compute[74821]:   <os>
Nov 06 13:22:19 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:22:19 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:22:19 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:22:19 user nova-compute[74821]:   </os>
Nov 06 13:22:19 user nova-compute[74821]:   <features>
Nov 06 13:22:19 user nova-compute[74821]:     <acpi/>
Nov 06 13:22:19 user nova-compute[74821]:     <apic/>
Nov 06 13:22:19 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:22:19 user nova-compute[74821]:   </features>
Nov 06 13:22:19 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:22:19 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:22:19 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:22:19 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:22:19 user nova-compute[74821]:   </clock>
Nov 06 13:22:19 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:22:19 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:22:19 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:22:19 user nova-compute[74821]:   </cpu>
Nov 06 13:22:19 user nova-compute[74821]:   <devices>
Nov 06 13:22:19 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:22:19 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:22:19 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk"/>
Nov 06 13:22:19 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:22:19 user nova-compute[74821]:     </disk>
Nov 06 13:22:19 user nova-compute[74821]:     <disk type="block" device="disk">
Nov 06 13:22:19 user nova-compute[74821]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:22:19 user nova-compute[74821]:       <source dev="/dev/sde"/>
Nov 06 13:22:19 user nova-compute[74821]:       <target dev="vdb" bus="virtio"/>
Nov 06 13:22:19 user nova-compute[74821]:       <serial>c27cae42-439c-4fd6-8c64-b7a0144f2116</serial>
Nov 06 13:22:19 user nova-compute[74821]:     </disk>
Nov 06 13:22:19 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:22:19 user nova-compute[74821]:       <mac address="fa:16:3e:6c:6c:87"/>
Nov 06 13:22:19 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:22:19 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:22:19 user nova-compute[74821]:       <target dev="tap741cb43d-19"/>
Nov 06 13:22:19 user nova-compute[74821]:     </interface>
Nov 06 13:22:19 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:22:19 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/console.log" append="off"/>
Nov 06 13:22:19 user nova-compute[74821]:     </serial>
Nov 06 13:22:19 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:22:19 user nova-compute[74821]:     <video>
Nov 06 13:22:19 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:22:19 user nova-compute[74821]:     </video>
Nov 06 13:22:19 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:22:19 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:22:19 user nova-compute[74821]:     </rng>
Nov 06 13:22:19 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:22:19 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:22:19 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:22:19 user nova-compute[74821]:     </memballoon>
Nov 06 13:22:19 user nova-compute[74821]:   </devices>
Nov 06 13:22:19 user nova-compute[74821]: </domain>
Nov 06 13:22:19 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:22:19 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T13:18:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-219751972',display_name='tempest-ServerActionsTestOtherA-server-1045248039',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-219751972',id=21,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGVJpgtmRZL9WKhOaXwD5m/EAyvGSguG6jTTT7b4IRvn135izX0urMafelC8vQXZBMR8O1HoZmDg8wWA0Bz8SPSg87ol6FREXNQzdTu5vhYkn54jvZdlsWdAb1XlCYP+3Q==',key_name='tempest-keypair-1473532461',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:18:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='77233758870b4fdfbb7ca76829f0f82e',ramdisk_id='',reservation_id='r-4lip00k3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1986828412',owner_user_name='tempest-ServerActionsTestOtherA-1986828412-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:21:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0620d1928d8d434fbe0bc1cdb31a2a89',uuid=290cd798-a041-40c0-8ef9-319d3627ff82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "address": "fa:16:3e:6c:6c:87", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap741cb43d-19", "ovs_interfaceid": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:22:19 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Converting VIF {"id": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "address": "fa:16:3e:6c:6c:87", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap741cb43d-19", "ovs_interfaceid": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:22:19 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:6c:87,bridge_name='br-int',has_traffic_filtering=True,id=741cb43d-19ba-4edc-92f0-5de562bf4c2c,network=Network(a3838abe-b3bb-4878-9d5d-eb80a8cf60a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap741cb43d-19') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:22:19 user nova-compute[74821]: DEBUG os_vif [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:6c:87,bridge_name='br-int',has_traffic_filtering=True,id=741cb43d-19ba-4edc-92f0-5de562bf4c2c,network=Network(a3838abe-b3bb-4878-9d5d-eb80a8cf60a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap741cb43d-19') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:22:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:22:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:22:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fbbe4059-72df-5a25-a197-c8a0e5f4a1f0', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:22:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:22:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap741cb43d-19, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:22:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap741cb43d-19, col_values=(('qos', UUID('b952231b-5da4-49cc-9470-39253cf0d5f2')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:22:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap741cb43d-19, col_values=(('external_ids', {'iface-id': '741cb43d-19ba-4edc-92f0-5de562bf4c2c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:6c:87', 'vm-uuid': '290cd798-a041-40c0-8ef9-319d3627ff82'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:22:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:22:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:19 user nova-compute[74821]: INFO os_vif [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:6c:87,bridge_name='br-int',has_traffic_filtering=True,id=741cb43d-19ba-4edc-92f0-5de562bf4c2c,network=Network(a3838abe-b3bb-4878-9d5d-eb80a8cf60a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap741cb43d-19')
Nov 06 13:22:20 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:22:20 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:22:20 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] No VIF found with MAC fa:16:3e:6c:6c:87, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:22:21 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:21 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:21 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:21 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:21 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:21 user nova-compute[74821]: DEBUG nova.compute.manager [req-9792fc8a-8e2a-439a-9662-0f883fe8cda5 req-c58d1d47-a6a8-4f01-9af5-0c309ef67e01 service nova] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Received event network-vif-plugged-741cb43d-19ba-4edc-92f0-5de562bf4c2c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:22:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-9792fc8a-8e2a-439a-9662-0f883fe8cda5 req-c58d1d47-a6a8-4f01-9af5-0c309ef67e01 service nova] Acquiring lock "290cd798-a041-40c0-8ef9-319d3627ff82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:22:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-9792fc8a-8e2a-439a-9662-0f883fe8cda5 req-c58d1d47-a6a8-4f01-9af5-0c309ef67e01 service nova] Lock "290cd798-a041-40c0-8ef9-319d3627ff82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:22:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-9792fc8a-8e2a-439a-9662-0f883fe8cda5 req-c58d1d47-a6a8-4f01-9af5-0c309ef67e01 service nova] Lock "290cd798-a041-40c0-8ef9-319d3627ff82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:22:21 user nova-compute[74821]: DEBUG nova.compute.manager [req-9792fc8a-8e2a-439a-9662-0f883fe8cda5 req-c58d1d47-a6a8-4f01-9af5-0c309ef67e01 service nova] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] No waiting events found dispatching network-vif-plugged-741cb43d-19ba-4edc-92f0-5de562bf4c2c {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:22:21 user nova-compute[74821]: WARNING nova.compute.manager [req-9792fc8a-8e2a-439a-9662-0f883fe8cda5 req-c58d1d47-a6a8-4f01-9af5-0c309ef67e01 service nova] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Received unexpected event network-vif-plugged-741cb43d-19ba-4edc-92f0-5de562bf4c2c for instance with vm_state active and task_state rebuild_spawning.
Nov 06 13:22:21 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:21 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:23 user nova-compute[74821]: DEBUG nova.compute.manager [req-14150b4d-7872-49a6-a0f8-7333f50e6401 req-23d08138-f683-48b1-9d87-e18bbe2a66fc service nova] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Received event network-vif-plugged-741cb43d-19ba-4edc-92f0-5de562bf4c2c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:22:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-14150b4d-7872-49a6-a0f8-7333f50e6401 req-23d08138-f683-48b1-9d87-e18bbe2a66fc service nova] Acquiring lock "290cd798-a041-40c0-8ef9-319d3627ff82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:22:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-14150b4d-7872-49a6-a0f8-7333f50e6401 req-23d08138-f683-48b1-9d87-e18bbe2a66fc service nova] Lock "290cd798-a041-40c0-8ef9-319d3627ff82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:22:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-14150b4d-7872-49a6-a0f8-7333f50e6401 req-23d08138-f683-48b1-9d87-e18bbe2a66fc service nova] Lock "290cd798-a041-40c0-8ef9-319d3627ff82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:22:23 user nova-compute[74821]: DEBUG nova.compute.manager [req-14150b4d-7872-49a6-a0f8-7333f50e6401 req-23d08138-f683-48b1-9d87-e18bbe2a66fc service nova] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] No waiting events found dispatching network-vif-plugged-741cb43d-19ba-4edc-92f0-5de562bf4c2c {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:22:23 user nova-compute[74821]: WARNING nova.compute.manager [req-14150b4d-7872-49a6-a0f8-7333f50e6401 req-23d08138-f683-48b1-9d87-e18bbe2a66fc service nova] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Received unexpected event network-vif-plugged-741cb43d-19ba-4edc-92f0-5de562bf4c2c for instance with vm_state active and task_state rebuild_spawning.
Nov 06 13:22:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:24 user nova-compute[74821]: DEBUG nova.compute.manager [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:22:24 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:22:24 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Instance spawned successfully.
Nov 06 13:22:24 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:22:24 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:22:24 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:22:24 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:22:24 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:22:24 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:22:24 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:22:24 user nova-compute[74821]: DEBUG nova.compute.manager [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:22:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:22:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:22:24 user nova-compute[74821]: DEBUG nova.objects.instance [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74821) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 06 13:22:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cfab10ba-4149-40de-92b1-4d15484800be tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.106s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:22:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:25 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:22:29 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:22:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:22:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:22:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:22:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:22:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:22:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:30 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:22:32 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:22:33 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:22:33 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:22:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-49c65aca-8392-46ba-8fa3-b47ff2416cb9" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:22:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-49c65aca-8392-46ba-8fa3-b47ff2416cb9" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:22:34 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:22:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:34 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Updating instance_info_cache with network_info: [{"id": "2000e5c8-e30c-44d9-b79c-fac8a9039c49", "address": "fa:16:3e:06:9f:52", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2000e5c8-e3", "ovs_interfaceid": "2000e5c8-e30c-44d9-b79c-fac8a9039c49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:22:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-49c65aca-8392-46ba-8fa3-b47ff2416cb9" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:22:34 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:22:34 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:22:34 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:22:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:35 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:22:36 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:22:38 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:22:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:22:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:22:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:22:39 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:22:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3cb35a-d45e-4e35-96fe-437a941c0244/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3cb35a-d45e-4e35-96fe-437a941c0244/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3cb35a-d45e-4e35-96fe-437a941c0244/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3cb35a-d45e-4e35-96fe-437a941c0244/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:42 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:22:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a895162-eec9-4e5f-a7d3-bd36155da4b8/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a895162-eec9-4e5f-a7d3-bd36155da4b8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a895162-eec9-4e5f-a7d3-bd36155da4b8/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a895162-eec9-4e5f-a7d3-bd36155da4b8/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:43 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:22:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk.rescue --force-share --output=json" returned: 0 in 0.250s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:44 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:22:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:22:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/496f8213-4b32-4211-a354-e33a4a088848/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/496f8213-4b32-4211-a354-e33a4a088848/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/496f8213-4b32-4211-a354-e33a4a088848/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Acquiring lock "5a07f64b-5b12-4e7d-a041-ad591141aa17" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:22:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:22:45 user nova-compute[74821]: DEBUG nova.objects.instance [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lazy-loading 'flavor' on Instance uuid 5a07f64b-5b12-4e7d-a041-ad591141aa17 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:22:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:22:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/496f8213-4b32-4211-a354-e33a4a088848/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:46 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:22:46 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:22:46 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=7129MB free_disk=25.13806915283203GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Acquiring lock "5a07f64b-5b12-4e7d-a041-ad591141aa17" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:22:46 user nova-compute[74821]: INFO nova.compute.manager [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Attaching volume b42dbce4-83ea-498c-abcf-86517f54ae3a to /dev/vdb
Nov 06 13:22:46 user nova-compute[74821]: DEBUG os_brick.utils [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fb37d9-8a73-4f5d-84a7-73167d856a6f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb74c6ff-9b9c-4252-9682-b953a99559fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[073d9f5a-5daa-4d86-9199-bde9e826a82f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b0bd85-a432-4f5e-a805-1a5779faf055]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 3e21d005-f190-478a-a911-e483e1235057 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 311817c5-7b08-4da9-98eb-c685f37e6fd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 2de346cb-9858-47b8-a86c-4fde720d6127 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 49c65aca-8392-46ba-8fa3-b47ff2416cb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 107abf1d-96da-4406-8111-ef0bc09fb3e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance cc3c1518-c493-41b0-a748-a0ed933c2b1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 290cd798-a041-40c0-8ef9-319d3627ff82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 5a07f64b-5b12-4e7d-a041-ad591141aa17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 61beb251-4345-44e6-a176-5c14c99c9a52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 496f8213-4b32-4211-a354-e33a4a088848 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance be3cb35a-d45e-4e35-96fe-437a941c0244 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 6a895162-eec9-4e5f-a7d3-bd36155da4b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 32e28c73-9e3c-483b-807e-6b286413fe85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:22:46 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:22:46 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[96550ece-2872-449b-9324-269399b690fc]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG os_brick.utils [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Updating existing volume attachment record: 0532e8ec-c6fa-4f94-8047-85c8b2e3ca8a {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:22:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.730s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:22:47 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:22:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:22:58 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:22:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'blJIYnvR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:22:58 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:22:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:22:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:22:58 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:22:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:22:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:22:58 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:22:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:58 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5129eb-a94b-40e0-8fb6-f23b87906d16]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:22:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:22:58 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:22:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:58 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab33c8d-bf89-4621-bf5a-2d6d75a43a85]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:22:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e] added
Nov 06 13:22:58 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:22:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:58 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c97c698-6670-469b-9a4b-2c631eb09359]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:22:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:22:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:58 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0762c04e-32f9-47ea-bf30-313ec9c32398]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:22:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:22:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v blJIYnvR {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v blJIYnvR" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:58 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59e4205-7502-4572-9d25-d3dc40edd403]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:22:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'blJIYnvR'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:22:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:58 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[234f60f0-422a-48af-be9a-62591f773074]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:22:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:22:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:58 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8aa2441-149e-4d75-bd90-d49bd2d71e64]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:22:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:22:58 user nova-compute[74821]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:22:58 user nova-compute[74821]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)
Nov 06 13:22:58 user nova-compute[74821]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)
Nov 06 13:22:58 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:22:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:22:58 user nova-compute[74821]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:22:58 user nova-compute[74821]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)
Nov 06 13:22:58 user nova-compute[74821]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)
Nov 06 13:22:58 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:22:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:59 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:59 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05614bd-5686-4595-a608-f1bd61f684c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:22:59 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e, portal: 172.16.0.220,3260]
Nov 06 13:22:59 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e, portal: 172.16.0.220,3260] successful.
Nov 06 13:22:59 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:22:59 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:59 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:59 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b927f17-00c2-4512-b829-c5f882f63aa3]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:22:59 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:22:59 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:59 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:59 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f2adf1-8c28-426d-9437-5294e854b57f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:22:59 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:22:59 user nova-compute[74821]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:22:59 user nova-compute[74821]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)
Nov 06 13:22:59 user nova-compute[74821]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)
Nov 06 13:22:59 user nova-compute[74821]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e (non-flash)
Nov 06 13:22:59 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:22:59 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:22:59 user nova-compute[74821]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:22:59 user nova-compute[74821]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)
Nov 06 13:22:59 user nova-compute[74821]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)
Nov 06 13:22:59 user nova-compute[74821]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e (non-flash)
Nov 06 13:22:59 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:22:59 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:22:59 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:22:59 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] HCTL ('37', '-', '-', 0) found on session 22 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:22:59 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:22:59 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:22:59 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:22:59 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7292410-d81c-4011-be0f-176d10ccf423]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:22:59 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Searching for a device in session 22 and hctl ['37', '*', '*', 0] yield: None {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:22:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:23:00 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Searching for a device in session 22 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:23:00 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'blJIYnvR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:23:00 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:23:00 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26532393737353464', 'path': '/dev/sdf'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:23:00 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532393737353464', 'path': '/dev/sdf'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:23:00 user nova-compute[74821]: DEBUG nova.objects.instance [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lazy-loading 'flavor' on Instance uuid be3cb35a-d45e-4e35-96fe-437a941c0244 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:23:00 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 13:23:00 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:23:00 user nova-compute[74821]:   <source dev="/dev/sdf"/>
Nov 06 13:23:00 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:23:00 user nova-compute[74821]:   <serial>56e8f341-6fcd-4f3e-8fa0-e4415103d97e</serial>
Nov 06 13:23:00 user nova-compute[74821]: </disk>
Nov 06 13:23:00 user nova-compute[74821]:  {{(pid=74821) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 13:23:00 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:23:00 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:23:00 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] No VIF found with MAC fa:16:3e:a8:3b:43, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:23:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-25f64fa7-47c6-4df6-8b26-01bbae971c91 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "be3cb35a-d45e-4e35-96fe-437a941c0244" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 42.867s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:23:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:23:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:23:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:23:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:23:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:23:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:23:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:23:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:23:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:23:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:23:20 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:23:20 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:20 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:23:20 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:23:20 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:23:20 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:20 user nova-compute[74821]: INFO nova.compute.manager [None req-5a7a861c-bba1-44c3-807c-6748f04eb6a1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Unrescuing
Nov 06 13:23:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5a7a861c-bba1-44c3-807c-6748f04eb6a1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "refresh_cache-496f8213-4b32-4211-a354-e33a4a088848" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:23:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5a7a861c-bba1-44c3-807c-6748f04eb6a1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquired lock "refresh_cache-496f8213-4b32-4211-a354-e33a4a088848" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:23:20 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5a7a861c-bba1-44c3-807c-6748f04eb6a1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:23:21 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5a7a861c-bba1-44c3-807c-6748f04eb6a1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Updating instance_info_cache with network_info: [{"id": "0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc", "address": "fa:16:3e:de:d4:5d", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dbd0a11-07", "ovs_interfaceid": "0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:23:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5a7a861c-bba1-44c3-807c-6748f04eb6a1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Releasing lock "refresh_cache-496f8213-4b32-4211-a354-e33a4a088848" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:23:21 user nova-compute[74821]: DEBUG nova.objects.instance [None req-5a7a861c-bba1-44c3-807c-6748f04eb6a1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lazy-loading 'flavor' on Instance uuid 496f8213-4b32-4211-a354-e33a4a088848 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:23:21 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:21 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:21 user nova-compute[74821]: DEBUG nova.compute.manager [req-b4ace959-12bf-4770-bae0-1e91543cfd3c req-24afcb37-64e8-4a4f-ad61-2be8ea020de5 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Received event network-vif-unplugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:23:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b4ace959-12bf-4770-bae0-1e91543cfd3c req-24afcb37-64e8-4a4f-ad61-2be8ea020de5 service nova] Acquiring lock "496f8213-4b32-4211-a354-e33a4a088848-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:23:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b4ace959-12bf-4770-bae0-1e91543cfd3c req-24afcb37-64e8-4a4f-ad61-2be8ea020de5 service nova] Lock "496f8213-4b32-4211-a354-e33a4a088848-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:23:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b4ace959-12bf-4770-bae0-1e91543cfd3c req-24afcb37-64e8-4a4f-ad61-2be8ea020de5 service nova] Lock "496f8213-4b32-4211-a354-e33a4a088848-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:23:21 user nova-compute[74821]: DEBUG nova.compute.manager [req-b4ace959-12bf-4770-bae0-1e91543cfd3c req-24afcb37-64e8-4a4f-ad61-2be8ea020de5 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] No waiting events found dispatching network-vif-unplugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:23:21 user nova-compute[74821]: WARNING nova.compute.manager [req-b4ace959-12bf-4770-bae0-1e91543cfd3c req-24afcb37-64e8-4a4f-ad61-2be8ea020de5 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Received unexpected event network-vif-unplugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc for instance with vm_state rescued and task_state unrescuing.
Nov 06 13:23:21 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:21 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:22 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Instance destroyed successfully.
Nov 06 13:23:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:23 user nova-compute[74821]: DEBUG nova.compute.manager [req-d9e59e02-68ce-49d8-81cb-9339a49afdea req-53533d08-e70d-4fb3-980b-87774d38f134 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Received event network-vif-plugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:23:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d9e59e02-68ce-49d8-81cb-9339a49afdea req-53533d08-e70d-4fb3-980b-87774d38f134 service nova] Acquiring lock "496f8213-4b32-4211-a354-e33a4a088848-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:23:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d9e59e02-68ce-49d8-81cb-9339a49afdea req-53533d08-e70d-4fb3-980b-87774d38f134 service nova] Lock "496f8213-4b32-4211-a354-e33a4a088848-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:23:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d9e59e02-68ce-49d8-81cb-9339a49afdea req-53533d08-e70d-4fb3-980b-87774d38f134 service nova] Lock "496f8213-4b32-4211-a354-e33a4a088848-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:23:23 user nova-compute[74821]: DEBUG nova.compute.manager [req-d9e59e02-68ce-49d8-81cb-9339a49afdea req-53533d08-e70d-4fb3-980b-87774d38f134 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] No waiting events found dispatching network-vif-plugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:23:23 user nova-compute[74821]: WARNING nova.compute.manager [req-d9e59e02-68ce-49d8-81cb-9339a49afdea req-53533d08-e70d-4fb3-980b-87774d38f134 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Received unexpected event network-vif-plugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc for instance with vm_state rescued and task_state unrescuing.
Nov 06 13:23:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:25 user nova-compute[74821]: INFO nova.compute.manager [None req-c44dd87d-8c6e-47cb-ab35-740c84a9275b tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Unrescuing
Nov 06 13:23:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c44dd87d-8c6e-47cb-ab35-740c84a9275b tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "refresh_cache-61beb251-4345-44e6-a176-5c14c99c9a52" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:23:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c44dd87d-8c6e-47cb-ab35-740c84a9275b tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquired lock "refresh_cache-61beb251-4345-44e6-a176-5c14c99c9a52" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:23:25 user nova-compute[74821]: DEBUG nova.network.neutron [None req-c44dd87d-8c6e-47cb-ab35-740c84a9275b tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:23:25 user nova-compute[74821]: DEBUG nova.compute.manager [req-6757c091-60ff-4a2e-bad5-0be4c922252f req-07af94a5-06ba-4887-9092-c6d2fb31aeab service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Received event network-vif-plugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:23:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6757c091-60ff-4a2e-bad5-0be4c922252f req-07af94a5-06ba-4887-9092-c6d2fb31aeab service nova] Acquiring lock "496f8213-4b32-4211-a354-e33a4a088848-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:23:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6757c091-60ff-4a2e-bad5-0be4c922252f req-07af94a5-06ba-4887-9092-c6d2fb31aeab service nova] Lock "496f8213-4b32-4211-a354-e33a4a088848-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:23:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6757c091-60ff-4a2e-bad5-0be4c922252f req-07af94a5-06ba-4887-9092-c6d2fb31aeab service nova] Lock "496f8213-4b32-4211-a354-e33a4a088848-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:23:25 user nova-compute[74821]: DEBUG nova.compute.manager [req-6757c091-60ff-4a2e-bad5-0be4c922252f req-07af94a5-06ba-4887-9092-c6d2fb31aeab service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] No waiting events found dispatching network-vif-plugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:23:25 user nova-compute[74821]: WARNING nova.compute.manager [req-6757c091-60ff-4a2e-bad5-0be4c922252f req-07af94a5-06ba-4887-9092-c6d2fb31aeab service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Received unexpected event network-vif-plugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc for instance with vm_state rescued and task_state unrescuing.
Nov 06 13:23:25 user nova-compute[74821]: DEBUG nova.compute.manager [req-6757c091-60ff-4a2e-bad5-0be4c922252f req-07af94a5-06ba-4887-9092-c6d2fb31aeab service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Received event network-vif-plugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:23:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6757c091-60ff-4a2e-bad5-0be4c922252f req-07af94a5-06ba-4887-9092-c6d2fb31aeab service nova] Acquiring lock "496f8213-4b32-4211-a354-e33a4a088848-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:23:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6757c091-60ff-4a2e-bad5-0be4c922252f req-07af94a5-06ba-4887-9092-c6d2fb31aeab service nova] Lock "496f8213-4b32-4211-a354-e33a4a088848-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:23:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6757c091-60ff-4a2e-bad5-0be4c922252f req-07af94a5-06ba-4887-9092-c6d2fb31aeab service nova] Lock "496f8213-4b32-4211-a354-e33a4a088848-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:23:25 user nova-compute[74821]: DEBUG nova.compute.manager [req-6757c091-60ff-4a2e-bad5-0be4c922252f req-07af94a5-06ba-4887-9092-c6d2fb31aeab service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] No waiting events found dispatching network-vif-plugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:23:25 user nova-compute[74821]: WARNING nova.compute.manager [req-6757c091-60ff-4a2e-bad5-0be4c922252f req-07af94a5-06ba-4887-9092-c6d2fb31aeab service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Received unexpected event network-vif-plugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc for instance with vm_state rescued and task_state unrescuing.
Nov 06 13:23:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5a7a861c-bba1-44c3-807c-6748f04eb6a1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG nova.network.neutron [None req-c44dd87d-8c6e-47cb-ab35-740c84a9275b tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Updating instance_info_cache with network_info: [{"id": "b5020053-395f-4341-99be-d522ebb938c7", "address": "fa:16:3e:d4:3e:f8", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5020053-39", "ovs_interfaceid": "b5020053-395f-4341-99be-d522ebb938c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c44dd87d-8c6e-47cb-ab35-740c84a9275b tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Releasing lock "refresh_cache-61beb251-4345-44e6-a176-5c14c99c9a52" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG nova.objects.instance [None req-c44dd87d-8c6e-47cb-ab35-740c84a9275b tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lazy-loading 'flavor' on Instance uuid 61beb251-4345-44e6-a176-5c14c99c9a52 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ktZqSKLl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:23:26 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:23:26 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:23:26 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:23:26 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:23:26 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:23:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4458982-d2b6-45fd-aedf-459291713f2c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:23:26 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f20699-e7d8-4b8a-8072-59f7b5ceb8ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a] added
Nov 06 13:23:26 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[595cb869-040c-44d4-8757-32ea9863c656]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb851cb-0747-4c5b-93df-0bbd4faba23b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ktZqSKLl {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ktZqSKLl" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d6dfa6-409c-438e-8d53-f28f960e06d1]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ktZqSKLl'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f51576-c4ae-4a9d-bbed-f19513a0e02d]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d04a9d-a6e8-4881-92ce-df923798a481]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:23:26 user nova-compute[74821]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:23:26 user nova-compute[74821]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)
Nov 06 13:23:26 user nova-compute[74821]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)
Nov 06 13:23:26 user nova-compute[74821]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e (non-flash)
Nov 06 13:23:26 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:23:26 user nova-compute[74821]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:23:26 user nova-compute[74821]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)
Nov 06 13:23:26 user nova-compute[74821]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)
Nov 06 13:23:26 user nova-compute[74821]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e (non-flash)
Nov 06 13:23:26 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG nova.compute.manager [req-f6cc51ca-f63e-41b3-9199-1c9eef2dd365 req-4e8dd597-6efa-49fa-a5e6-c3842e246244 service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received event network-vif-unplugged-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f6cc51ca-f63e-41b3-9199-1c9eef2dd365 req-4e8dd597-6efa-49fa-a5e6-c3842e246244 service nova] Acquiring lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f6cc51ca-f63e-41b3-9199-1c9eef2dd365 req-4e8dd597-6efa-49fa-a5e6-c3842e246244 service nova] Lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f6cc51ca-f63e-41b3-9199-1c9eef2dd365 req-4e8dd597-6efa-49fa-a5e6-c3842e246244 service nova] Lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG nova.compute.manager [req-f6cc51ca-f63e-41b3-9199-1c9eef2dd365 req-4e8dd597-6efa-49fa-a5e6-c3842e246244 service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] No waiting events found dispatching network-vif-unplugged-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:23:26 user nova-compute[74821]: WARNING nova.compute.manager [req-f6cc51ca-f63e-41b3-9199-1c9eef2dd365 req-4e8dd597-6efa-49fa-a5e6-c3842e246244 service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received unexpected event network-vif-unplugged-b5020053-395f-4341-99be-d522ebb938c7 for instance with vm_state rescued and task_state unrescuing.
Nov 06 13:23:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1edcfeaf-a705-4e03-8bd1-627dce62877c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a, portal: 172.16.0.220,3260]
Nov 06 13:23:26 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a, portal: 172.16.0.220,3260] successful.
Nov 06 13:23:26 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a09b520-d33c-4ee1-aacf-fe9b8a48d497]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb413f8-f300-419f-addb-f14ada921963]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:23:26 user nova-compute[74821]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:23:26 user nova-compute[74821]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)
Nov 06 13:23:26 user nova-compute[74821]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)
Nov 06 13:23:26 user nova-compute[74821]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e (non-flash)
Nov 06 13:23:26 user nova-compute[74821]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a (non-flash)
Nov 06 13:23:26 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:23:26 user nova-compute[74821]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:23:26 user nova-compute[74821]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)
Nov 06 13:23:26 user nova-compute[74821]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)
Nov 06 13:23:26 user nova-compute[74821]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e (non-flash)
Nov 06 13:23:26 user nova-compute[74821]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a (non-flash)
Nov 06 13:23:26 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] HCTL ('38', '-', '-', 0) found on session 23 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:23:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.033s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:27 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b8066d-fbd0-48e1-bb9d-49f6cae03439]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:23:27 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Searching for a device in session 23 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:23:27 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ktZqSKLl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:23:27 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Instance destroyed successfully.
Nov 06 13:23:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-61a9198c-fae3-4f7d-af07-84fb48efb431 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Acquiring lock "6a895162-eec9-4e5f-a7d3-bd36155da4b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:23:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-61a9198c-fae3-4f7d-af07-84fb48efb431 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "6a895162-eec9-4e5f-a7d3-bd36155da4b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:23:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-61a9198c-fae3-4f7d-af07-84fb48efb431 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Acquiring lock "6a895162-eec9-4e5f-a7d3-bd36155da4b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:23:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-61a9198c-fae3-4f7d-af07-84fb48efb431 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "6a895162-eec9-4e5f-a7d3-bd36155da4b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:23:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-61a9198c-fae3-4f7d-af07-84fb48efb431 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "6a895162-eec9-4e5f-a7d3-bd36155da4b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:23:27 user nova-compute[74821]: INFO nova.compute.manager [None req-61a9198c-fae3-4f7d-af07-84fb48efb431 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Terminating instance
Nov 06 13:23:27 user nova-compute[74821]: DEBUG nova.compute.manager [None req-61a9198c-fae3-4f7d-af07-84fb48efb431 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:23:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:27 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '26361646364396238', 'path': '/dev/sdg'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361646364396238', 'path': '/dev/sdg'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG nova.objects.instance [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lazy-loading 'flavor' on Instance uuid 5a07f64b-5b12-4e7d-a041-ad591141aa17 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 13:23:28 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:23:28 user nova-compute[74821]:   <source dev="/dev/sdg"/>
Nov 06 13:23:28 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:23:28 user nova-compute[74821]:   <serial>b42dbce4-83ea-498c-abcf-86517f54ae3a</serial>
Nov 06 13:23:28 user nova-compute[74821]: </disk>
Nov 06 13:23:28 user nova-compute[74821]:  {{(pid=74821) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 13:23:28 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Instance destroyed successfully.
Nov 06 13:23:28 user nova-compute[74821]: DEBUG nova.objects.instance [None req-61a9198c-fae3-4f7d-af07-84fb48efb431 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lazy-loading 'resources' on Instance uuid 6a895162-eec9-4e5f-a7d3-bd36155da4b8 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-61a9198c-fae3-4f7d-af07-84fb48efb431 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:20:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-773710014',display_name='tempest-VolumesAdminNegativeTest-server-773710014',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-773710014',id=26,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:21:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc877e77ae92437f8ae2f5e4d9b65947',ramdisk_id='',reservation_id='r-a7t3j59l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-610056100',owner_user_name='tempest-VolumesAdminNegativeTest-610056100-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:21:07Z,user_data=None,user_id='d0b7addf6de74979a206dfccac04f475',uuid=6a895162-eec9-4e5f-a7d3-bd36155da4b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7d3274f-f84f-4e54-bd58-12ccd3e3aabc", "address": "fa:16:3e:f3:db:11", "network": {"id": "221da9ed-3df1-4f6c-91b0-ec4117f186f9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-999229259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc877e77ae92437f8ae2f5e4d9b65947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7d3274f-f8", "ovs_interfaceid": "c7d3274f-f84f-4e54-bd58-12ccd3e3aabc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-61a9198c-fae3-4f7d-af07-84fb48efb431 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Converting VIF {"id": "c7d3274f-f84f-4e54-bd58-12ccd3e3aabc", "address": "fa:16:3e:f3:db:11", "network": {"id": "221da9ed-3df1-4f6c-91b0-ec4117f186f9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-999229259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc877e77ae92437f8ae2f5e4d9b65947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7d3274f-f8", "ovs_interfaceid": "c7d3274f-f84f-4e54-bd58-12ccd3e3aabc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-61a9198c-fae3-4f7d-af07-84fb48efb431 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:db:11,bridge_name='br-int',has_traffic_filtering=True,id=c7d3274f-f84f-4e54-bd58-12ccd3e3aabc,network=Network(221da9ed-3df1-4f6c-91b0-ec4117f186f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7d3274f-f8') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG os_vif [None req-61a9198c-fae3-4f7d-af07-84fb48efb431 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:db:11,bridge_name='br-int',has_traffic_filtering=True,id=c7d3274f-f84f-4e54-bd58-12ccd3e3aabc,network=Network(221da9ed-3df1-4f6c-91b0-ec4117f186f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7d3274f-f8') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7d3274f-f8, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a8fca32d-ecca-4817-a141-98c1bfc93dbc) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:28 user nova-compute[74821]: INFO os_vif [None req-61a9198c-fae3-4f7d-af07-84fb48efb431 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:db:11,bridge_name='br-int',has_traffic_filtering=True,id=c7d3274f-f84f-4e54-bd58-12ccd3e3aabc,network=Network(221da9ed-3df1-4f6c-91b0-ec4117f186f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7d3274f-f8')
Nov 06 13:23:28 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-61a9198c-fae3-4f7d-af07-84fb48efb431 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Deleting instance files /opt/stack/data/nova/instances/6a895162-eec9-4e5f-a7d3-bd36155da4b8_del
Nov 06 13:23:28 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-61a9198c-fae3-4f7d-af07-84fb48efb431 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Deletion of /opt/stack/data/nova/instances/6a895162-eec9-4e5f-a7d3-bd36155da4b8_del complete
Nov 06 13:23:28 user nova-compute[74821]: INFO nova.compute.manager [None req-61a9198c-fae3-4f7d-af07-84fb48efb431 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Took 1.10 seconds to destroy the instance on the hypervisor.
Nov 06 13:23:28 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-61a9198c-fae3-4f7d-af07-84fb48efb431 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG nova.compute.manager [req-1271e784-b931-48cc-adc5-08b038541359 req-ea671a25-8760-4b90-9bcb-128d709f19ea service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received event network-vif-plugged-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1271e784-b931-48cc-adc5-08b038541359 req-ea671a25-8760-4b90-9bcb-128d709f19ea service nova] Acquiring lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1271e784-b931-48cc-adc5-08b038541359 req-ea671a25-8760-4b90-9bcb-128d709f19ea service nova] Lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1271e784-b931-48cc-adc5-08b038541359 req-ea671a25-8760-4b90-9bcb-128d709f19ea service nova] Lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG nova.compute.manager [req-1271e784-b931-48cc-adc5-08b038541359 req-ea671a25-8760-4b90-9bcb-128d709f19ea service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] No waiting events found dispatching network-vif-plugged-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:23:28 user nova-compute[74821]: WARNING nova.compute.manager [req-1271e784-b931-48cc-adc5-08b038541359 req-ea671a25-8760-4b90-9bcb-128d709f19ea service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received unexpected event network-vif-plugged-b5020053-395f-4341-99be-d522ebb938c7 for instance with vm_state rescued and task_state unrescuing.
Nov 06 13:23:28 user nova-compute[74821]: DEBUG nova.compute.manager [req-1271e784-b931-48cc-adc5-08b038541359 req-ea671a25-8760-4b90-9bcb-128d709f19ea service nova] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Received event network-vif-unplugged-c7d3274f-f84f-4e54-bd58-12ccd3e3aabc {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1271e784-b931-48cc-adc5-08b038541359 req-ea671a25-8760-4b90-9bcb-128d709f19ea service nova] Acquiring lock "6a895162-eec9-4e5f-a7d3-bd36155da4b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1271e784-b931-48cc-adc5-08b038541359 req-ea671a25-8760-4b90-9bcb-128d709f19ea service nova] Lock "6a895162-eec9-4e5f-a7d3-bd36155da4b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1271e784-b931-48cc-adc5-08b038541359 req-ea671a25-8760-4b90-9bcb-128d709f19ea service nova] Lock "6a895162-eec9-4e5f-a7d3-bd36155da4b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG nova.compute.manager [req-1271e784-b931-48cc-adc5-08b038541359 req-ea671a25-8760-4b90-9bcb-128d709f19ea service nova] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] No waiting events found dispatching network-vif-unplugged-c7d3274f-f84f-4e54-bd58-12ccd3e3aabc {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG nova.compute.manager [req-1271e784-b931-48cc-adc5-08b038541359 req-ea671a25-8760-4b90-9bcb-128d709f19ea service nova] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Received event network-vif-unplugged-c7d3274f-f84f-4e54-bd58-12ccd3e3aabc for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG nova.compute.manager [req-1271e784-b931-48cc-adc5-08b038541359 req-ea671a25-8760-4b90-9bcb-128d709f19ea service nova] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Received event network-vif-plugged-c7d3274f-f84f-4e54-bd58-12ccd3e3aabc {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1271e784-b931-48cc-adc5-08b038541359 req-ea671a25-8760-4b90-9bcb-128d709f19ea service nova] Acquiring lock "6a895162-eec9-4e5f-a7d3-bd36155da4b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1271e784-b931-48cc-adc5-08b038541359 req-ea671a25-8760-4b90-9bcb-128d709f19ea service nova] Lock "6a895162-eec9-4e5f-a7d3-bd36155da4b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1271e784-b931-48cc-adc5-08b038541359 req-ea671a25-8760-4b90-9bcb-128d709f19ea service nova] Lock "6a895162-eec9-4e5f-a7d3-bd36155da4b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG nova.compute.manager [req-1271e784-b931-48cc-adc5-08b038541359 req-ea671a25-8760-4b90-9bcb-128d709f19ea service nova] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] No waiting events found dispatching network-vif-plugged-c7d3274f-f84f-4e54-bd58-12ccd3e3aabc {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:23:28 user nova-compute[74821]: WARNING nova.compute.manager [req-1271e784-b931-48cc-adc5-08b038541359 req-ea671a25-8760-4b90-9bcb-128d709f19ea service nova] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Received unexpected event network-vif-plugged-c7d3274f-f84f-4e54-bd58-12ccd3e3aabc for instance with vm_state active and task_state deleting.
Nov 06 13:23:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:29 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:23:29 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Took 0.45 seconds to deallocate network for instance.
Nov 06 13:23:29 user nova-compute[74821]: DEBUG nova.compute.manager [req-1deaae25-24fc-4373-8953-d14083be1ff4 req-38e3f5bb-5bdf-4037-bb03-0ecaa2180ea7 service nova] [instance: 6a895162-eec9-4e5f-a7d3-bd36155da4b8] Received event network-vif-deleted-c7d3274f-f84f-4e54-bd58-12ccd3e3aabc {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:23:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-61a9198c-fae3-4f7d-af07-84fb48efb431 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:23:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-61a9198c-fae3-4f7d-af07-84fb48efb431 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:23:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:23:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:23:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] No VIF found with MAC fa:16:3e:30:ef:48, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:23:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a3fb11d8-f84d-4c9d-a667-23081b067add tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 43.564s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:23:29 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-61a9198c-fae3-4f7d-af07-84fb48efb431 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:23:29 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-61a9198c-fae3-4f7d-af07-84fb48efb431 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:23:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-61a9198c-fae3-4f7d-af07-84fb48efb431 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.521s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:23:29 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-61a9198c-fae3-4f7d-af07-84fb48efb431 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Deleted allocations for instance 6a895162-eec9-4e5f-a7d3-bd36155da4b8
Nov 06 13:23:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-61a9198c-fae3-4f7d-af07-84fb48efb431 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "6a895162-eec9-4e5f-a7d3-bd36155da4b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.274s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:23:30 user nova-compute[74821]: INFO nova.compute.manager [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Rescuing
Nov 06 13:23:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Acquiring lock "refresh_cache-5a07f64b-5b12-4e7d-a041-ad591141aa17" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:23:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Acquired lock "refresh_cache-5a07f64b-5b12-4e7d-a041-ad591141aa17" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:23:30 user nova-compute[74821]: DEBUG nova.network.neutron [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:23:30 user nova-compute[74821]: DEBUG nova.network.neutron [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Updating instance_info_cache with network_info: [{"id": "db18095e-82aa-407a-b43f-5f060b8c64ec", "address": "fa:16:3e:30:ef:48", "network": {"id": "79eddc13-4e87-497c-af1f-ce215f23e831", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412663699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d867544bce424f90bcb0403e953f59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb18095e-82", "ovs_interfaceid": "db18095e-82aa-407a-b43f-5f060b8c64ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:23:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Releasing lock "refresh_cache-5a07f64b-5b12-4e7d-a041-ad591141aa17" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:23:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:31 user nova-compute[74821]: DEBUG nova.compute.manager [req-5cf10740-62b2-4312-be00-ed76b1d0b326 req-99cc028f-0c55-4dbb-bcb8-07bf9cc70dd4 service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received event network-vif-plugged-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:23:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5cf10740-62b2-4312-be00-ed76b1d0b326 req-99cc028f-0c55-4dbb-bcb8-07bf9cc70dd4 service nova] Acquiring lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:23:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5cf10740-62b2-4312-be00-ed76b1d0b326 req-99cc028f-0c55-4dbb-bcb8-07bf9cc70dd4 service nova] Lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:23:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5cf10740-62b2-4312-be00-ed76b1d0b326 req-99cc028f-0c55-4dbb-bcb8-07bf9cc70dd4 service nova] Lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:23:31 user nova-compute[74821]: DEBUG nova.compute.manager [req-5cf10740-62b2-4312-be00-ed76b1d0b326 req-99cc028f-0c55-4dbb-bcb8-07bf9cc70dd4 service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] No waiting events found dispatching network-vif-plugged-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:23:31 user nova-compute[74821]: WARNING nova.compute.manager [req-5cf10740-62b2-4312-be00-ed76b1d0b326 req-99cc028f-0c55-4dbb-bcb8-07bf9cc70dd4 service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received unexpected event network-vif-plugged-b5020053-395f-4341-99be-d522ebb938c7 for instance with vm_state rescued and task_state unrescuing.
Nov 06 13:23:31 user nova-compute[74821]: DEBUG nova.compute.manager [req-5cf10740-62b2-4312-be00-ed76b1d0b326 req-99cc028f-0c55-4dbb-bcb8-07bf9cc70dd4 service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received event network-vif-plugged-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:23:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5cf10740-62b2-4312-be00-ed76b1d0b326 req-99cc028f-0c55-4dbb-bcb8-07bf9cc70dd4 service nova] Acquiring lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:23:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5cf10740-62b2-4312-be00-ed76b1d0b326 req-99cc028f-0c55-4dbb-bcb8-07bf9cc70dd4 service nova] Lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:23:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5cf10740-62b2-4312-be00-ed76b1d0b326 req-99cc028f-0c55-4dbb-bcb8-07bf9cc70dd4 service nova] Lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:23:31 user nova-compute[74821]: DEBUG nova.compute.manager [req-5cf10740-62b2-4312-be00-ed76b1d0b326 req-99cc028f-0c55-4dbb-bcb8-07bf9cc70dd4 service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] No waiting events found dispatching network-vif-plugged-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:23:31 user nova-compute[74821]: WARNING nova.compute.manager [req-5cf10740-62b2-4312-be00-ed76b1d0b326 req-99cc028f-0c55-4dbb-bcb8-07bf9cc70dd4 service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received unexpected event network-vif-plugged-b5020053-395f-4341-99be-d522ebb938c7 for instance with vm_state rescued and task_state unrescuing.
Nov 06 13:23:31 user nova-compute[74821]: DEBUG nova.compute.manager [req-4b93e92c-0a07-4cc1-b860-e48acaffea58 req-ab54f748-e583-44ee-8f8e-fdc287a92a28 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received event network-vif-unplugged-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:23:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4b93e92c-0a07-4cc1-b860-e48acaffea58 req-ab54f748-e583-44ee-8f8e-fdc287a92a28 service nova] Acquiring lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:23:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4b93e92c-0a07-4cc1-b860-e48acaffea58 req-ab54f748-e583-44ee-8f8e-fdc287a92a28 service nova] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:23:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4b93e92c-0a07-4cc1-b860-e48acaffea58 req-ab54f748-e583-44ee-8f8e-fdc287a92a28 service nova] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:23:31 user nova-compute[74821]: DEBUG nova.compute.manager [req-4b93e92c-0a07-4cc1-b860-e48acaffea58 req-ab54f748-e583-44ee-8f8e-fdc287a92a28 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] No waiting events found dispatching network-vif-unplugged-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:23:31 user nova-compute[74821]: WARNING nova.compute.manager [req-4b93e92c-0a07-4cc1-b860-e48acaffea58 req-ab54f748-e583-44ee-8f8e-fdc287a92a28 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received unexpected event network-vif-unplugged-db18095e-82aa-407a-b43f-5f060b8c64ec for instance with vm_state active and task_state rescuing.
Nov 06 13:23:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Acquiring lock "cc3c1518-c493-41b0-a748-a0ed933c2b1e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:23:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lock "cc3c1518-c493-41b0-a748-a0ed933c2b1e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:23:31 user nova-compute[74821]: INFO nova.compute.manager [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Detaching volume 4f5f31c1-284d-4554-ac80-322ddb4146d5
Nov 06 13:23:31 user nova-compute[74821]: INFO nova.virt.block_device [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Attempting to driver detach volume 4f5f31c1-284d-4554-ac80-322ddb4146d5 from mountpoint /dev/vdb
Nov 06 13:23:31 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Attempting to detach device vdb from instance cc3c1518-c493-41b0-a748-a0ed933c2b1e from the persistent domain config. {{(pid=74821) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 13:23:31 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:23:31 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:23:31 user nova-compute[74821]:   <source dev="/dev/sdc"/>
Nov 06 13:23:31 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:23:31 user nova-compute[74821]:   <serial>4f5f31c1-284d-4554-ac80-322ddb4146d5</serial>
Nov 06 13:23:31 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:23:31 user nova-compute[74821]: </disk>
Nov 06 13:23:31 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:23:31 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Successfully detached device vdb from instance cc3c1518-c493-41b0-a748-a0ed933c2b1e from the persistent domain config.
Nov 06 13:23:31 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cc3c1518-c493-41b0-a748-a0ed933c2b1e from the live domain config. {{(pid=74821) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 13:23:31 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:23:31 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:23:31 user nova-compute[74821]:   <source dev="/dev/sdc"/>
Nov 06 13:23:31 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:23:31 user nova-compute[74821]:   <serial>4f5f31c1-284d-4554-ac80-322ddb4146d5</serial>
Nov 06 13:23:31 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:23:31 user nova-compute[74821]: </disk>
Nov 06 13:23:31 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:23:31 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:31 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:31 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:31 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:31 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:31 user nova-compute[74821]: DEBUG nova.compute.manager [None req-c44dd87d-8c6e-47cb-ab35-740c84a9275b tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:23:31 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:23:31 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cc3c1518-c493-41b0-a748-a0ed933c2b1e {{(pid=74821) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 13:23:32 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Instance destroyed successfully.
Nov 06 13:23:32 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Attempting a stable device rescue
Nov 06 13:23:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74821) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 06 13:23:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Instance directory exists: not creating {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 06 13:23:32 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Creating image(s)
Nov 06 13:23:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:23:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "/opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:23:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "/opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:23:32 user nova-compute[74821]: DEBUG nova.objects.instance [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5a07f64b-5b12-4e7d-a041-ad591141aa17 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:23:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Acquiring lock "ad36bdff2a6f608e0a3fed7e52e52a3f61a95484" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:23:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "ad36bdff2a6f608e0a3fed7e52e52a3f61a95484" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:23:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad36bdff2a6f608e0a3fed7e52e52a3f61a95484.part --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:33 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:23:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:33 user nova-compute[74821]: DEBUG nova.compute.manager [req-0a02b242-5399-4ee8-8652-8fd307a11cb8 req-2129093d-93e9-414d-8d98-a0e2663e1911 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received event network-vif-plugged-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:23:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0a02b242-5399-4ee8-8652-8fd307a11cb8 req-2129093d-93e9-414d-8d98-a0e2663e1911 service nova] Acquiring lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:23:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0a02b242-5399-4ee8-8652-8fd307a11cb8 req-2129093d-93e9-414d-8d98-a0e2663e1911 service nova] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:23:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0a02b242-5399-4ee8-8652-8fd307a11cb8 req-2129093d-93e9-414d-8d98-a0e2663e1911 service nova] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:23:33 user nova-compute[74821]: DEBUG nova.compute.manager [req-0a02b242-5399-4ee8-8652-8fd307a11cb8 req-2129093d-93e9-414d-8d98-a0e2663e1911 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] No waiting events found dispatching network-vif-plugged-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:23:33 user nova-compute[74821]: WARNING nova.compute.manager [req-0a02b242-5399-4ee8-8652-8fd307a11cb8 req-2129093d-93e9-414d-8d98-a0e2663e1911 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received unexpected event network-vif-plugged-db18095e-82aa-407a-b43f-5f060b8c64ec for instance with vm_state active and task_state rescuing.
Nov 06 13:23:33 user nova-compute[74821]: DEBUG nova.compute.manager [req-0a02b242-5399-4ee8-8652-8fd307a11cb8 req-2129093d-93e9-414d-8d98-a0e2663e1911 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received event network-vif-plugged-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:23:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0a02b242-5399-4ee8-8652-8fd307a11cb8 req-2129093d-93e9-414d-8d98-a0e2663e1911 service nova] Acquiring lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:23:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0a02b242-5399-4ee8-8652-8fd307a11cb8 req-2129093d-93e9-414d-8d98-a0e2663e1911 service nova] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:23:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0a02b242-5399-4ee8-8652-8fd307a11cb8 req-2129093d-93e9-414d-8d98-a0e2663e1911 service nova] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:23:33 user nova-compute[74821]: DEBUG nova.compute.manager [req-0a02b242-5399-4ee8-8652-8fd307a11cb8 req-2129093d-93e9-414d-8d98-a0e2663e1911 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] No waiting events found dispatching network-vif-plugged-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:23:33 user nova-compute[74821]: WARNING nova.compute.manager [req-0a02b242-5399-4ee8-8652-8fd307a11cb8 req-2129093d-93e9-414d-8d98-a0e2663e1911 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received unexpected event network-vif-plugged-db18095e-82aa-407a-b43f-5f060b8c64ec for instance with vm_state active and task_state rescuing.
Nov 06 13:23:33 user nova-compute[74821]: DEBUG nova.compute.manager [req-0a02b242-5399-4ee8-8652-8fd307a11cb8 req-2129093d-93e9-414d-8d98-a0e2663e1911 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received event network-vif-plugged-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:23:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0a02b242-5399-4ee8-8652-8fd307a11cb8 req-2129093d-93e9-414d-8d98-a0e2663e1911 service nova] Acquiring lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:23:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0a02b242-5399-4ee8-8652-8fd307a11cb8 req-2129093d-93e9-414d-8d98-a0e2663e1911 service nova] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:23:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0a02b242-5399-4ee8-8652-8fd307a11cb8 req-2129093d-93e9-414d-8d98-a0e2663e1911 service nova] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:23:33 user nova-compute[74821]: DEBUG nova.compute.manager [req-0a02b242-5399-4ee8-8652-8fd307a11cb8 req-2129093d-93e9-414d-8d98-a0e2663e1911 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] No waiting events found dispatching network-vif-plugged-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:23:33 user nova-compute[74821]: WARNING nova.compute.manager [req-0a02b242-5399-4ee8-8652-8fd307a11cb8 req-2129093d-93e9-414d-8d98-a0e2663e1911 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received unexpected event network-vif-plugged-db18095e-82aa-407a-b43f-5f060b8c64ec for instance with vm_state active and task_state rescuing.
Nov 06 13:23:33 user nova-compute[74821]: DEBUG nova.compute.manager [req-0a02b242-5399-4ee8-8652-8fd307a11cb8 req-2129093d-93e9-414d-8d98-a0e2663e1911 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received event network-vif-unplugged-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:23:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0a02b242-5399-4ee8-8652-8fd307a11cb8 req-2129093d-93e9-414d-8d98-a0e2663e1911 service nova] Acquiring lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:23:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0a02b242-5399-4ee8-8652-8fd307a11cb8 req-2129093d-93e9-414d-8d98-a0e2663e1911 service nova] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:23:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0a02b242-5399-4ee8-8652-8fd307a11cb8 req-2129093d-93e9-414d-8d98-a0e2663e1911 service nova] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:23:33 user nova-compute[74821]: DEBUG nova.compute.manager [req-0a02b242-5399-4ee8-8652-8fd307a11cb8 req-2129093d-93e9-414d-8d98-a0e2663e1911 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] No waiting events found dispatching network-vif-unplugged-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:23:33 user nova-compute[74821]: WARNING nova.compute.manager [req-0a02b242-5399-4ee8-8652-8fd307a11cb8 req-2129093d-93e9-414d-8d98-a0e2663e1911 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received unexpected event network-vif-unplugged-db18095e-82aa-407a-b43f-5f060b8c64ec for instance with vm_state active and task_state rescuing.
Nov 06 13:23:33 user nova-compute[74821]: DEBUG nova.compute.manager [req-0a02b242-5399-4ee8-8652-8fd307a11cb8 req-2129093d-93e9-414d-8d98-a0e2663e1911 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received event network-vif-plugged-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:23:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0a02b242-5399-4ee8-8652-8fd307a11cb8 req-2129093d-93e9-414d-8d98-a0e2663e1911 service nova] Acquiring lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:23:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0a02b242-5399-4ee8-8652-8fd307a11cb8 req-2129093d-93e9-414d-8d98-a0e2663e1911 service nova] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:23:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0a02b242-5399-4ee8-8652-8fd307a11cb8 req-2129093d-93e9-414d-8d98-a0e2663e1911 service nova] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:23:33 user nova-compute[74821]: DEBUG nova.compute.manager [req-0a02b242-5399-4ee8-8652-8fd307a11cb8 req-2129093d-93e9-414d-8d98-a0e2663e1911 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] No waiting events found dispatching network-vif-plugged-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:23:33 user nova-compute[74821]: WARNING nova.compute.manager [req-0a02b242-5399-4ee8-8652-8fd307a11cb8 req-2129093d-93e9-414d-8d98-a0e2663e1911 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received unexpected event network-vif-plugged-db18095e-82aa-407a-b43f-5f060b8c64ec for instance with vm_state active and task_state rescuing.
Nov 06 13:23:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad36bdff2a6f608e0a3fed7e52e52a3f61a95484.part --force-share --output=json" returned: 0 in 0.190s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:33 user nova-compute[74821]: DEBUG nova.virt.images [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] 19d54c0c-8110-4956-916f-2f7639bc4477 was qcow2, converting to raw {{(pid=74821) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 13:23:33 user nova-compute[74821]: DEBUG nova.privsep.utils [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74821) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 13:23:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ad36bdff2a6f608e0a3fed7e52e52a3f61a95484.part /opt/stack/data/nova/instances/_base/ad36bdff2a6f608e0a3fed7e52e52a3f61a95484.converted {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:33 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ad36bdff2a6f608e0a3fed7e52e52a3f61a95484.part /opt/stack/data/nova/instances/_base/ad36bdff2a6f608e0a3fed7e52e52a3f61a95484.converted" returned: 0 in 0.642s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad36bdff2a6f608e0a3fed7e52e52a3f61a95484.converted --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad36bdff2a6f608e0a3fed7e52e52a3f61a95484.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "ad36bdff2a6f608e0a3fed7e52e52a3f61a95484" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.535s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Acquiring lock "ad36bdff2a6f608e0a3fed7e52e52a3f61a95484" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "ad36bdff2a6f608e0a3fed7e52e52a3f61a95484" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad36bdff2a6f608e0a3fed7e52e52a3f61a95484 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad36bdff2a6f608e0a3fed7e52e52a3f61a95484 --force-share --output=json" returned: 0 in 0.191s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad36bdff2a6f608e0a3fed7e52e52a3f61a95484,backing_fmt=raw /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk.rescue {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad36bdff2a6f608e0a3fed7e52e52a3f61a95484,backing_fmt=raw /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk.rescue" returned: 0 in 0.056s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "ad36bdff2a6f608e0a3fed7e52e52a3f61a95484" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG nova.objects.instance [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lazy-loading 'migration_context' on Instance uuid 5a07f64b-5b12-4e7d-a041-ad591141aa17 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG nova.objects.base [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Object Instance<5a07f64b-5b12-4e7d-a041-ad591141aa17> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Start _get_guest_xml network_info=[{"id": "db18095e-82aa-407a-b43f-5f060b8c64ec", "address": "fa:16:3e:30:ef:48", "network": {"id": "79eddc13-4e87-497c-af1f-ce215f23e831", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412663699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1412663699-network", "vif_mac": "fa:16:3e:30:ef:48"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d867544bce424f90bcb0403e953f59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb18095e-82", "ovs_interfaceid": "db18095e-82aa-407a-b43f-5f060b8c64ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '19d54c0c-8110-4956-916f-2f7639bc4477', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ktZqSKLl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '5a07f64b-5b12-4e7d-a041-ad591141aa17', 'attached_at': '', 'detached_at': '', 'volume_id': 'b42dbce4-83ea-498c-abcf-86517f54ae3a', 'serial': 'b42dbce4-83ea-498c-abcf-86517f54ae3a'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '0532e8ec-c6fa-4f94-8047-85c8b2e3ca8a', 'volume_type': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG nova.objects.instance [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lazy-loading 'resources' on Instance uuid 5a07f64b-5b12-4e7d-a041-ad591141aa17 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG nova.objects.base [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Object Instance<5a07f64b-5b12-4e7d-a041-ad591141aa17> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG nova.objects.instance [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lazy-loading 'numa_topology' on Instance uuid 5a07f64b-5b12-4e7d-a041-ad591141aa17 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG nova.objects.base [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Object Instance<5a07f64b-5b12-4e7d-a041-ad591141aa17> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:23:34 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:23:34 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:23:34 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:23:34 user nova-compute[74821]: DEBUG nova.objects.instance [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5a07f64b-5b12-4e7d-a041-ad591141aa17 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG nova.objects.base [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Object Instance<5a07f64b-5b12-4e7d-a041-ad591141aa17> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ktZqSKLl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:23:35 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:23:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:23:35 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:23:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:23:35 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:23:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fab7c80-60aa-42ff-8633-ad2726f76828]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ktZqSKLl\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 06 13:23:35 user nova-compute[74821]: node.name = iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a
Nov 06 13:23:35 user nova-compute[74821]: node.tpgt = -1
Nov 06 13:23:35 user nova-compute[74821]: node.startup = automatic
Nov 06 13:23:35 user nova-compute[74821]: node.leading_login = No
Nov 06 13:23:35 user nova-compute[74821]: iface.iscsi_ifacename = default
Nov 06 13:23:35 user nova-compute[74821]: iface.net_ifacename = <empty>
Nov 06 13:23:35 user nova-compute[74821]: iface.ipaddress = <empty>
Nov 06 13:23:35 user nova-compute[74821]: iface.prefix_len = 0
Nov 06 13:23:35 user nova-compute[74821]: iface.hwaddress = <empty>
Nov 06 13:23:35 user nova-compute[74821]: iface.transport_name = tcp
Nov 06 13:23:35 user nova-compute[74821]: iface.initiatorname = <empty>
Nov 06 13:23:35 user nova-compute[74821]: iface.state = <empty>
Nov 06 13:23:35 user nova-compute[74821]: iface.vlan_id = 0
Nov 06 13:23:35 user nova-compute[74821]: iface.vlan_priority = 0
Nov 06 13:23:35 user nova-compute[74821]: iface.vlan_state = <empty>
Nov 06 13:23:35 user nova-compute[74821]: iface.iface_num = 0
Nov 06 13:23:35 user nova-compute[74821]: iface.mtu = 0
Nov 06 13:23:35 user nova-compute[74821]: iface.port = 0
Nov 06 13:23:35 user nova-compute[74821]: iface.bootproto = <empty>
Nov 06 13:23:35 user nova-compute[74821]: iface.subnet_mask = <empty>
Nov 06 13:23:35 user nova-compute[74821]: iface.gateway = <empty>
Nov 06 13:23:35 user nova-compute[74821]: iface.dhcp_alt_client_id_state = <empty>
Nov 06 13:23:35 user nova-compute[74821]: iface.dhcp_alt_client_id = <empty>
Nov 06 13:23:35 user nova-compute[74821]: iface.dhcp_dns = <empty>
Nov 06 13:23:35 user nova-compute[74821]: iface.dhcp_learn_iqn = <empty>
Nov 06 13:23:35 user nova-compute[74821]: iface.dhcp_req_vendor_id_state = <empty>
Nov 06 13:23:35 user nova-compute[74821]: iface.dhcp_vendor_id_state = <empty>
Nov 06 13:23:35 user nova-compute[74821]: iface.dhcp_vendor_id = <empty>
Nov 06 13:23:35 user nova-compute[74821]: iface.dhcp_slp_da = <empty>
Nov 06 13:23:35 user nova-compute[74821]: iface.fragmentation = <empty>
Nov 06 13:23:35 user nova-compute[74821]: iface.gratuitous_arp = <empty>
Nov 06 13:23:35 user nova-compute[74821]: iface.incoming_forwarding = <empty>
Nov 06 13:23:35 user nova-compute[74821]: iface.tos_state = <empty>
Nov 06 13:23:35 user nova-compute[74821]: iface.tos = 0
Nov 06 13:23:35 user nova-compute[74821]: iface.ttl = 0
Nov 06 13:23:35 user nova-compute[74821]: iface.delayed_ack = <empty>
Nov 06 13:23:35 user nova-compute[74821]: iface.tcp_nagle = <empty>
Nov 06 13:23:35 user nova-compute[74821]: iface.tcp_wsf_state = <empty>
Nov 06 13:23:35 user nova-compute[74821]: iface.tcp_wsf = 0
Nov 06 13:23:35 user nova-compute[74821]: iface.tcp_timer_scale = 0
Nov 06 13:23:35 user nova-compute[74821]: iface.tcp_timestamp = <empty>
Nov 06 13:23:35 user nova-compute[74821]: iface.redirect = <empty>
Nov 06 13:23:35 user nova-compute[74821]: iface.def_task_mgmt_timeout = 0
Nov 06 13:23:35 user nova-compute[74821]: iface.header_digest = <empty>
Nov 06 13:23:35 user nova-compute[74821]: iface.data_digest = <empty>
Nov 06 13:23:35 user nova-compute[74821]: iface.immediate_data = <empty>
Nov 06 13:23:35 user nova-compute[74821]: iface.initial_r2t = <empty>
Nov 06 13:23:35 user nova-compute[74821]: iface.data_seq_inorder = <empty>
Nov 06 13:23:35 user nova-compute[74821]: iface.data_pdu_inorder = <empty>
Nov 06 13:23:35 user nova-compute[74821]: iface.erl = 0
Nov 06 13:23:35 user nova-compute[74821]: iface.max_receive_data_len = 0
Nov 06 13:23:35 user nova-compute[74821]: iface.first_burst_len = 0
Nov 06 13:23:35 user nova-compute[74821]: iface.max_outstanding_r2t = 0
Nov 06 13:23:35 user nova-compute[74821]: iface.max_burst_len = 0
Nov 06 13:23:35 user nova-compute[74821]: iface.chap_auth = <empty>
Nov 06 13:23:35 user nova-compute[74821]: iface.bidi_chap = <empty>
Nov 06 13:23:35 user nova-compute[74821]: iface.strict_login_compliance = <empty>
Nov 06 13:23:35 user nova-compute[74821]: iface.discovery_auth = <empty>
Nov 06 13:23:35 user nova-compute[74821]: iface.discovery_logout = <empty>
Nov 06 13:23:35 user nova-compute[74821]: node.discovery_address = <empty>
Nov 06 13:23:35 user nova-compute[74821]: node.discovery_port = 0
Nov 06 13:23:35 user nova-compute[74821]: node.discovery_type = static
Nov 06 13:23:35 user nova-compute[74821]: node.session.initial_cmdsn = 0
Nov 06 13:23:35 user nova-compute[74821]: node.session.initial_login_retry_max = 8
Nov 06 13:23:35 user nova-compute[74821]: node.session.xmit_thread_priority = -20
Nov 06 13:23:35 user nova-compute[74821]: node.session.cmds_max = 128
Nov 06 13:23:35 user nova-compute[74821]: node.session.queue_depth = 32
Nov 06 13:23:35 user nova-compute[74821]: node.session.nr_sessions = 1
Nov 06 13:23:35 user nova-compute[74821]: node.session.auth.authmethod = CHAP
Nov 06 13:23:35 user nova-compute[74821]: node.session.auth.username = ktZqSKLl
Nov 06 13:23:35 user nova-compute[74821]: node.session.auth.password = ***
Nov 06 13:23:35 user nova-compute[74821]: node.session.auth.username_in = <empty>
Nov 06 13:23:35 user nova-compute[74821]: node.session.auth.password_in = <empty>
Nov 06 13:23:35 user nova-compute[74821]: node.session.auth.chap_algs = MD5
Nov 06 13:23:35 user nova-compute[74821]: node.session.timeo.replacement_timeout = 120
Nov 06 13:23:35 user nova-compute[74821]: node.session.err_timeo.abort_timeout = 15
Nov 06 13:23:35 user nova-compute[74821]: node.session.err_timeo.lu_reset_timeout = 30
Nov 06 13:23:35 user nova-compute[74821]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 06 13:23:35 user nova-compute[74821]: node.session.err_timeo.host_reset_timeout = 60
Nov 06 13:23:35 user nova-compute[74821]: node.session.iscsi.FastAbort = Yes
Nov 06 13:23:35 user nova-compute[74821]: node.session.iscsi.InitialR2T = No
Nov 06 13:23:35 user nova-compute[74821]: node.session.iscsi.ImmediateData = Yes
Nov 06 13:23:35 user nova-compute[74821]: node.session.iscsi.FirstBurstLength = 262144
Nov 06 13:23:35 user nova-compute[74821]: node.session.iscsi.MaxBurstLength = 16776192
Nov 06 13:23:35 user nova-compute[74821]: node.session.iscsi.DefaultTime2Retain = 0
Nov 06 13:23:35 user nova-compute[74821]: node.session.iscsi.DefaultTime2Wait = 2
Nov 06 13:23:35 user nova-compute[74821]: node.session.iscsi.MaxConnections = 1
Nov 06 13:23:35 user nova-compute[74821]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 06 13:23:35 user nova-compute[74821]: node.session.iscsi.ERL = 0
Nov 06 13:23:35 user nova-compute[74821]: node.session.scan = manual
Nov 06 13:23:35 user nova-compute[74821]: node.session.reopen_max = 0
Nov 06 13:23:35 user nova-compute[74821]: node.conn[0].address = 172.16.0.220
Nov 06 13:23:35 user nova-compute[74821]: node.conn[0].port = 3260
Nov 06 13:23:35 user nova-compute[74821]: node.conn[0].startup = manual
Nov 06 13:23:35 user nova-compute[74821]: node.conn[0].tcp.window_size = 524288
Nov 06 13:23:35 user nova-compute[74821]: node.conn[0].tcp.type_of_service = 0
Nov 06 13:23:35 user nova-compute[74821]: node.conn[0].timeo.logout_timeout = 15
Nov 06 13:23:35 user nova-compute[74821]: node.conn[0].timeo.login_timeout = 15
Nov 06 13:23:35 user nova-compute[74821]: node.conn[0].timeo.auth_timeout = 45
Nov 06 13:23:35 user nova-compute[74821]: node.conn[0].timeo.noop_out_interval = 5
Nov 06 13:23:35 user nova-compute[74821]: node.conn[0].timeo.noop_out_timeout = 5
Nov 06 13:23:35 user nova-compute[74821]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 06 13:23:35 user nova-compute[74821]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 06 13:23:35 user nova-compute[74821]: node.conn[0].iscsi.HeaderDigest = None
Nov 06 13:23:35 user nova-compute[74821]: node.conn[0].iscsi.DataDigest = None
Nov 06 13:23:35 user nova-compute[74821]: node.conn[0].iscsi.IFMarker = No
Nov 06 13:23:35 user nova-compute[74821]: node.conn[0].iscsi.OFMarker = No
Nov 06 13:23:35 user nova-compute[74821]: # END RECORD
Nov 06 13:23:35 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5616c1-f739-4a4a-9486-856acb23b60b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-107abf1d-96da-4406-8111-ef0bc09fb3e3" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-107abf1d-96da-4406-8111-ef0bc09fb3e3" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47b3a8c-c1c5-40fd-9fec-888a4706cb4a]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ktZqSKLl {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ktZqSKLl" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6612128b-de37-4023-b4f5-07a3be35029a]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ktZqSKLl'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[148a47c2-3e65-4e74-bb47-4bb66cbc36e9]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1ae944-ed3f-4ebc-a25d-a6e2b90e2505]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:23:35 user nova-compute[74821]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:23:35 user nova-compute[74821]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)
Nov 06 13:23:35 user nova-compute[74821]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)
Nov 06 13:23:35 user nova-compute[74821]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e (non-flash)
Nov 06 13:23:35 user nova-compute[74821]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a (non-flash)
Nov 06 13:23:35 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:23:35 user nova-compute[74821]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:23:35 user nova-compute[74821]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)
Nov 06 13:23:35 user nova-compute[74821]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)
Nov 06 13:23:35 user nova-compute[74821]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e (non-flash)
Nov 06 13:23:35 user nova-compute[74821]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a (non-flash)
Nov 06 13:23:35 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.187s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] HCTL ('38', '0', '0', 0) found on session 23 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Scanning host 38 c: 0, t: 0, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db316f2-15ac-48b1-aad9-93cfe62f13c2]: (4, ('0 0 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Searching for a device in session 23 and hctl ('38', '0', '0', 0) yield: sdg {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ktZqSKLl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.212s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] <== connect_volume: return (213ms) {'type': 'block', 'scsi_wwn': '26361646364396238', 'path': '/dev/sdg'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361646364396238', 'path': '/dev/sdg'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:19:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1004493493',display_name='tempest-ServerStableDeviceRescueTest-server-1004493493',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1004493493',id=22,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBv29rmsLsLYiSk9kbTOijARa8gu+ah6i2bQrZxKfobLwcDnuJUCtjfp+YJRgwX32aeI6MDK+wE0irmaV53pFlnbi+Na7GAsfUUsSfu+9E+Izyqg0uf2ImUG12ugRFqtGw==',key_name='tempest-keypair-1601620280',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:19:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63d867544bce424f90bcb0403e953f59',ramdisk_id='',reservation_id='r-h5j27ucc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-273439640',owner_user_name='tempest-ServerStableDeviceRescueTest-273439640-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:20:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c788f2d8493b4bbab80872eba4045fb0',uuid=5a07f64b-5b12-4e7d-a041-ad591141aa17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db18095e-82aa-407a-b43f-5f060b8c64ec", "address": "fa:16:3e:30:ef:48", "network": {"id": "79eddc13-4e87-497c-af1f-ce215f23e831", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412663699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1412663699-network", "vif_mac": "fa:16:3e:30:ef:48"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d867544bce424f90bcb0403e953f59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb18095e-82", "ovs_interfaceid": "db18095e-82aa-407a-b43f-5f060b8c64ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Converting VIF {"id": "db18095e-82aa-407a-b43f-5f060b8c64ec", "address": "fa:16:3e:30:ef:48", "network": {"id": "79eddc13-4e87-497c-af1f-ce215f23e831", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412663699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1412663699-network", "vif_mac": "fa:16:3e:30:ef:48"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d867544bce424f90bcb0403e953f59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb18095e-82", "ovs_interfaceid": "db18095e-82aa-407a-b43f-5f060b8c64ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:ef:48,bridge_name='br-int',has_traffic_filtering=True,id=db18095e-82aa-407a-b43f-5f060b8c64ec,network=Network(79eddc13-4e87-497c-af1f-ce215f23e831),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb18095e-82') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG nova.objects.instance [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a07f64b-5b12-4e7d-a041-ad591141aa17 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG nova.objects.base [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Object Instance<5a07f64b-5b12-4e7d-a041-ad591141aa17> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:23:35 user nova-compute[74821]:   <uuid>5a07f64b-5b12-4e7d-a041-ad591141aa17</uuid>
Nov 06 13:23:35 user nova-compute[74821]:   <name>instance-00000016</name>
Nov 06 13:23:35 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:23:35 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:23:35 user nova-compute[74821]:   <metadata>
Nov 06 13:23:35 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:23:35 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:23:35 user nova-compute[74821]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1004493493</nova:name>
Nov 06 13:23:35 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:23:34</nova:creationTime>
Nov 06 13:23:35 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:23:35 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:23:35 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:23:35 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:23:35 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:23:35 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:23:35 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:23:35 user nova-compute[74821]:       <nova:owner>
Nov 06 13:23:35 user nova-compute[74821]:         <nova:user uuid="c788f2d8493b4bbab80872eba4045fb0">tempest-ServerStableDeviceRescueTest-273439640-project-member</nova:user>
Nov 06 13:23:35 user nova-compute[74821]:         <nova:project uuid="63d867544bce424f90bcb0403e953f59">tempest-ServerStableDeviceRescueTest-273439640</nova:project>
Nov 06 13:23:35 user nova-compute[74821]:       </nova:owner>
Nov 06 13:23:35 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:23:35 user nova-compute[74821]:       <nova:ports>
Nov 06 13:23:35 user nova-compute[74821]:         <nova:port uuid="db18095e-82aa-407a-b43f-5f060b8c64ec">
Nov 06 13:23:35 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 13:23:35 user nova-compute[74821]:         </nova:port>
Nov 06 13:23:35 user nova-compute[74821]:       </nova:ports>
Nov 06 13:23:35 user nova-compute[74821]:     </nova:instance>
Nov 06 13:23:35 user nova-compute[74821]:   </metadata>
Nov 06 13:23:35 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:23:35 user nova-compute[74821]:     <system>
Nov 06 13:23:35 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:23:35 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:23:35 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:23:35 user nova-compute[74821]:       <entry name="serial">5a07f64b-5b12-4e7d-a041-ad591141aa17</entry>
Nov 06 13:23:35 user nova-compute[74821]:       <entry name="uuid">5a07f64b-5b12-4e7d-a041-ad591141aa17</entry>
Nov 06 13:23:35 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:23:35 user nova-compute[74821]:     </system>
Nov 06 13:23:35 user nova-compute[74821]:   </sysinfo>
Nov 06 13:23:35 user nova-compute[74821]:   <os>
Nov 06 13:23:35 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:23:35 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:23:35 user nova-compute[74821]:   </os>
Nov 06 13:23:35 user nova-compute[74821]:   <features>
Nov 06 13:23:35 user nova-compute[74821]:     <acpi/>
Nov 06 13:23:35 user nova-compute[74821]:     <apic/>
Nov 06 13:23:35 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:23:35 user nova-compute[74821]:   </features>
Nov 06 13:23:35 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:23:35 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:23:35 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:23:35 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:23:35 user nova-compute[74821]:   </clock>
Nov 06 13:23:35 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:23:35 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:23:35 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:23:35 user nova-compute[74821]:   </cpu>
Nov 06 13:23:35 user nova-compute[74821]:   <devices>
Nov 06 13:23:35 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:23:35 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:23:35 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk"/>
Nov 06 13:23:35 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:23:35 user nova-compute[74821]:     </disk>
Nov 06 13:23:35 user nova-compute[74821]:     <disk type="block" device="disk">
Nov 06 13:23:35 user nova-compute[74821]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:23:35 user nova-compute[74821]:       <source dev="/dev/sdg"/>
Nov 06 13:23:35 user nova-compute[74821]:       <target dev="vdb" bus="virtio"/>
Nov 06 13:23:35 user nova-compute[74821]:       <serial>b42dbce4-83ea-498c-abcf-86517f54ae3a</serial>
Nov 06 13:23:35 user nova-compute[74821]:     </disk>
Nov 06 13:23:35 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:23:35 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:23:35 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk.rescue"/>
Nov 06 13:23:35 user nova-compute[74821]:       <target dev="vdc" bus="virtio"/>
Nov 06 13:23:35 user nova-compute[74821]:       <boot order="1"/>
Nov 06 13:23:35 user nova-compute[74821]:     </disk>
Nov 06 13:23:35 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:23:35 user nova-compute[74821]:       <mac address="fa:16:3e:30:ef:48"/>
Nov 06 13:23:35 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:23:35 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:23:35 user nova-compute[74821]:       <target dev="tapdb18095e-82"/>
Nov 06 13:23:35 user nova-compute[74821]:     </interface>
Nov 06 13:23:35 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:23:35 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/console.log" append="off"/>
Nov 06 13:23:35 user nova-compute[74821]:     </serial>
Nov 06 13:23:35 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:23:35 user nova-compute[74821]:     <video>
Nov 06 13:23:35 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:23:35 user nova-compute[74821]:     </video>
Nov 06 13:23:35 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:23:35 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:23:35 user nova-compute[74821]:     </rng>
Nov 06 13:23:35 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:23:35 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:23:35 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:23:35 user nova-compute[74821]:     </memballoon>
Nov 06 13:23:35 user nova-compute[74821]:   </devices>
Nov 06 13:23:35 user nova-compute[74821]: </domain>
Nov 06 13:23:35 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:23:35 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Instance destroyed successfully.
Nov 06 13:23:35 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] No VIF found with MAC fa:16:3e:30:ef:48, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Updating instance_info_cache with network_info: [{"id": "3ce43b79-45cd-4110-9508-0278e47d5bc8", "address": "fa:16:3e:37:94:57", "network": {"id": "221da9ed-3df1-4f6c-91b0-ec4117f186f9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-999229259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc877e77ae92437f8ae2f5e4d9b65947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce43b79-45", "ovs_interfaceid": "3ce43b79-45cd-4110-9508-0278e47d5bc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-107abf1d-96da-4406-8111-ef0bc09fb3e3" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:23:35 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:23:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:37 user nova-compute[74821]: DEBUG nova.compute.manager [req-1bc2b05f-3c9f-4cef-83c0-85cd6d820998 req-6be752ba-cafe-41da-9069-f947e4895895 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received event network-vif-plugged-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:23:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1bc2b05f-3c9f-4cef-83c0-85cd6d820998 req-6be752ba-cafe-41da-9069-f947e4895895 service nova] Acquiring lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:23:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1bc2b05f-3c9f-4cef-83c0-85cd6d820998 req-6be752ba-cafe-41da-9069-f947e4895895 service nova] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:23:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1bc2b05f-3c9f-4cef-83c0-85cd6d820998 req-6be752ba-cafe-41da-9069-f947e4895895 service nova] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:23:37 user nova-compute[74821]: DEBUG nova.compute.manager [req-1bc2b05f-3c9f-4cef-83c0-85cd6d820998 req-6be752ba-cafe-41da-9069-f947e4895895 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] No waiting events found dispatching network-vif-plugged-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:23:37 user nova-compute[74821]: WARNING nova.compute.manager [req-1bc2b05f-3c9f-4cef-83c0-85cd6d820998 req-6be752ba-cafe-41da-9069-f947e4895895 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received unexpected event network-vif-plugged-db18095e-82aa-407a-b43f-5f060b8c64ec for instance with vm_state active and task_state rescuing.
Nov 06 13:23:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:38 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:23:39 user nova-compute[74821]: DEBUG nova.compute.manager [req-2f6e5796-c535-472a-bf44-bbe9f2d9e5e5 req-8f02801a-b27b-4ce6-bdad-70c35097610d service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received event network-vif-plugged-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:23:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2f6e5796-c535-472a-bf44-bbe9f2d9e5e5 req-8f02801a-b27b-4ce6-bdad-70c35097610d service nova] Acquiring lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:23:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2f6e5796-c535-472a-bf44-bbe9f2d9e5e5 req-8f02801a-b27b-4ce6-bdad-70c35097610d service nova] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:23:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2f6e5796-c535-472a-bf44-bbe9f2d9e5e5 req-8f02801a-b27b-4ce6-bdad-70c35097610d service nova] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:23:39 user nova-compute[74821]: DEBUG nova.compute.manager [req-2f6e5796-c535-472a-bf44-bbe9f2d9e5e5 req-8f02801a-b27b-4ce6-bdad-70c35097610d service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] No waiting events found dispatching network-vif-plugged-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:23:39 user nova-compute[74821]: WARNING nova.compute.manager [req-2f6e5796-c535-472a-bf44-bbe9f2d9e5e5 req-8f02801a-b27b-4ce6-bdad-70c35097610d service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received unexpected event network-vif-plugged-db18095e-82aa-407a-b43f-5f060b8c64ec for instance with vm_state active and task_state rescuing.
Nov 06 13:23:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:39 user nova-compute[74821]: DEBUG nova.compute.manager [None req-a938b066-3e46-4cbe-b6f3-f63e9e939683 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:23:40 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:23:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:23:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:23:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:23:41 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:23:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3cb35a-d45e-4e35-96fe-437a941c0244/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3cb35a-d45e-4e35-96fe-437a941c0244/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3cb35a-d45e-4e35-96fe-437a941c0244/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3cb35a-d45e-4e35-96fe-437a941c0244/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:23:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk --force-share --output=json" returned: 0 in 0.486s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:43 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:43 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:23:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk.rescue --force-share --output=json" returned: 0 in 0.239s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk.rescue --force-share --output=json" returned: 0 in 0.243s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:46 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:23:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk --force-share --output=json" returned: 0 in 0.327s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:46 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:23:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:23:48 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:23:48 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:23:48 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=7441MB free_disk=25.031429290771484GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:23:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:23:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:23:48 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 3e21d005-f190-478a-a911-e483e1235057 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:23:48 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 311817c5-7b08-4da9-98eb-c685f37e6fd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:23:48 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 2de346cb-9858-47b8-a86c-4fde720d6127 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:23:48 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 49c65aca-8392-46ba-8fa3-b47ff2416cb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:23:48 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 107abf1d-96da-4406-8111-ef0bc09fb3e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:23:48 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance cc3c1518-c493-41b0-a748-a0ed933c2b1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:23:48 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 290cd798-a041-40c0-8ef9-319d3627ff82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:23:48 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 5a07f64b-5b12-4e7d-a041-ad591141aa17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:23:48 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 61beb251-4345-44e6-a176-5c14c99c9a52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:23:48 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 496f8213-4b32-4211-a354-e33a4a088848 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:23:48 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance be3cb35a-d45e-4e35-96fe-437a941c0244 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:23:48 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 32e28c73-9e3c-483b-807e-6b286413fe85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:23:48 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:23:48 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:23:48 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:49 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:23:49 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:23:49 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:23:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.748s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:23:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:50 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:23:51 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cc3c1518-c493-41b0-a748-a0ed933c2b1e is timed out.
Nov 06 13:23:52 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Successfully detached device vdb from instance cc3c1518-c493-41b0-a748-a0ed933c2b1e from the live domain config.
Nov 06 13:23:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TOvStAnd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:23:52 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:23:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc46a78c-117e-4914-a355-b13435c6a859]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:23:52 user nova-compute[74821]: No targets found.
Nov 06 13:23:52 user nova-compute[74821]: iSNS:
Nov 06 13:23:52 user nova-compute[74821]: No targets found.
Nov 06 13:23:52 user nova-compute[74821]: STATIC:
Nov 06 13:23:52 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116
Nov 06 13:23:52 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:23:52 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:23:52 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a
Nov 06 13:23:52 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:23:52 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:23:52 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5
Nov 06 13:23:52 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:23:52 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:23:52 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979
Nov 06 13:23:52 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:23:52 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:23:52 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e
Nov 06 13:23:52 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:23:52 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:23:52 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0
Nov 06 13:23:52 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:23:52 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:23:52 user nova-compute[74821]: FIRMWARE:
Nov 06 13:23:52 user nova-compute[74821]: No targets found.
Nov 06 13:23:52 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:23:52 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:23:52 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[953c077b-960a-47be-b757-f00c722209be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f21b44-7f45-4099-97db-fb0647cd401f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:23:52 user nova-compute[74821]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:23:52 user nova-compute[74821]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)
Nov 06 13:23:52 user nova-compute[74821]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)
Nov 06 13:23:52 user nova-compute[74821]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e (non-flash)
Nov 06 13:23:52 user nova-compute[74821]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a (non-flash)
Nov 06 13:23:52 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 (non-flash)
Nov 06 13:23:52 user nova-compute[74821]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:23:52 user nova-compute[74821]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)
Nov 06 13:23:52 user nova-compute[74821]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)
Nov 06 13:23:52 user nova-compute[74821]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e (non-flash)
Nov 06 13:23:52 user nova-compute[74821]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a (non-flash)
Nov 06 13:23:52 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e404972e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5'): ({'sdc'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Removing single pathed devices sdc {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfcc0c6-fe7f-4343-9285-32909210ceb8]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[408abeee-f695-4168-91c1-b84de07d3357]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Flushing IO for device /dev/sdc {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25353a8-613c-4bd6-82b0-ef73a267bb7b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b36ac2-d03a-4383-9891-dafd9552599b]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] SCSI volumes sdc have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.039s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd6c46d-5730-4701-ba76-9e5b42066730]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a6cf34-a527-44e6-bfab-a8cf90baeb8c]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5, portal: 172.16.0.220,3260]
Nov 06 13:23:52 user nova-compute[74821]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5, portal: 172.16.0.220,3260] successful.
Nov 06 13:23:52 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f5f31c1-284d-4554-ac80-322ddb4146d5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc4df63-d760-4e1f-8b3f-d417bfa7cb43]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] <== disconnect_volume: return (370ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:23:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:23:53 user nova-compute[74821]: DEBUG nova.objects.instance [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lazy-loading 'flavor' on Instance uuid cc3c1518-c493-41b0-a748-a0ed933c2b1e {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:23:53 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-40b114e3-7611-410e-bd70-b63a05dacb3c tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lock "cc3c1518-c493-41b0-a748-a0ed933c2b1e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.320s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:23:53 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-94f7b895-672a-43ac-91b8-06f73c7e49a1 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "32e28c73-9e3c-483b-807e-6b286413fe85" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:23:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-94f7b895-672a-43ac-91b8-06f73c7e49a1 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "32e28c73-9e3c-483b-807e-6b286413fe85" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:23:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-94f7b895-672a-43ac-91b8-06f73c7e49a1 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "32e28c73-9e3c-483b-807e-6b286413fe85-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:23:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-94f7b895-672a-43ac-91b8-06f73c7e49a1 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "32e28c73-9e3c-483b-807e-6b286413fe85-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:23:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-94f7b895-672a-43ac-91b8-06f73c7e49a1 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "32e28c73-9e3c-483b-807e-6b286413fe85-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:23:55 user nova-compute[74821]: INFO nova.compute.manager [None req-94f7b895-672a-43ac-91b8-06f73c7e49a1 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Terminating instance
Nov 06 13:23:55 user nova-compute[74821]: DEBUG nova.compute.manager [None req-94f7b895-672a-43ac-91b8-06f73c7e49a1 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:23:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:56 user nova-compute[74821]: DEBUG nova.compute.manager [req-0258775b-f857-4c3a-983d-948a361b5029 req-7578a519-82ca-48d4-b85e-9dff45c0bb1a service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Received event network-vif-unplugged-e5ab685a-b1f3-4704-963f-e7db827c947c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:23:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0258775b-f857-4c3a-983d-948a361b5029 req-7578a519-82ca-48d4-b85e-9dff45c0bb1a service nova] Acquiring lock "32e28c73-9e3c-483b-807e-6b286413fe85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:23:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0258775b-f857-4c3a-983d-948a361b5029 req-7578a519-82ca-48d4-b85e-9dff45c0bb1a service nova] Lock "32e28c73-9e3c-483b-807e-6b286413fe85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:23:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0258775b-f857-4c3a-983d-948a361b5029 req-7578a519-82ca-48d4-b85e-9dff45c0bb1a service nova] Lock "32e28c73-9e3c-483b-807e-6b286413fe85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:23:56 user nova-compute[74821]: DEBUG nova.compute.manager [req-0258775b-f857-4c3a-983d-948a361b5029 req-7578a519-82ca-48d4-b85e-9dff45c0bb1a service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] No waiting events found dispatching network-vif-unplugged-e5ab685a-b1f3-4704-963f-e7db827c947c {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:23:56 user nova-compute[74821]: DEBUG nova.compute.manager [req-0258775b-f857-4c3a-983d-948a361b5029 req-7578a519-82ca-48d4-b85e-9dff45c0bb1a service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Received event network-vif-unplugged-e5ab685a-b1f3-4704-963f-e7db827c947c for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:23:56 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Instance destroyed successfully.
Nov 06 13:23:56 user nova-compute[74821]: DEBUG nova.objects.instance [None req-94f7b895-672a-43ac-91b8-06f73c7e49a1 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lazy-loading 'resources' on Instance uuid 32e28c73-9e3c-483b-807e-6b286413fe85 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:23:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-94f7b895-672a-43ac-91b8-06f73c7e49a1 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T13:18:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1563572892',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1563572892',id=20,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEKYnXFLTR+2m8MV2bSy0f782O0BpwK/RW9xjhqlDgMuS85GEfW33cGEVy0+mivD0qgHHUJxCnGxmI4hcaL9bxGOgc60B0tHzOrPILwiUdfVhUEozjAJjaiVLjCwtIusA==',key_name='tempest-keypair-724006026',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:22:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07250ce4ef1b429f8a5c3c7763866763',ramdisk_id='',reservation_id='r-d03fj2ad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-374688010',owner_user_name='tempest-AttachVolumeShelveTestJSON-374688010-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:22:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c82a5e63234e40f6a8e63b3cb4dc97b3',uuid=32e28c73-9e3c-483b-807e-6b286413fe85,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5ab685a-b1f3-4704-963f-e7db827c947c", "address": "fa:16:3e:d5:da:15", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5ab685a-b1", "ovs_interfaceid": "e5ab685a-b1f3-4704-963f-e7db827c947c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:23:56 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-94f7b895-672a-43ac-91b8-06f73c7e49a1 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Converting VIF {"id": "e5ab685a-b1f3-4704-963f-e7db827c947c", "address": "fa:16:3e:d5:da:15", "network": {"id": "5318228c-491a-4ea1-a2b2-49ea8e15dccd", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1857330176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07250ce4ef1b429f8a5c3c7763866763", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5ab685a-b1", "ovs_interfaceid": "e5ab685a-b1f3-4704-963f-e7db827c947c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:23:56 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-94f7b895-672a-43ac-91b8-06f73c7e49a1 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:da:15,bridge_name='br-int',has_traffic_filtering=True,id=e5ab685a-b1f3-4704-963f-e7db827c947c,network=Network(5318228c-491a-4ea1-a2b2-49ea8e15dccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5ab685a-b1') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:23:56 user nova-compute[74821]: DEBUG os_vif [None req-94f7b895-672a-43ac-91b8-06f73c7e49a1 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:da:15,bridge_name='br-int',has_traffic_filtering=True,id=e5ab685a-b1f3-4704-963f-e7db827c947c,network=Network(5318228c-491a-4ea1-a2b2-49ea8e15dccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5ab685a-b1') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:23:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5ab685a-b1, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:23:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:23:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=16242dac-a5ed-48d9-849e-aee6620fc412) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:23:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:23:56 user nova-compute[74821]: INFO os_vif [None req-94f7b895-672a-43ac-91b8-06f73c7e49a1 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:da:15,bridge_name='br-int',has_traffic_filtering=True,id=e5ab685a-b1f3-4704-963f-e7db827c947c,network=Network(5318228c-491a-4ea1-a2b2-49ea8e15dccd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5ab685a-b1')
Nov 06 13:23:56 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-94f7b895-672a-43ac-91b8-06f73c7e49a1 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Deleting instance files /opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85_del
Nov 06 13:23:56 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-94f7b895-672a-43ac-91b8-06f73c7e49a1 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Deletion of /opt/stack/data/nova/instances/32e28c73-9e3c-483b-807e-6b286413fe85_del complete
Nov 06 13:23:56 user nova-compute[74821]: INFO nova.compute.manager [None req-94f7b895-672a-43ac-91b8-06f73c7e49a1 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 06 13:23:56 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-94f7b895-672a-43ac-91b8-06f73c7e49a1 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:23:56 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:23:56 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:23:57 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:23:57 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Took 0.96 seconds to deallocate network for instance.
Nov 06 13:23:57 user nova-compute[74821]: DEBUG nova.compute.manager [req-2a01b5a8-16cf-4afb-8d29-aed8ab9de123 req-06d4ea19-68f8-40a0-9dd2-ca03357dfefb service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Received event network-vif-deleted-e5ab685a-b1f3-4704-963f-e7db827c947c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:23:57 user nova-compute[74821]: INFO nova.compute.manager [req-2a01b5a8-16cf-4afb-8d29-aed8ab9de123 req-06d4ea19-68f8-40a0-9dd2-ca03357dfefb service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Neutron deleted interface e5ab685a-b1f3-4704-963f-e7db827c947c; detaching it from the instance and deleting it from the info cache
Nov 06 13:23:57 user nova-compute[74821]: DEBUG nova.network.neutron [req-2a01b5a8-16cf-4afb-8d29-aed8ab9de123 req-06d4ea19-68f8-40a0-9dd2-ca03357dfefb service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:23:57 user nova-compute[74821]: DEBUG nova.compute.manager [req-2a01b5a8-16cf-4afb-8d29-aed8ab9de123 req-06d4ea19-68f8-40a0-9dd2-ca03357dfefb service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Detach interface failed, port_id=e5ab685a-b1f3-4704-963f-e7db827c947c, reason: Instance 32e28c73-9e3c-483b-807e-6b286413fe85 could not be found. {{(pid=74821) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 13:23:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-94f7b895-672a-43ac-91b8-06f73c7e49a1 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:23:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-94f7b895-672a-43ac-91b8-06f73c7e49a1 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:23:58 user nova-compute[74821]: DEBUG nova.compute.manager [req-4f3f8190-2bae-4163-9499-5b325979e874 req-edfd3001-161d-4d6c-89c3-d4b407addcbe service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Received event network-vif-plugged-e5ab685a-b1f3-4704-963f-e7db827c947c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:23:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4f3f8190-2bae-4163-9499-5b325979e874 req-edfd3001-161d-4d6c-89c3-d4b407addcbe service nova] Acquiring lock "32e28c73-9e3c-483b-807e-6b286413fe85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:23:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4f3f8190-2bae-4163-9499-5b325979e874 req-edfd3001-161d-4d6c-89c3-d4b407addcbe service nova] Lock "32e28c73-9e3c-483b-807e-6b286413fe85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:23:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4f3f8190-2bae-4163-9499-5b325979e874 req-edfd3001-161d-4d6c-89c3-d4b407addcbe service nova] Lock "32e28c73-9e3c-483b-807e-6b286413fe85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:23:58 user nova-compute[74821]: DEBUG nova.compute.manager [req-4f3f8190-2bae-4163-9499-5b325979e874 req-edfd3001-161d-4d6c-89c3-d4b407addcbe service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] No waiting events found dispatching network-vif-plugged-e5ab685a-b1f3-4704-963f-e7db827c947c {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:23:58 user nova-compute[74821]: WARNING nova.compute.manager [req-4f3f8190-2bae-4163-9499-5b325979e874 req-edfd3001-161d-4d6c-89c3-d4b407addcbe service nova] [instance: 32e28c73-9e3c-483b-807e-6b286413fe85] Received unexpected event network-vif-plugged-e5ab685a-b1f3-4704-963f-e7db827c947c for instance with vm_state deleted and task_state None.
Nov 06 13:23:58 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-94f7b895-672a-43ac-91b8-06f73c7e49a1 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:23:58 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-94f7b895-672a-43ac-91b8-06f73c7e49a1 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:23:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-94f7b895-672a-43ac-91b8-06f73c7e49a1 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.423s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:23:58 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-94f7b895-672a-43ac-91b8-06f73c7e49a1 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Deleted allocations for instance 32e28c73-9e3c-483b-807e-6b286413fe85
Nov 06 13:23:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-94f7b895-672a-43ac-91b8-06f73c7e49a1 tempest-AttachVolumeShelveTestJSON-374688010 tempest-AttachVolumeShelveTestJSON-374688010-project-member] Lock "32e28c73-9e3c-483b-807e-6b286413fe85" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.661s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:23:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:06 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:11 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Acquiring lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:24:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:24:16 user nova-compute[74821]: DEBUG nova.compute.manager [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:24:16 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:24:16 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:24:16 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:24:16 user nova-compute[74821]: INFO nova.compute.claims [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Claim successful on node user
Nov 06 13:24:16 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:24:16 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:24:16 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.541s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:24:16 user nova-compute[74821]: DEBUG nova.compute.manager [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:24:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:24:16 user nova-compute[74821]: DEBUG nova.compute.manager [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:24:16 user nova-compute[74821]: DEBUG nova.network.neutron [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:24:16 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:24:16 user nova-compute[74821]: DEBUG nova.compute.manager [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:24:16 user nova-compute[74821]: DEBUG nova.policy [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '59d98c278c9349f3a010b526679a67b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d32bd8dc1c9419b90607e20dfa5d50b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:24:16 user nova-compute[74821]: INFO nova.virt.block_device [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Booting with volume be4ce8c2-20da-4129-903f-4487642101af at /dev/vda
Nov 06 13:24:16 user nova-compute[74821]: DEBUG os_brick.utils [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:24:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:24:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc42230d-90f0-4259-8acd-749069f191ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:24:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:24:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cf0726-c772-447a-bd6a-74231ea83d26]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:24:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:24:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2003e7b8-443f-4ec5-a50f-90a40f03e47a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:24:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86e041b-5611-4a37-8995-21c5ea26136b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:24:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:24:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:24:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:24:17 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:24:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c946c83-04cd-4c57-bfb6-a0fc4666b2dd]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:24:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:24:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:24:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:24:17 user nova-compute[74821]: DEBUG os_brick.utils [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:24:17 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Updating existing volume attachment record: 1b64b526-4bab-4d78-8578-f70b81011fd9 {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:24:17 user nova-compute[74821]: DEBUG nova.network.neutron [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Successfully created port: f35b642a-825f-4e17-9b97-3c8eba32a08e {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:24:18 user nova-compute[74821]: DEBUG nova.network.neutron [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Successfully updated port: f35b642a-825f-4e17-9b97-3c8eba32a08e {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:24:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Acquiring lock "refresh_cache-9cf1a0c3-4719-4637-a88d-e5864b2f1c3c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:24:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Acquired lock "refresh_cache-9cf1a0c3-4719-4637-a88d-e5864b2f1c3c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:24:18 user nova-compute[74821]: DEBUG nova.network.neutron [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:24:18 user nova-compute[74821]: DEBUG nova.compute.manager [req-77a3cec4-cc45-45e0-a6d0-710909df5dad req-d8b2201f-4ce7-42f4-bf04-402525a9eab2 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Received event network-changed-f35b642a-825f-4e17-9b97-3c8eba32a08e {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:24:18 user nova-compute[74821]: DEBUG nova.compute.manager [req-77a3cec4-cc45-45e0-a6d0-710909df5dad req-d8b2201f-4ce7-42f4-bf04-402525a9eab2 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Refreshing instance network info cache due to event network-changed-f35b642a-825f-4e17-9b97-3c8eba32a08e. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:24:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-77a3cec4-cc45-45e0-a6d0-710909df5dad req-d8b2201f-4ce7-42f4-bf04-402525a9eab2 service nova] Acquiring lock "refresh_cache-9cf1a0c3-4719-4637-a88d-e5864b2f1c3c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:24:18 user nova-compute[74821]: DEBUG nova.network.neutron [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:24:18 user nova-compute[74821]: DEBUG nova.network.neutron [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Updating instance_info_cache with network_info: [{"id": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "address": "fa:16:3e:3f:5e:be", "network": {"id": "20103956-1e64-4c7a-bed2-24edd5ae7724", "bridge": "br-int", "label": "tempest-TestShelveInstance-307843308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d32bd8dc1c9419b90607e20dfa5d50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35b642a-82", "ovs_interfaceid": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:24:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Releasing lock "refresh_cache-9cf1a0c3-4719-4637-a88d-e5864b2f1c3c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:24:18 user nova-compute[74821]: DEBUG nova.compute.manager [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Instance network_info: |[{"id": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "address": "fa:16:3e:3f:5e:be", "network": {"id": "20103956-1e64-4c7a-bed2-24edd5ae7724", "bridge": "br-int", "label": "tempest-TestShelveInstance-307843308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d32bd8dc1c9419b90607e20dfa5d50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35b642a-82", "ovs_interfaceid": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:24:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-77a3cec4-cc45-45e0-a6d0-710909df5dad req-d8b2201f-4ce7-42f4-bf04-402525a9eab2 service nova] Acquired lock "refresh_cache-9cf1a0c3-4719-4637-a88d-e5864b2f1c3c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:24:18 user nova-compute[74821]: DEBUG nova.network.neutron [req-77a3cec4-cc45-45e0-a6d0-710909df5dad req-d8b2201f-4ce7-42f4-bf04-402525a9eab2 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Refreshing network info cache for port f35b642a-825f-4e17-9b97-3c8eba32a08e {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:24:18 user nova-compute[74821]: DEBUG nova.network.neutron [req-77a3cec4-cc45-45e0-a6d0-710909df5dad req-d8b2201f-4ce7-42f4-bf04-402525a9eab2 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Updated VIF entry in instance network info cache for port f35b642a-825f-4e17-9b97-3c8eba32a08e. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:24:18 user nova-compute[74821]: DEBUG nova.network.neutron [req-77a3cec4-cc45-45e0-a6d0-710909df5dad req-d8b2201f-4ce7-42f4-bf04-402525a9eab2 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Updating instance_info_cache with network_info: [{"id": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "address": "fa:16:3e:3f:5e:be", "network": {"id": "20103956-1e64-4c7a-bed2-24edd5ae7724", "bridge": "br-int", "label": "tempest-TestShelveInstance-307843308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d32bd8dc1c9419b90607e20dfa5d50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35b642a-82", "ovs_interfaceid": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:24:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-77a3cec4-cc45-45e0-a6d0-710909df5dad req-d8b2201f-4ce7-42f4-bf04-402525a9eab2 service nova] Releasing lock "refresh_cache-9cf1a0c3-4719-4637-a88d-e5864b2f1c3c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:24:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7960170c-b164-4fab-adbc-a7c40eb08e12 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Acquiring lock "cc3c1518-c493-41b0-a748-a0ed933c2b1e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:24:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7960170c-b164-4fab-adbc-a7c40eb08e12 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lock "cc3c1518-c493-41b0-a748-a0ed933c2b1e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:24:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7960170c-b164-4fab-adbc-a7c40eb08e12 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Acquiring lock "cc3c1518-c493-41b0-a748-a0ed933c2b1e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:24:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7960170c-b164-4fab-adbc-a7c40eb08e12 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lock "cc3c1518-c493-41b0-a748-a0ed933c2b1e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:24:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7960170c-b164-4fab-adbc-a7c40eb08e12 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lock "cc3c1518-c493-41b0-a748-a0ed933c2b1e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:24:21 user nova-compute[74821]: INFO nova.compute.manager [None req-7960170c-b164-4fab-adbc-a7c40eb08e12 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Terminating instance
Nov 06 13:24:21 user nova-compute[74821]: DEBUG nova.compute.manager [None req-7960170c-b164-4fab-adbc-a7c40eb08e12 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:24:21 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:21 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:21 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:21 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:21 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:21 user nova-compute[74821]: DEBUG nova.compute.manager [req-75892270-8661-4226-af8d-951f7acc6e7e req-3954badc-4f89-4031-b3a3-9f5aca59f82e service nova] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Received event network-vif-unplugged-1bd8a943-f48b-4501-8f21-0f2d04e10624 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:24:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-75892270-8661-4226-af8d-951f7acc6e7e req-3954badc-4f89-4031-b3a3-9f5aca59f82e service nova] Acquiring lock "cc3c1518-c493-41b0-a748-a0ed933c2b1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:24:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-75892270-8661-4226-af8d-951f7acc6e7e req-3954badc-4f89-4031-b3a3-9f5aca59f82e service nova] Lock "cc3c1518-c493-41b0-a748-a0ed933c2b1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:24:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-75892270-8661-4226-af8d-951f7acc6e7e req-3954badc-4f89-4031-b3a3-9f5aca59f82e service nova] Lock "cc3c1518-c493-41b0-a748-a0ed933c2b1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:24:21 user nova-compute[74821]: DEBUG nova.compute.manager [req-75892270-8661-4226-af8d-951f7acc6e7e req-3954badc-4f89-4031-b3a3-9f5aca59f82e service nova] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] No waiting events found dispatching network-vif-unplugged-1bd8a943-f48b-4501-8f21-0f2d04e10624 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:24:21 user nova-compute[74821]: DEBUG nova.compute.manager [req-75892270-8661-4226-af8d-951f7acc6e7e req-3954badc-4f89-4031-b3a3-9f5aca59f82e service nova] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Received event network-vif-unplugged-1bd8a943-f48b-4501-8f21-0f2d04e10624 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:24:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:22 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Instance destroyed successfully.
Nov 06 13:24:22 user nova-compute[74821]: DEBUG nova.objects.instance [None req-7960170c-b164-4fab-adbc-a7c40eb08e12 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lazy-loading 'resources' on Instance uuid cc3c1518-c493-41b0-a748-a0ed933c2b1e {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:24:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-7960170c-b164-4fab-adbc-a7c40eb08e12 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:17:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2129299094',display_name='tempest-TestServerVolumeAttachmentScenario-server-2129299094',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2129299094',id=19,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIM68JlwItLlxNJIwjiyMwzha01uicyMTpV59ZaLgmn3bggXy7BbyXyYURF8hJaMWb1IO15fc+oxC7QaFU6pdyaNe4DiARfSfy/D00aj4rE044bDSiYNrXx4QOD6Bah1vw==',key_name='tempest-keypair-500936032',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:17:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='733c88e2098c49969334dad925f621c2',ramdisk_id='',reservation_id='r-f3vh2d9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2099995196',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2099995196-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:17:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53d9201b8b60408eb3bea10a590e35b0',uuid=cc3c1518-c493-41b0-a748-a0ed933c2b1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1bd8a943-f48b-4501-8f21-0f2d04e10624", "address": "fa:16:3e:b7:63:5d", "network": {"id": "3d0a42fb-8ba8-4d46-bbc2-7d1cde6bc297", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1825623675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733c88e2098c49969334dad925f621c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bd8a943-f4", "ovs_interfaceid": "1bd8a943-f48b-4501-8f21-0f2d04e10624", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:24:22 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-7960170c-b164-4fab-adbc-a7c40eb08e12 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Converting VIF {"id": "1bd8a943-f48b-4501-8f21-0f2d04e10624", "address": "fa:16:3e:b7:63:5d", "network": {"id": "3d0a42fb-8ba8-4d46-bbc2-7d1cde6bc297", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1825623675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733c88e2098c49969334dad925f621c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bd8a943-f4", "ovs_interfaceid": "1bd8a943-f48b-4501-8f21-0f2d04e10624", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:24:22 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-7960170c-b164-4fab-adbc-a7c40eb08e12 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:63:5d,bridge_name='br-int',has_traffic_filtering=True,id=1bd8a943-f48b-4501-8f21-0f2d04e10624,network=Network(3d0a42fb-8ba8-4d46-bbc2-7d1cde6bc297),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bd8a943-f4') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:24:22 user nova-compute[74821]: DEBUG os_vif [None req-7960170c-b164-4fab-adbc-a7c40eb08e12 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:63:5d,bridge_name='br-int',has_traffic_filtering=True,id=1bd8a943-f48b-4501-8f21-0f2d04e10624,network=Network(3d0a42fb-8ba8-4d46-bbc2-7d1cde6bc297),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bd8a943-f4') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:24:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1bd8a943-f4, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:24:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:24:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=941382df-59c2-4f64-aa70-c65108916f25) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:24:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:22 user nova-compute[74821]: INFO os_vif [None req-7960170c-b164-4fab-adbc-a7c40eb08e12 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:63:5d,bridge_name='br-int',has_traffic_filtering=True,id=1bd8a943-f48b-4501-8f21-0f2d04e10624,network=Network(3d0a42fb-8ba8-4d46-bbc2-7d1cde6bc297),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bd8a943-f4')
Nov 06 13:24:22 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-7960170c-b164-4fab-adbc-a7c40eb08e12 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Deleting instance files /opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e_del
Nov 06 13:24:22 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-7960170c-b164-4fab-adbc-a7c40eb08e12 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Deletion of /opt/stack/data/nova/instances/cc3c1518-c493-41b0-a748-a0ed933c2b1e_del complete
Nov 06 13:24:22 user nova-compute[74821]: INFO nova.compute.manager [None req-7960170c-b164-4fab-adbc-a7c40eb08e12 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 06 13:24:22 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-7960170c-b164-4fab-adbc-a7c40eb08e12 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:24:22 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:24:22 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:24:23 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:24:23 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Took 0.82 seconds to deallocate network for instance.
Nov 06 13:24:23 user nova-compute[74821]: DEBUG nova.compute.manager [req-bd9dd7ff-040b-4df4-b84d-ee99ab5ec67d req-40a38fc8-6cd3-4edd-a62e-b9707227b24a service nova] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Received event network-vif-deleted-1bd8a943-f48b-4501-8f21-0f2d04e10624 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:24:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7960170c-b164-4fab-adbc-a7c40eb08e12 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:24:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7960170c-b164-4fab-adbc-a7c40eb08e12 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:24:23 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-7960170c-b164-4fab-adbc-a7c40eb08e12 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:24:23 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-7960170c-b164-4fab-adbc-a7c40eb08e12 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:24:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7960170c-b164-4fab-adbc-a7c40eb08e12 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:24:23 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-7960170c-b164-4fab-adbc-a7c40eb08e12 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Deleted allocations for instance cc3c1518-c493-41b0-a748-a0ed933c2b1e
Nov 06 13:24:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7960170c-b164-4fab-adbc-a7c40eb08e12 tempest-TestServerVolumeAttachmentScenario-2099995196 tempest-TestServerVolumeAttachmentScenario-2099995196-project-member] Lock "cc3c1518-c493-41b0-a748-a0ed933c2b1e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.338s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:24:23 user nova-compute[74821]: DEBUG nova.compute.manager [req-96e7fec3-b341-4724-8b02-9ac4f1e1af3e req-9db6b0c0-9319-46a4-b0c2-2a92e55d5591 service nova] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Received event network-vif-plugged-1bd8a943-f48b-4501-8f21-0f2d04e10624 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:24:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-96e7fec3-b341-4724-8b02-9ac4f1e1af3e req-9db6b0c0-9319-46a4-b0c2-2a92e55d5591 service nova] Acquiring lock "cc3c1518-c493-41b0-a748-a0ed933c2b1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:24:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-96e7fec3-b341-4724-8b02-9ac4f1e1af3e req-9db6b0c0-9319-46a4-b0c2-2a92e55d5591 service nova] Lock "cc3c1518-c493-41b0-a748-a0ed933c2b1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:24:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-96e7fec3-b341-4724-8b02-9ac4f1e1af3e req-9db6b0c0-9319-46a4-b0c2-2a92e55d5591 service nova] Lock "cc3c1518-c493-41b0-a748-a0ed933c2b1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:24:23 user nova-compute[74821]: DEBUG nova.compute.manager [req-96e7fec3-b341-4724-8b02-9ac4f1e1af3e req-9db6b0c0-9319-46a4-b0c2-2a92e55d5591 service nova] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] No waiting events found dispatching network-vif-plugged-1bd8a943-f48b-4501-8f21-0f2d04e10624 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:24:23 user nova-compute[74821]: WARNING nova.compute.manager [req-96e7fec3-b341-4724-8b02-9ac4f1e1af3e req-9db6b0c0-9319-46a4-b0c2-2a92e55d5591 service nova] [instance: cc3c1518-c493-41b0-a748-a0ed933c2b1e] Received unexpected event network-vif-plugged-1bd8a943-f48b-4501-8f21-0f2d04e10624 for instance with vm_state deleted and task_state None.
Nov 06 13:24:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:27 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:24:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:33 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:24:33 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:24:34 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:24:34 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:24:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-290cd798-a041-40c0-8ef9-319d3627ff82" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:24:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-290cd798-a041-40c0-8ef9-319d3627ff82" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:24:35 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:24:35 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Updating instance_info_cache with network_info: [{"id": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "address": "fa:16:3e:6c:6c:87", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap741cb43d-19", "ovs_interfaceid": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:24:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-290cd798-a041-40c0-8ef9-319d3627ff82" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:24:35 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:24:35 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:24:35 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:24:35 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:24:36 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:24:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:24:38 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:24:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:24:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Acquiring lock "be3cb35a-d45e-4e35-96fe-437a941c0244" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:24:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "be3cb35a-d45e-4e35-96fe-437a941c0244" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:24:42 user nova-compute[74821]: INFO nova.compute.manager [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Detaching volume 56e8f341-6fcd-4f3e-8fa0-e4415103d97e
Nov 06 13:24:42 user nova-compute[74821]: INFO nova.virt.block_device [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Attempting to driver detach volume 56e8f341-6fcd-4f3e-8fa0-e4415103d97e from mountpoint /dev/vdb
Nov 06 13:24:42 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Attempting to detach device vdb from instance be3cb35a-d45e-4e35-96fe-437a941c0244 from the persistent domain config. {{(pid=74821) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 13:24:42 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:24:42 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:24:42 user nova-compute[74821]:   <source dev="/dev/sdf"/>
Nov 06 13:24:42 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:24:42 user nova-compute[74821]:   <serial>56e8f341-6fcd-4f3e-8fa0-e4415103d97e</serial>
Nov 06 13:24:42 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:24:42 user nova-compute[74821]: </disk>
Nov 06 13:24:42 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:24:42 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Successfully detached device vdb from instance be3cb35a-d45e-4e35-96fe-437a941c0244 from the persistent domain config.
Nov 06 13:24:42 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance be3cb35a-d45e-4e35-96fe-437a941c0244 from the live domain config. {{(pid=74821) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 13:24:42 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:24:42 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:24:42 user nova-compute[74821]:   <source dev="/dev/sdf"/>
Nov 06 13:24:42 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:24:42 user nova-compute[74821]:   <serial>56e8f341-6fcd-4f3e-8fa0-e4415103d97e</serial>
Nov 06 13:24:42 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:24:42 user nova-compute[74821]: </disk>
Nov 06 13:24:42 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:24:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Acquiring lock "be3cb35a-d45e-4e35-96fe-437a941c0244" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:24:42 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:24:42 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:24:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:24:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:24:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:24:42 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:24:43 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance be3cb35a-d45e-4e35-96fe-437a941c0244 {{(pid=74821) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 13:24:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3cb35a-d45e-4e35-96fe-437a941c0244/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3cb35a-d45e-4e35-96fe-437a941c0244/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:24:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3cb35a-d45e-4e35-96fe-437a941c0244/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be3cb35a-d45e-4e35-96fe-437a941c0244/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:24:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:24:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:24:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:24:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:24:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:24:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:24:44 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:24:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:24:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk.rescue --force-share --output=json" returned: 0 in 0.247s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:24:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:24:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:24:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:24:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:24:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:24:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:46 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:24:46 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:24:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:24:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:24:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:24:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:24:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:24:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:24:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:24:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:24:48 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:24:48 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:24:48 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=7653MB free_disk=25.073543548583984GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:24:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:24:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:24:48 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 3e21d005-f190-478a-a911-e483e1235057 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:24:48 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 311817c5-7b08-4da9-98eb-c685f37e6fd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:24:48 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 2de346cb-9858-47b8-a86c-4fde720d6127 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:24:48 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 49c65aca-8392-46ba-8fa3-b47ff2416cb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:24:48 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 107abf1d-96da-4406-8111-ef0bc09fb3e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:24:48 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 290cd798-a041-40c0-8ef9-319d3627ff82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:24:48 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 5a07f64b-5b12-4e7d-a041-ad591141aa17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:24:48 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 61beb251-4345-44e6-a176-5c14c99c9a52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:24:48 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 496f8213-4b32-4211-a354-e33a4a088848 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:24:48 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance be3cb35a-d45e-4e35-96fe-437a941c0244 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:24:48 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:24:48 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:24:48 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:24:48 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:24:48 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:24:48 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:24:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.580s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:24:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "290cd798-a041-40c0-8ef9-319d3627ff82" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:24:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "290cd798-a041-40c0-8ef9-319d3627ff82" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:24:50 user nova-compute[74821]: INFO nova.compute.manager [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Detaching volume c27cae42-439c-4fd6-8c64-b7a0144f2116
Nov 06 13:24:50 user nova-compute[74821]: INFO nova.virt.block_device [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Attempting to driver detach volume c27cae42-439c-4fd6-8c64-b7a0144f2116 from mountpoint /dev/vdb
Nov 06 13:24:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Attempting to detach device vdb from instance 290cd798-a041-40c0-8ef9-319d3627ff82 from the persistent domain config. {{(pid=74821) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 13:24:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:24:50 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:24:50 user nova-compute[74821]:   <source dev="/dev/sde"/>
Nov 06 13:24:50 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:24:50 user nova-compute[74821]:   <serial>c27cae42-439c-4fd6-8c64-b7a0144f2116</serial>
Nov 06 13:24:50 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 06 13:24:50 user nova-compute[74821]: </disk>
Nov 06 13:24:50 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:24:50 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Successfully detached device vdb from instance 290cd798-a041-40c0-8ef9-319d3627ff82 from the persistent domain config.
Nov 06 13:24:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 290cd798-a041-40c0-8ef9-319d3627ff82 from the live domain config. {{(pid=74821) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 13:24:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:24:50 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:24:50 user nova-compute[74821]:   <source dev="/dev/sde"/>
Nov 06 13:24:50 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:24:50 user nova-compute[74821]:   <serial>c27cae42-439c-4fd6-8c64-b7a0144f2116</serial>
Nov 06 13:24:50 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 06 13:24:50 user nova-compute[74821]: </disk>
Nov 06 13:24:50 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:24:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 290cd798-a041-40c0-8ef9-319d3627ff82 {{(pid=74821) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 13:24:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG nova.compute.manager [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:24:56 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Creating image(s)
Nov 06 13:24:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Did not create local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Ensure instance console log exists: /opt/stack/data/nova/instances/9cf1a0c3-4719-4637-a88d-e5864b2f1c3c/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Start _get_guest_xml network_info=[{"id": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "address": "fa:16:3e:3f:5e:be", "network": {"id": "20103956-1e64-4c7a-bed2-24edd5ae7724", "bridge": "br-int", "label": "tempest-TestShelveInstance-307843308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d32bd8dc1c9419b90607e20dfa5d50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35b642a-82", "ovs_interfaceid": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VqnwLbMR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9cf1a0c3-4719-4637-a88d-e5864b2f1c3c', 'attached_at': '', 'detached_at': '', 'volume_id': 'be4ce8c2-20da-4129-903f-4487642101af', 'serial': 'be4ce8c2-20da-4129-903f-4487642101af'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '1b64b526-4bab-4d78-8578-f70b81011fd9', 'volume_type': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:24:56 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:24:56 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:24:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VqnwLbMR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:24:56 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:24:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:24:56 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:24:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:24:56 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[13dbfe41-a1bc-48b1-a2c2-b33d63425c6b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:24:56 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1dbd278-c06a-445f-9800-d2fa05cc688d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af] added
Nov 06 13:24:56 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d868380a-388b-406a-b6c1-284dd2053a07]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b0f0a3-fdcf-4498-ae5c-ac41e2bb3a1f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VqnwLbMR {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VqnwLbMR" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff03a2ab-6658-4028-8f18-d9261d65464f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VqnwLbMR'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08c387c-5ffd-4d81-a3df-5d6cfd7f14de]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a4226101-dbe2-443c-9298-d3fa34ef5380 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Acquiring lock "107abf1d-96da-4406-8111-ef0bc09fb3e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a4226101-dbe2-443c-9298-d3fa34ef5380 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "107abf1d-96da-4406-8111-ef0bc09fb3e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a4226101-dbe2-443c-9298-d3fa34ef5380 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Acquiring lock "107abf1d-96da-4406-8111-ef0bc09fb3e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a4226101-dbe2-443c-9298-d3fa34ef5380 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "107abf1d-96da-4406-8111-ef0bc09fb3e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a4226101-dbe2-443c-9298-d3fa34ef5380 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "107abf1d-96da-4406-8111-ef0bc09fb3e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:24:56 user nova-compute[74821]: INFO nova.compute.manager [None req-a4226101-dbe2-443c-9298-d3fa34ef5380 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Terminating instance
Nov 06 13:24:56 user nova-compute[74821]: DEBUG nova.compute.manager [None req-a4226101-dbe2-443c-9298-d3fa34ef5380 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfd813f-bbb8-4497-ac28-7b7c1cb6534f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:24:56 user nova-compute[74821]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)
Nov 06 13:24:56 user nova-compute[74821]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)
Nov 06 13:24:56 user nova-compute[74821]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e (non-flash)
Nov 06 13:24:56 user nova-compute[74821]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a (non-flash)
Nov 06 13:24:56 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:24:56 user nova-compute[74821]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)
Nov 06 13:24:56 user nova-compute[74821]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)
Nov 06 13:24:56 user nova-compute[74821]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e (non-flash)
Nov 06 13:24:56 user nova-compute[74821]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a (non-flash)
Nov 06 13:24:56 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c7a504-ded8-415c-9961-c2e02235b1f3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af, portal: 172.16.0.220,3260]
Nov 06 13:24:56 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af, portal: 172.16.0.220,3260] successful.
Nov 06 13:24:56 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[628043ce-67df-48d7-9ed0-10e881e024b0]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf49186e-68d6-435d-af4d-5fb8aff11d2d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:24:56 user nova-compute[74821]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)
Nov 06 13:24:56 user nova-compute[74821]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)
Nov 06 13:24:56 user nova-compute[74821]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e (non-flash)
Nov 06 13:24:56 user nova-compute[74821]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a (non-flash)
Nov 06 13:24:56 user nova-compute[74821]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:24:56 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:24:56 user nova-compute[74821]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)
Nov 06 13:24:56 user nova-compute[74821]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)
Nov 06 13:24:56 user nova-compute[74821]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e (non-flash)
Nov 06 13:24:56 user nova-compute[74821]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a (non-flash)
Nov 06 13:24:56 user nova-compute[74821]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:24:56 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee2cf09-f5b4-4968-98ef-c93ba978b94e]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:24:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VqnwLbMR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:24:57 user nova-compute[74821]: DEBUG nova.compute.manager [req-fc2d05f5-c18e-4fec-a065-2a4e493eb3f3 req-9e9db168-1518-47ba-97b4-c3fdc77f9c89 service nova] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Received event network-vif-unplugged-3ce43b79-45cd-4110-9508-0278e47d5bc8 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:24:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fc2d05f5-c18e-4fec-a065-2a4e493eb3f3 req-9e9db168-1518-47ba-97b4-c3fdc77f9c89 service nova] Acquiring lock "107abf1d-96da-4406-8111-ef0bc09fb3e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:24:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fc2d05f5-c18e-4fec-a065-2a4e493eb3f3 req-9e9db168-1518-47ba-97b4-c3fdc77f9c89 service nova] Lock "107abf1d-96da-4406-8111-ef0bc09fb3e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:24:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fc2d05f5-c18e-4fec-a065-2a4e493eb3f3 req-9e9db168-1518-47ba-97b4-c3fdc77f9c89 service nova] Lock "107abf1d-96da-4406-8111-ef0bc09fb3e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:24:57 user nova-compute[74821]: DEBUG nova.compute.manager [req-fc2d05f5-c18e-4fec-a065-2a4e493eb3f3 req-9e9db168-1518-47ba-97b4-c3fdc77f9c89 service nova] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] No waiting events found dispatching network-vif-unplugged-3ce43b79-45cd-4110-9508-0278e47d5bc8 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:24:57 user nova-compute[74821]: DEBUG nova.compute.manager [req-fc2d05f5-c18e-4fec-a065-2a4e493eb3f3 req-9e9db168-1518-47ba-97b4-c3fdc77f9c89 service nova] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Received event network-vif-unplugged-3ce43b79-45cd-4110-9508-0278e47d5bc8 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:24:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:57 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Instance destroyed successfully.
Nov 06 13:24:57 user nova-compute[74821]: DEBUG nova.objects.instance [None req-a4226101-dbe2-443c-9298-d3fa34ef5380 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lazy-loading 'resources' on Instance uuid 107abf1d-96da-4406-8111-ef0bc09fb3e3 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:24:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-a4226101-dbe2-443c-9298-d3fa34ef5380 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:17:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-648502763',display_name='tempest-VolumesAdminNegativeTest-server-648502763',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-648502763',id=18,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONtFiKV3YE6V5SUgDBbtL7ZCGbAXstEw6H++682kYmupKAQazTO1RNFbNdOR4exqo36Tc9FnUiQ1PsapZEf4G7mcYvLXdKuAK/ZfWqiUw+Wx8SMsjjiSHaAdZXUkUL2lg==',key_name='tempest-keypair-1084933158',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:17:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc877e77ae92437f8ae2f5e4d9b65947',ramdisk_id='',reservation_id='r-x0mw253n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-610056100',owner_user_name='tempest-VolumesAdminNegativeTest-610056100-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:17:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0b7addf6de74979a206dfccac04f475',uuid=107abf1d-96da-4406-8111-ef0bc09fb3e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ce43b79-45cd-4110-9508-0278e47d5bc8", "address": "fa:16:3e:37:94:57", "network": {"id": "221da9ed-3df1-4f6c-91b0-ec4117f186f9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-999229259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc877e77ae92437f8ae2f5e4d9b65947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce43b79-45", "ovs_interfaceid": "3ce43b79-45cd-4110-9508-0278e47d5bc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:24:57 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-a4226101-dbe2-443c-9298-d3fa34ef5380 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Converting VIF {"id": "3ce43b79-45cd-4110-9508-0278e47d5bc8", "address": "fa:16:3e:37:94:57", "network": {"id": "221da9ed-3df1-4f6c-91b0-ec4117f186f9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-999229259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc877e77ae92437f8ae2f5e4d9b65947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce43b79-45", "ovs_interfaceid": "3ce43b79-45cd-4110-9508-0278e47d5bc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:24:57 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-a4226101-dbe2-443c-9298-d3fa34ef5380 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:94:57,bridge_name='br-int',has_traffic_filtering=True,id=3ce43b79-45cd-4110-9508-0278e47d5bc8,network=Network(221da9ed-3df1-4f6c-91b0-ec4117f186f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce43b79-45') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:24:57 user nova-compute[74821]: DEBUG os_vif [None req-a4226101-dbe2-443c-9298-d3fa34ef5380 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:94:57,bridge_name='br-int',has_traffic_filtering=True,id=3ce43b79-45cd-4110-9508-0278e47d5bc8,network=Network(221da9ed-3df1-4f6c-91b0-ec4117f186f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce43b79-45') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:24:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ce43b79-45, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:24:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:24:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f6fbd416-3a98-486c-bc22-48af3fec76c2) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:24:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:57 user nova-compute[74821]: INFO os_vif [None req-a4226101-dbe2-443c-9298-d3fa34ef5380 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:94:57,bridge_name='br-int',has_traffic_filtering=True,id=3ce43b79-45cd-4110-9508-0278e47d5bc8,network=Network(221da9ed-3df1-4f6c-91b0-ec4117f186f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce43b79-45')
Nov 06 13:24:57 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-a4226101-dbe2-443c-9298-d3fa34ef5380 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Deleting instance files /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3_del
Nov 06 13:24:57 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-a4226101-dbe2-443c-9298-d3fa34ef5380 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Deletion of /opt/stack/data/nova/instances/107abf1d-96da-4406-8111-ef0bc09fb3e3_del complete
Nov 06 13:24:57 user nova-compute[74821]: INFO nova.compute.manager [None req-a4226101-dbe2-443c-9298-d3fa34ef5380 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 06 13:24:57 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-a4226101-dbe2-443c-9298-d3fa34ef5380 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:24:57 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:24:57 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:24:57 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:24:57 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] <== connect_volume: return (1413ms) {'type': 'block', 'scsi_wwn': '23335313566373062', 'path': '/dev/sdc'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:24:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335313566373062', 'path': '/dev/sdc'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:24:58 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:24:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2121328163',display_name='tempest-TestShelveInstance-server-2121328163',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2121328163',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwfuvsbviphz947EVvwS0hBLH0hqkvelFZBVA/BbW13Na0YbmBH7ZF7KDI0Bt918tlo46Bl4nxkVdoSqlbR//uOE/jWGnGmLRd26zKs/LiEE+tlAwNPK69p2mKNICzRTw==',key_name='tempest-TestShelveInstance-1104151437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d32bd8dc1c9419b90607e20dfa5d50b',ramdisk_id='',reservation_id='r-14h61fxg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-570916377',owner_user_name='tempest-TestShelveInstance-570916377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:24:17Z,user_data=None,user_id='59d98c278c9349f3a010b526679a67b3',uuid=9cf1a0c3-4719-4637-a88d-e5864b2f1c3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "address": "fa:16:3e:3f:5e:be", "network": {"id": "20103956-1e64-4c7a-bed2-24edd5ae7724", "bridge": "br-int", "label": "tempest-TestShelveInstance-307843308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d32bd8dc1c9419b90607e20dfa5d50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35b642a-82", "ovs_interfaceid": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:24:58 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Converting VIF {"id": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "address": "fa:16:3e:3f:5e:be", "network": {"id": "20103956-1e64-4c7a-bed2-24edd5ae7724", "bridge": "br-int", "label": "tempest-TestShelveInstance-307843308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d32bd8dc1c9419b90607e20dfa5d50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35b642a-82", "ovs_interfaceid": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:24:58 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:5e:be,bridge_name='br-int',has_traffic_filtering=True,id=f35b642a-825f-4e17-9b97-3c8eba32a08e,network=Network(20103956-1e64-4c7a-bed2-24edd5ae7724),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf35b642a-82') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:24:58 user nova-compute[74821]: DEBUG nova.objects.instance [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lazy-loading 'pci_devices' on Instance uuid 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:24:58 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:24:58 user nova-compute[74821]:   <uuid>9cf1a0c3-4719-4637-a88d-e5864b2f1c3c</uuid>
Nov 06 13:24:58 user nova-compute[74821]:   <name>instance-0000001b</name>
Nov 06 13:24:58 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:24:58 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:24:58 user nova-compute[74821]:   <metadata>
Nov 06 13:24:58 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:24:58 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:24:58 user nova-compute[74821]:       <nova:name>tempest-TestShelveInstance-server-2121328163</nova:name>
Nov 06 13:24:58 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:24:56</nova:creationTime>
Nov 06 13:24:58 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:24:58 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:24:58 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:24:58 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:24:58 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:24:58 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:24:58 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:24:58 user nova-compute[74821]:       <nova:owner>
Nov 06 13:24:58 user nova-compute[74821]:         <nova:user uuid="59d98c278c9349f3a010b526679a67b3">tempest-TestShelveInstance-570916377-project-member</nova:user>
Nov 06 13:24:58 user nova-compute[74821]:         <nova:project uuid="6d32bd8dc1c9419b90607e20dfa5d50b">tempest-TestShelveInstance-570916377</nova:project>
Nov 06 13:24:58 user nova-compute[74821]:       </nova:owner>
Nov 06 13:24:58 user nova-compute[74821]:       <nova:ports>
Nov 06 13:24:58 user nova-compute[74821]:         <nova:port uuid="f35b642a-825f-4e17-9b97-3c8eba32a08e">
Nov 06 13:24:58 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 06 13:24:58 user nova-compute[74821]:         </nova:port>
Nov 06 13:24:58 user nova-compute[74821]:       </nova:ports>
Nov 06 13:24:58 user nova-compute[74821]:     </nova:instance>
Nov 06 13:24:58 user nova-compute[74821]:   </metadata>
Nov 06 13:24:58 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:24:58 user nova-compute[74821]:     <system>
Nov 06 13:24:58 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:24:58 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:24:58 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:24:58 user nova-compute[74821]:       <entry name="serial">9cf1a0c3-4719-4637-a88d-e5864b2f1c3c</entry>
Nov 06 13:24:58 user nova-compute[74821]:       <entry name="uuid">9cf1a0c3-4719-4637-a88d-e5864b2f1c3c</entry>
Nov 06 13:24:58 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:24:58 user nova-compute[74821]:     </system>
Nov 06 13:24:58 user nova-compute[74821]:   </sysinfo>
Nov 06 13:24:58 user nova-compute[74821]:   <os>
Nov 06 13:24:58 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:24:58 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:24:58 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:24:58 user nova-compute[74821]:   </os>
Nov 06 13:24:58 user nova-compute[74821]:   <features>
Nov 06 13:24:58 user nova-compute[74821]:     <acpi/>
Nov 06 13:24:58 user nova-compute[74821]:     <apic/>
Nov 06 13:24:58 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:24:58 user nova-compute[74821]:   </features>
Nov 06 13:24:58 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:24:58 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:24:58 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:24:58 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:24:58 user nova-compute[74821]:   </clock>
Nov 06 13:24:58 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:24:58 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:24:58 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:24:58 user nova-compute[74821]:   </cpu>
Nov 06 13:24:58 user nova-compute[74821]:   <devices>
Nov 06 13:24:58 user nova-compute[74821]:     <disk type="block" device="disk">
Nov 06 13:24:58 user nova-compute[74821]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:24:58 user nova-compute[74821]:       <source dev="/dev/sdc"/>
Nov 06 13:24:58 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:24:58 user nova-compute[74821]:       <serial>be4ce8c2-20da-4129-903f-4487642101af</serial>
Nov 06 13:24:58 user nova-compute[74821]:     </disk>
Nov 06 13:24:58 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:24:58 user nova-compute[74821]:       <mac address="fa:16:3e:3f:5e:be"/>
Nov 06 13:24:58 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:24:58 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:24:58 user nova-compute[74821]:       <target dev="tapf35b642a-82"/>
Nov 06 13:24:58 user nova-compute[74821]:     </interface>
Nov 06 13:24:58 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:24:58 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/9cf1a0c3-4719-4637-a88d-e5864b2f1c3c/console.log" append="off"/>
Nov 06 13:24:58 user nova-compute[74821]:     </serial>
Nov 06 13:24:58 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:24:58 user nova-compute[74821]:     <video>
Nov 06 13:24:58 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:24:58 user nova-compute[74821]:     </video>
Nov 06 13:24:58 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:24:58 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:24:58 user nova-compute[74821]:     </rng>
Nov 06 13:24:58 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:24:58 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:24:58 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:24:58 user nova-compute[74821]:     </memballoon>
Nov 06 13:24:58 user nova-compute[74821]:   </devices>
Nov 06 13:24:58 user nova-compute[74821]: </domain>
Nov 06 13:24:58 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:24:58 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:24:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2121328163',display_name='tempest-TestShelveInstance-server-2121328163',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2121328163',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwfuvsbviphz947EVvwS0hBLH0hqkvelFZBVA/BbW13Na0YbmBH7ZF7KDI0Bt918tlo46Bl4nxkVdoSqlbR//uOE/jWGnGmLRd26zKs/LiEE+tlAwNPK69p2mKNICzRTw==',key_name='tempest-TestShelveInstance-1104151437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d32bd8dc1c9419b90607e20dfa5d50b',ramdisk_id='',reservation_id='r-14h61fxg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-570916377',owner_user_name='tempest-TestShelveInstance-570916377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:24:17Z,user_data=None,user_id='59d98c278c9349f3a010b526679a67b3',uuid=9cf1a0c3-4719-4637-a88d-e5864b2f1c3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "address": "fa:16:3e:3f:5e:be", "network": {"id": "20103956-1e64-4c7a-bed2-24edd5ae7724", "bridge": "br-int", "label": "tempest-TestShelveInstance-307843308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d32bd8dc1c9419b90607e20dfa5d50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35b642a-82", "ovs_interfaceid": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:24:58 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Converting VIF {"id": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "address": "fa:16:3e:3f:5e:be", "network": {"id": "20103956-1e64-4c7a-bed2-24edd5ae7724", "bridge": "br-int", "label": "tempest-TestShelveInstance-307843308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d32bd8dc1c9419b90607e20dfa5d50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35b642a-82", "ovs_interfaceid": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:24:58 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:5e:be,bridge_name='br-int',has_traffic_filtering=True,id=f35b642a-825f-4e17-9b97-3c8eba32a08e,network=Network(20103956-1e64-4c7a-bed2-24edd5ae7724),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf35b642a-82') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:24:58 user nova-compute[74821]: DEBUG os_vif [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:5e:be,bridge_name='br-int',has_traffic_filtering=True,id=f35b642a-825f-4e17-9b97-3c8eba32a08e,network=Network(20103956-1e64-4c7a-bed2-24edd5ae7724),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf35b642a-82') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:24:58 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:58 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:24:58 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:24:58 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:58 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '711314a3-95ac-568c-a3ae-4e06a7ebd977', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:24:58 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:58 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:58 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:58 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf35b642a-82, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:24:58 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf35b642a-82, col_values=(('qos', UUID('7c8fa9c9-8743-46e5-98a5-0aa5299681ad')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:24:58 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf35b642a-82, col_values=(('external_ids', {'iface-id': 'f35b642a-825f-4e17-9b97-3c8eba32a08e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:5e:be', 'vm-uuid': '9cf1a0c3-4719-4637-a88d-e5864b2f1c3c'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:24:58 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:58 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:24:58 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:58 user nova-compute[74821]: INFO os_vif [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:5e:be,bridge_name='br-int',has_traffic_filtering=True,id=f35b642a-825f-4e17-9b97-3c8eba32a08e,network=Network(20103956-1e64-4c7a-bed2-24edd5ae7724),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf35b642a-82')
Nov 06 13:24:58 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:24:58 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] No VIF found with MAC fa:16:3e:3f:5e:be, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:24:58 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:24:58 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Took 0.75 seconds to deallocate network for instance.
Nov 06 13:24:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a4226101-dbe2-443c-9298-d3fa34ef5380 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:24:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a4226101-dbe2-443c-9298-d3fa34ef5380 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:24:58 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-a4226101-dbe2-443c-9298-d3fa34ef5380 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:24:58 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-a4226101-dbe2-443c-9298-d3fa34ef5380 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:24:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a4226101-dbe2-443c-9298-d3fa34ef5380 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:24:58 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-a4226101-dbe2-443c-9298-d3fa34ef5380 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Deleted allocations for instance 107abf1d-96da-4406-8111-ef0bc09fb3e3
Nov 06 13:24:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a4226101-dbe2-443c-9298-d3fa34ef5380 tempest-VolumesAdminNegativeTest-610056100 tempest-VolumesAdminNegativeTest-610056100-project-member] Lock "107abf1d-96da-4406-8111-ef0bc09fb3e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.224s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:24:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-305d32cc-e3bd-48cc-8e05-0a0f06882252 req-36db6ba0-1d01-49f8-9cc0-1ef9950b9d54 service nova] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Received event network-vif-plugged-3ce43b79-45cd-4110-9508-0278e47d5bc8 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:24:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-305d32cc-e3bd-48cc-8e05-0a0f06882252 req-36db6ba0-1d01-49f8-9cc0-1ef9950b9d54 service nova] Acquiring lock "107abf1d-96da-4406-8111-ef0bc09fb3e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:24:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-305d32cc-e3bd-48cc-8e05-0a0f06882252 req-36db6ba0-1d01-49f8-9cc0-1ef9950b9d54 service nova] Lock "107abf1d-96da-4406-8111-ef0bc09fb3e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:24:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-305d32cc-e3bd-48cc-8e05-0a0f06882252 req-36db6ba0-1d01-49f8-9cc0-1ef9950b9d54 service nova] Lock "107abf1d-96da-4406-8111-ef0bc09fb3e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:24:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-305d32cc-e3bd-48cc-8e05-0a0f06882252 req-36db6ba0-1d01-49f8-9cc0-1ef9950b9d54 service nova] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] No waiting events found dispatching network-vif-plugged-3ce43b79-45cd-4110-9508-0278e47d5bc8 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:24:59 user nova-compute[74821]: WARNING nova.compute.manager [req-305d32cc-e3bd-48cc-8e05-0a0f06882252 req-36db6ba0-1d01-49f8-9cc0-1ef9950b9d54 service nova] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Received unexpected event network-vif-plugged-3ce43b79-45cd-4110-9508-0278e47d5bc8 for instance with vm_state deleted and task_state None.
Nov 06 13:24:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-305d32cc-e3bd-48cc-8e05-0a0f06882252 req-36db6ba0-1d01-49f8-9cc0-1ef9950b9d54 service nova] [instance: 107abf1d-96da-4406-8111-ef0bc09fb3e3] Received event network-vif-deleted-3ce43b79-45cd-4110-9508-0278e47d5bc8 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:24:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:24:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-de73035d-c557-41f0-a832-3b8e5892b652 req-bf03b136-b032-4139-bb04-dd949bb749dc service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Received event network-vif-plugged-f35b642a-825f-4e17-9b97-3c8eba32a08e {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:24:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-de73035d-c557-41f0-a832-3b8e5892b652 req-bf03b136-b032-4139-bb04-dd949bb749dc service nova] Acquiring lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:24:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-de73035d-c557-41f0-a832-3b8e5892b652 req-bf03b136-b032-4139-bb04-dd949bb749dc service nova] Lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:24:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-de73035d-c557-41f0-a832-3b8e5892b652 req-bf03b136-b032-4139-bb04-dd949bb749dc service nova] Lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:24:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-de73035d-c557-41f0-a832-3b8e5892b652 req-bf03b136-b032-4139-bb04-dd949bb749dc service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] No waiting events found dispatching network-vif-plugged-f35b642a-825f-4e17-9b97-3c8eba32a08e {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:24:59 user nova-compute[74821]: WARNING nova.compute.manager [req-de73035d-c557-41f0-a832-3b8e5892b652 req-bf03b136-b032-4139-bb04-dd949bb749dc service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Received unexpected event network-vif-plugged-f35b642a-825f-4e17-9b97-3c8eba32a08e for instance with vm_state building and task_state spawning.
Nov 06 13:25:00 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:00 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:00 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:01 user nova-compute[74821]: DEBUG nova.compute.manager [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:25:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:25:01 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Instance spawned successfully.
Nov 06 13:25:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:25:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:25:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:25:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:25:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:25:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:25:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:25:01 user nova-compute[74821]: INFO nova.compute.manager [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Took 5.27 seconds to spawn the instance on the hypervisor.
Nov 06 13:25:01 user nova-compute[74821]: DEBUG nova.compute.manager [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:25:01 user nova-compute[74821]: INFO nova.compute.manager [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Took 45.75 seconds to build instance.
Nov 06 13:25:01 user nova-compute[74821]: DEBUG nova.compute.manager [req-fe2b8ee7-ad62-43e2-8259-6f1e975343af req-91edcf58-d201-497f-9df6-b4a90750f8c9 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Received event network-vif-plugged-f35b642a-825f-4e17-9b97-3c8eba32a08e {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:25:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fe2b8ee7-ad62-43e2-8259-6f1e975343af req-91edcf58-d201-497f-9df6-b4a90750f8c9 service nova] Acquiring lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:25:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fe2b8ee7-ad62-43e2-8259-6f1e975343af req-91edcf58-d201-497f-9df6-b4a90750f8c9 service nova] Lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:25:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fe2b8ee7-ad62-43e2-8259-6f1e975343af req-91edcf58-d201-497f-9df6-b4a90750f8c9 service nova] Lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:25:01 user nova-compute[74821]: DEBUG nova.compute.manager [req-fe2b8ee7-ad62-43e2-8259-6f1e975343af req-91edcf58-d201-497f-9df6-b4a90750f8c9 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] No waiting events found dispatching network-vif-plugged-f35b642a-825f-4e17-9b97-3c8eba32a08e {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:25:01 user nova-compute[74821]: WARNING nova.compute.manager [req-fe2b8ee7-ad62-43e2-8259-6f1e975343af req-91edcf58-d201-497f-9df6-b4a90750f8c9 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Received unexpected event network-vif-plugged-f35b642a-825f-4e17-9b97-3c8eba32a08e for instance with vm_state active and task_state None.
Nov 06 13:25:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-dc43f436-2e6a-426a-bae8-0735032f91cd tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 45.860s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:03 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance be3cb35a-d45e-4e35-96fe-437a941c0244 is timed out.
Nov 06 13:25:03 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Successfully detached device vdb from instance be3cb35a-d45e-4e35-96fe-437a941c0244 from the live domain config.
Nov 06 13:25:03 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'blJIYnvR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:25:03 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:25:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bf9a10-996d-4c43-a8cf-04afe0dcdb81]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:25:03 user nova-compute[74821]: No targets found.
Nov 06 13:25:03 user nova-compute[74821]: iSNS:
Nov 06 13:25:03 user nova-compute[74821]: No targets found.
Nov 06 13:25:03 user nova-compute[74821]: STATIC:
Nov 06 13:25:03 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116
Nov 06 13:25:03 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:25:03 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:25:03 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af
Nov 06 13:25:03 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:25:03 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:25:03 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a
Nov 06 13:25:03 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:25:03 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:25:03 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979
Nov 06 13:25:03 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:25:03 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:25:03 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e
Nov 06 13:25:03 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:25:03 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:25:03 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0
Nov 06 13:25:03 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:25:03 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:25:03 user nova-compute[74821]: FIRMWARE:
Nov 06 13:25:03 user nova-compute[74821]: No targets found.
Nov 06 13:25:03 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:25:03 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:25:03 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df64921-9d13-4295-85c0-3d8fcc9f24df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d78d330-3a7f-4e4c-b11b-9daeec13c135]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:25:03 user nova-compute[74821]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)
Nov 06 13:25:03 user nova-compute[74821]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)
Nov 06 13:25:03 user nova-compute[74821]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e (non-flash)
Nov 06 13:25:03 user nova-compute[74821]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a (non-flash)
Nov 06 13:25:03 user nova-compute[74821]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:25:03 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:25:03 user nova-compute[74821]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)
Nov 06 13:25:03 user nova-compute[74821]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)
Nov 06 13:25:03 user nova-compute[74821]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e (non-flash)
Nov 06 13:25:03 user nova-compute[74821]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a (non-flash)
Nov 06 13:25:03 user nova-compute[74821]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:25:03 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e405f1240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e'): ({'sdf'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Removing single pathed devices sdf {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a715e8-36cc-4720-8265-d276daad57ee]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed57ed8-aa4d-4093-be7e-1f30bfe21d1b]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Flushing IO for device /dev/sdf {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc051d77-b99a-43cb-9656-6737cdc72b48]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7102a2-bdca-4df0-92f1-76f5c38d0c19]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] SCSI volumes sdf have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a3f885-30d6-4d9d-8484-4f36a6c04f4e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aee4179-426a-4990-9907-670b3f5b84f0]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e, portal: 172.16.0.220,3260]
Nov 06 13:25:03 user nova-compute[74821]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e, portal: 172.16.0.220,3260] successful.
Nov 06 13:25:03 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a758a39b-c2d3-4115-8346-9bac922081b8]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] <== disconnect_volume: return (375ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:25:03 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:25:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG nova.objects.instance [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lazy-loading 'flavor' on Instance uuid be3cb35a-d45e-4e35-96fe-437a941c0244 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1da6a08a-db30-4354-92be-c47407d4af97 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "be3cb35a-d45e-4e35-96fe-437a941c0244" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.656s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "be3cb35a-d45e-4e35-96fe-437a941c0244" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.425s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Acquiring lock "be3cb35a-d45e-4e35-96fe-437a941c0244-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "be3cb35a-d45e-4e35-96fe-437a941c0244-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "be3cb35a-d45e-4e35-96fe-437a941c0244-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:25:05 user nova-compute[74821]: INFO nova.compute.manager [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Terminating instance
Nov 06 13:25:05 user nova-compute[74821]: DEBUG nova.compute.manager [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG nova.compute.manager [req-95503e21-be96-41a5-b311-4b63d45ebd39 req-87a80a9b-2464-40a3-a546-87360d7b970d service nova] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Received event network-vif-unplugged-0a9f35be-92cb-4904-998d-213bac64ebc0 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-95503e21-be96-41a5-b311-4b63d45ebd39 req-87a80a9b-2464-40a3-a546-87360d7b970d service nova] Acquiring lock "be3cb35a-d45e-4e35-96fe-437a941c0244-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-95503e21-be96-41a5-b311-4b63d45ebd39 req-87a80a9b-2464-40a3-a546-87360d7b970d service nova] Lock "be3cb35a-d45e-4e35-96fe-437a941c0244-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-95503e21-be96-41a5-b311-4b63d45ebd39 req-87a80a9b-2464-40a3-a546-87360d7b970d service nova] Lock "be3cb35a-d45e-4e35-96fe-437a941c0244-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG nova.compute.manager [req-95503e21-be96-41a5-b311-4b63d45ebd39 req-87a80a9b-2464-40a3-a546-87360d7b970d service nova] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] No waiting events found dispatching network-vif-unplugged-0a9f35be-92cb-4904-998d-213bac64ebc0 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG nova.compute.manager [req-95503e21-be96-41a5-b311-4b63d45ebd39 req-87a80a9b-2464-40a3-a546-87360d7b970d service nova] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Received event network-vif-unplugged-0a9f35be-92cb-4904-998d-213bac64ebc0 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:25:05 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Instance destroyed successfully.
Nov 06 13:25:05 user nova-compute[74821]: DEBUG nova.objects.instance [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lazy-loading 'resources' on Instance uuid be3cb35a-d45e-4e35-96fe-437a941c0244 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:20:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-75962531',display_name='tempest-VolumesSnapshotTestJSON-instance-75962531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-75962531',id=25,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDV2JFNQ4pExLc+A7YGfIw9+Y4bgVvRqXI21tJEatDX2l/abyhNM+UW5FvUQLsnRgL8Dm0hoAMzMm2+K1e+RcN/cagZViJ/7U/aNCuznZwnGcbMXTwT7nu/dndP62LKNWQ==',key_name='tempest-keypair-1439888578',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:20:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f25eb95045d145c99d728e5d007ec1b6',ramdisk_id='',reservation_id='r-26jtx0qj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1889603116',owner_user_name='tempest-VolumesSnapshotTestJSON-1889603116-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:20:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d34c030545b43f8a1ab4d071189d7fc',uuid=be3cb35a-d45e-4e35-96fe-437a941c0244,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a9f35be-92cb-4904-998d-213bac64ebc0", "address": "fa:16:3e:a8:3b:43", "network": {"id": "9fe30aa2-5c5b-448b-8bd5-cdeda2721e6b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2097801930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f25eb95045d145c99d728e5d007ec1b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a9f35be-92", "ovs_interfaceid": "0a9f35be-92cb-4904-998d-213bac64ebc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Converting VIF {"id": "0a9f35be-92cb-4904-998d-213bac64ebc0", "address": "fa:16:3e:a8:3b:43", "network": {"id": "9fe30aa2-5c5b-448b-8bd5-cdeda2721e6b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2097801930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f25eb95045d145c99d728e5d007ec1b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a9f35be-92", "ovs_interfaceid": "0a9f35be-92cb-4904-998d-213bac64ebc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:3b:43,bridge_name='br-int',has_traffic_filtering=True,id=0a9f35be-92cb-4904-998d-213bac64ebc0,network=Network(9fe30aa2-5c5b-448b-8bd5-cdeda2721e6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a9f35be-92') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG os_vif [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:3b:43,bridge_name='br-int',has_traffic_filtering=True,id=0a9f35be-92cb-4904-998d-213bac64ebc0,network=Network(9fe30aa2-5c5b-448b-8bd5-cdeda2721e6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a9f35be-92') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a9f35be-92, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ec166faf-c524-407e-a6bd-54ec8ece465c) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:25:05 user nova-compute[74821]: INFO os_vif [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:3b:43,bridge_name='br-int',has_traffic_filtering=True,id=0a9f35be-92cb-4904-998d-213bac64ebc0,network=Network(9fe30aa2-5c5b-448b-8bd5-cdeda2721e6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a9f35be-92')
Nov 06 13:25:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'blJIYnvR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:25:05 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:25:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[783bda61-a912-45e3-b076-6172c3c81e48]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:25:05 user nova-compute[74821]: No targets found.
Nov 06 13:25:05 user nova-compute[74821]: iSNS:
Nov 06 13:25:05 user nova-compute[74821]: No targets found.
Nov 06 13:25:05 user nova-compute[74821]: STATIC:
Nov 06 13:25:05 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116
Nov 06 13:25:05 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:25:05 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:25:05 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af
Nov 06 13:25:05 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:25:05 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:25:05 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a
Nov 06 13:25:05 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:25:05 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:25:05 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979
Nov 06 13:25:05 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:25:05 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:25:05 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0
Nov 06 13:25:05 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:25:05 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:25:05 user nova-compute[74821]: FIRMWARE:
Nov 06 13:25:05 user nova-compute[74821]: No targets found.
Nov 06 13:25:05 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:25:05 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:25:05 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56e8f341-6fcd-4f3e-8fa0-e4415103d97e', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd8d76e-bd88-4d46-8bff-700e72b03ebd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f4e5e3-442c-4a63-996e-6ca8b36efc0b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:25:05 user nova-compute[74821]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)
Nov 06 13:25:05 user nova-compute[74821]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)
Nov 06 13:25:05 user nova-compute[74821]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a (non-flash)
Nov 06 13:25:05 user nova-compute[74821]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:25:05 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:25:05 user nova-compute[74821]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)
Nov 06 13:25:05 user nova-compute[74821]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)
Nov 06 13:25:05 user nova-compute[74821]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a (non-flash)
Nov 06 13:25:05 user nova-compute[74821]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:25:05 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e405f3520>, {}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Disconnecting from: [] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.089s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] <== disconnect_volume: return (90ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:25:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:25:05 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Deleting instance files /opt/stack/data/nova/instances/be3cb35a-d45e-4e35-96fe-437a941c0244_del
Nov 06 13:25:05 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Deletion of /opt/stack/data/nova/instances/be3cb35a-d45e-4e35-96fe-437a941c0244_del complete
Nov 06 13:25:06 user nova-compute[74821]: INFO nova.compute.manager [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 06 13:25:06 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:25:06 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:25:06 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:25:07 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:25:07 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Took 1.26 seconds to deallocate network for instance.
Nov 06 13:25:07 user nova-compute[74821]: WARNING nova.volume.cinder [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Attachment bfb7ae90-8f1d-43da-a083-ad05ac0f7d72 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = bfb7ae90-8f1d-43da-a083-ad05ac0f7d72. (HTTP 404) (Request-ID: req-e6e0749a-466f-4334-844e-b92a9b8c372c)
Nov 06 13:25:07 user nova-compute[74821]: INFO nova.compute.manager [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Took 0.03 seconds to detach 1 volumes for instance.
Nov 06 13:25:07 user nova-compute[74821]: DEBUG nova.compute.manager [req-2b16004e-16e0-4465-a719-e2f9591699ad req-63f3776b-9eea-4e3f-9e18-95813950cd9e service nova] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Received event network-vif-plugged-0a9f35be-92cb-4904-998d-213bac64ebc0 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:25:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2b16004e-16e0-4465-a719-e2f9591699ad req-63f3776b-9eea-4e3f-9e18-95813950cd9e service nova] Acquiring lock "be3cb35a-d45e-4e35-96fe-437a941c0244-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:25:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2b16004e-16e0-4465-a719-e2f9591699ad req-63f3776b-9eea-4e3f-9e18-95813950cd9e service nova] Lock "be3cb35a-d45e-4e35-96fe-437a941c0244-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:25:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2b16004e-16e0-4465-a719-e2f9591699ad req-63f3776b-9eea-4e3f-9e18-95813950cd9e service nova] Lock "be3cb35a-d45e-4e35-96fe-437a941c0244-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:25:07 user nova-compute[74821]: DEBUG nova.compute.manager [req-2b16004e-16e0-4465-a719-e2f9591699ad req-63f3776b-9eea-4e3f-9e18-95813950cd9e service nova] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] No waiting events found dispatching network-vif-plugged-0a9f35be-92cb-4904-998d-213bac64ebc0 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:25:07 user nova-compute[74821]: WARNING nova.compute.manager [req-2b16004e-16e0-4465-a719-e2f9591699ad req-63f3776b-9eea-4e3f-9e18-95813950cd9e service nova] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Received unexpected event network-vif-plugged-0a9f35be-92cb-4904-998d-213bac64ebc0 for instance with vm_state active and task_state deleting.
Nov 06 13:25:07 user nova-compute[74821]: DEBUG nova.compute.manager [req-2b16004e-16e0-4465-a719-e2f9591699ad req-63f3776b-9eea-4e3f-9e18-95813950cd9e service nova] [instance: be3cb35a-d45e-4e35-96fe-437a941c0244] Received event network-vif-deleted-0a9f35be-92cb-4904-998d-213bac64ebc0 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:25:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:25:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:25:07 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:25:07 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:25:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.429s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:25:07 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Deleted allocations for instance be3cb35a-d45e-4e35-96fe-437a941c0244
Nov 06 13:25:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1a51e10a-b6ad-41db-80d0-9aa3f077379d tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "be3cb35a-d45e-4e35-96fe-437a941c0244" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.956s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:25:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:11 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 290cd798-a041-40c0-8ef9-319d3627ff82 is timed out.
Nov 06 13:25:11 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Successfully detached device vdb from instance 290cd798-a041-40c0-8ef9-319d3627ff82 from the live domain config.
Nov 06 13:25:11 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvHqMJOQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:25:11 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:25:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3f206a-0c6d-4975-874f-b240be2b78a7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:25:11 user nova-compute[74821]: No targets found.
Nov 06 13:25:11 user nova-compute[74821]: iSNS:
Nov 06 13:25:11 user nova-compute[74821]: No targets found.
Nov 06 13:25:11 user nova-compute[74821]: STATIC:
Nov 06 13:25:11 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116
Nov 06 13:25:11 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:25:11 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:25:11 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af
Nov 06 13:25:11 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:25:11 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:25:11 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a
Nov 06 13:25:11 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:25:11 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:25:11 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979
Nov 06 13:25:11 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:25:11 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:25:11 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0
Nov 06 13:25:11 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:25:11 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:25:11 user nova-compute[74821]: FIRMWARE:
Nov 06 13:25:11 user nova-compute[74821]: No targets found.
Nov 06 13:25:11 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:25:11 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:25:11 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5e406e-a743-4a34-9963-b93bd9d6a2dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8095fd9f-2106-4e6f-89fd-7e6213c85dd4]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:25:11 user nova-compute[74821]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)
Nov 06 13:25:11 user nova-compute[74821]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)
Nov 06 13:25:11 user nova-compute[74821]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a (non-flash)
Nov 06 13:25:11 user nova-compute[74821]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:25:11 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:25:11 user nova-compute[74821]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)
Nov 06 13:25:11 user nova-compute[74821]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 (non-flash)
Nov 06 13:25:11 user nova-compute[74821]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a (non-flash)
Nov 06 13:25:11 user nova-compute[74821]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:25:11 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e404d92d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116'): ({'sde'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Removing single pathed devices sde {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2217ded-f47b-44aa-939f-84a633ad3088]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ffe22e-e392-4f06-89d6-5692ab490ceb]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Flushing IO for device /dev/sde {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb58c015-e19c-4f85-83af-31acd10c17a7]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[476e535d-b76d-47aa-8914-f7fe21268588]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] SCSI volumes sde have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f531079-9bfb-435c-841c-b32b4aca9110]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec5b4de-8834-4444-88bf-25a391c38330]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116, portal: 172.16.0.220,3260]
Nov 06 13:25:11 user nova-compute[74821]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116, portal: 172.16.0.220,3260] successful.
Nov 06 13:25:11 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c27cae42-439c-4fd6-8c64-b7a0144f2116 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b53a7c-5073-4a67-b579-4ae6758e8d90]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] <== disconnect_volume: return (343ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:25:11 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:25:12 user nova-compute[74821]: DEBUG nova.objects.instance [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lazy-loading 'flavor' on Instance uuid 290cd798-a041-40c0-8ef9-319d3627ff82 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:25:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f2c7c126-e355-4c3a-9325-12f1038bb84c tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "290cd798-a041-40c0-8ef9-319d3627ff82" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.114s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:25:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "1290bdb3-827f-4365-a4f1-4ae063de780d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:25:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "1290bdb3-827f-4365-a4f1-4ae063de780d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:25:13 user nova-compute[74821]: DEBUG nova.compute.manager [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:25:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:25:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:25:13 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:25:13 user nova-compute[74821]: INFO nova.compute.claims [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Claim successful on node user
Nov 06 13:25:13 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:25:13 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:25:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.726s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:25:13 user nova-compute[74821]: DEBUG nova.compute.manager [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:25:14 user nova-compute[74821]: DEBUG nova.compute.manager [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:25:14 user nova-compute[74821]: DEBUG nova.network.neutron [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:25:14 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:25:14 user nova-compute[74821]: DEBUG nova.compute.manager [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:25:14 user nova-compute[74821]: DEBUG nova.policy [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '133932d1063241078d84731624e89216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745a322931e4150b12d139bfb17b94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:25:14 user nova-compute[74821]: DEBUG nova.compute.manager [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:25:14 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:25:14 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Creating image(s)
Nov 06 13:25:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "/opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:25:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "/opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:25:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "/opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:25:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.203s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:25:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:25:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.232s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk 1073741824" returned: 0 in 0.049s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:25:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.217s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:14 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:25:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:15 user nova-compute[74821]: DEBUG nova.network.neutron [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Successfully created port: 289e941f-a075-4d4c-804a-7fe3d666037c {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:25:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:15 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Cannot resize image /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:25:15 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:25:15 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Ensure instance console log exists: /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:25:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:25:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:25:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:25:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG nova.network.neutron [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Successfully updated port: 289e941f-a075-4d4c-804a-7fe3d666037c {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "refresh_cache-1290bdb3-827f-4365-a4f1-4ae063de780d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquired lock "refresh_cache-1290bdb3-827f-4365-a4f1-4ae063de780d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG nova.network.neutron [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG nova.compute.manager [req-6eea1a50-d977-495e-aa38-5c6dd51ad9b4 req-daf3e364-79c2-4e8f-a319-68d85bafc339 service nova] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Received event network-changed-289e941f-a075-4d4c-804a-7fe3d666037c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG nova.compute.manager [req-6eea1a50-d977-495e-aa38-5c6dd51ad9b4 req-daf3e364-79c2-4e8f-a319-68d85bafc339 service nova] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Refreshing instance network info cache due to event network-changed-289e941f-a075-4d4c-804a-7fe3d666037c. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6eea1a50-d977-495e-aa38-5c6dd51ad9b4 req-daf3e364-79c2-4e8f-a319-68d85bafc339 service nova] Acquiring lock "refresh_cache-1290bdb3-827f-4365-a4f1-4ae063de780d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG nova.network.neutron [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG nova.network.neutron [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Updating instance_info_cache with network_info: [{"id": "289e941f-a075-4d4c-804a-7fe3d666037c", "address": "fa:16:3e:be:ab:5c", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap289e941f-a0", "ovs_interfaceid": "289e941f-a075-4d4c-804a-7fe3d666037c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Releasing lock "refresh_cache-1290bdb3-827f-4365-a4f1-4ae063de780d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG nova.compute.manager [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Instance network_info: |[{"id": "289e941f-a075-4d4c-804a-7fe3d666037c", "address": "fa:16:3e:be:ab:5c", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap289e941f-a0", "ovs_interfaceid": "289e941f-a075-4d4c-804a-7fe3d666037c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6eea1a50-d977-495e-aa38-5c6dd51ad9b4 req-daf3e364-79c2-4e8f-a319-68d85bafc339 service nova] Acquired lock "refresh_cache-1290bdb3-827f-4365-a4f1-4ae063de780d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG nova.network.neutron [req-6eea1a50-d977-495e-aa38-5c6dd51ad9b4 req-daf3e364-79c2-4e8f-a319-68d85bafc339 service nova] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Refreshing network info cache for port 289e941f-a075-4d4c-804a-7fe3d666037c {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Start _get_guest_xml network_info=[{"id": "289e941f-a075-4d4c-804a-7fe3d666037c", "address": "fa:16:3e:be:ab:5c", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap289e941f-a0", "ovs_interfaceid": "289e941f-a075-4d4c-804a-7fe3d666037c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:25:16 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:25:16 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:25:16 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:25:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1082951085',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1082951085',id=28,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f745a322931e4150b12d139bfb17b94c',ramdisk_id='',reservation_id='r-taz4lj5q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1064633830',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:25:14Z,user_data=None,user_id='133932d1063241078d84731624e89216',uuid=1290bdb3-827f-4365-a4f1-4ae063de780d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "289e941f-a075-4d4c-804a-7fe3d666037c", "address": "fa:16:3e:be:ab:5c", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap289e941f-a0", "ovs_interfaceid": "289e941f-a075-4d4c-804a-7fe3d666037c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Converting VIF {"id": "289e941f-a075-4d4c-804a-7fe3d666037c", "address": "fa:16:3e:be:ab:5c", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap289e941f-a0", "ovs_interfaceid": "289e941f-a075-4d4c-804a-7fe3d666037c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:ab:5c,bridge_name='br-int',has_traffic_filtering=True,id=289e941f-a075-4d4c-804a-7fe3d666037c,network=Network(354bf335-0cac-46d9-acb8-5095411f5db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap289e941f-a0') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG nova.objects.instance [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lazy-loading 'pci_devices' on Instance uuid 1290bdb3-827f-4365-a4f1-4ae063de780d {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:25:16 user nova-compute[74821]:   <uuid>1290bdb3-827f-4365-a4f1-4ae063de780d</uuid>
Nov 06 13:25:16 user nova-compute[74821]:   <name>instance-0000001c</name>
Nov 06 13:25:16 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:25:16 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:25:16 user nova-compute[74821]:   <metadata>
Nov 06 13:25:16 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:25:16 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:25:16 user nova-compute[74821]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1082951085</nova:name>
Nov 06 13:25:16 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:25:16</nova:creationTime>
Nov 06 13:25:16 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:25:16 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:25:16 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:25:16 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:25:16 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:25:16 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:25:16 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:25:16 user nova-compute[74821]:       <nova:owner>
Nov 06 13:25:16 user nova-compute[74821]:         <nova:user uuid="133932d1063241078d84731624e89216">tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member</nova:user>
Nov 06 13:25:16 user nova-compute[74821]:         <nova:project uuid="f745a322931e4150b12d139bfb17b94c">tempest-ServerBootFromVolumeStableRescueTest-1064633830</nova:project>
Nov 06 13:25:16 user nova-compute[74821]:       </nova:owner>
Nov 06 13:25:16 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:25:16 user nova-compute[74821]:       <nova:ports>
Nov 06 13:25:16 user nova-compute[74821]:         <nova:port uuid="289e941f-a075-4d4c-804a-7fe3d666037c">
Nov 06 13:25:16 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 06 13:25:16 user nova-compute[74821]:         </nova:port>
Nov 06 13:25:16 user nova-compute[74821]:       </nova:ports>
Nov 06 13:25:16 user nova-compute[74821]:     </nova:instance>
Nov 06 13:25:16 user nova-compute[74821]:   </metadata>
Nov 06 13:25:16 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:25:16 user nova-compute[74821]:     <system>
Nov 06 13:25:16 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:25:16 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:25:16 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:25:16 user nova-compute[74821]:       <entry name="serial">1290bdb3-827f-4365-a4f1-4ae063de780d</entry>
Nov 06 13:25:16 user nova-compute[74821]:       <entry name="uuid">1290bdb3-827f-4365-a4f1-4ae063de780d</entry>
Nov 06 13:25:16 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:25:16 user nova-compute[74821]:     </system>
Nov 06 13:25:16 user nova-compute[74821]:   </sysinfo>
Nov 06 13:25:16 user nova-compute[74821]:   <os>
Nov 06 13:25:16 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:25:16 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:25:16 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:25:16 user nova-compute[74821]:   </os>
Nov 06 13:25:16 user nova-compute[74821]:   <features>
Nov 06 13:25:16 user nova-compute[74821]:     <acpi/>
Nov 06 13:25:16 user nova-compute[74821]:     <apic/>
Nov 06 13:25:16 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:25:16 user nova-compute[74821]:   </features>
Nov 06 13:25:16 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:25:16 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:25:16 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:25:16 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:25:16 user nova-compute[74821]:   </clock>
Nov 06 13:25:16 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:25:16 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:25:16 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:25:16 user nova-compute[74821]:   </cpu>
Nov 06 13:25:16 user nova-compute[74821]:   <devices>
Nov 06 13:25:16 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:25:16 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:25:16 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk"/>
Nov 06 13:25:16 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:25:16 user nova-compute[74821]:     </disk>
Nov 06 13:25:16 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:25:16 user nova-compute[74821]:       <mac address="fa:16:3e:be:ab:5c"/>
Nov 06 13:25:16 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:25:16 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:25:16 user nova-compute[74821]:       <target dev="tap289e941f-a0"/>
Nov 06 13:25:16 user nova-compute[74821]:     </interface>
Nov 06 13:25:16 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:25:16 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/console.log" append="off"/>
Nov 06 13:25:16 user nova-compute[74821]:     </serial>
Nov 06 13:25:16 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:25:16 user nova-compute[74821]:     <video>
Nov 06 13:25:16 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:25:16 user nova-compute[74821]:     </video>
Nov 06 13:25:16 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:25:16 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:25:16 user nova-compute[74821]:     </rng>
Nov 06 13:25:16 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:25:16 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:25:16 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:25:16 user nova-compute[74821]:     </memballoon>
Nov 06 13:25:16 user nova-compute[74821]:   </devices>
Nov 06 13:25:16 user nova-compute[74821]: </domain>
Nov 06 13:25:16 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:25:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1082951085',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1082951085',id=28,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f745a322931e4150b12d139bfb17b94c',ramdisk_id='',reservation_id='r-taz4lj5q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1064633830',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:25:14Z,user_data=None,user_id='133932d1063241078d84731624e89216',uuid=1290bdb3-827f-4365-a4f1-4ae063de780d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "289e941f-a075-4d4c-804a-7fe3d666037c", "address": "fa:16:3e:be:ab:5c", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap289e941f-a0", "ovs_interfaceid": "289e941f-a075-4d4c-804a-7fe3d666037c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Converting VIF {"id": "289e941f-a075-4d4c-804a-7fe3d666037c", "address": "fa:16:3e:be:ab:5c", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap289e941f-a0", "ovs_interfaceid": "289e941f-a075-4d4c-804a-7fe3d666037c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:ab:5c,bridge_name='br-int',has_traffic_filtering=True,id=289e941f-a075-4d4c-804a-7fe3d666037c,network=Network(354bf335-0cac-46d9-acb8-5095411f5db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap289e941f-a0') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG os_vif [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:ab:5c,bridge_name='br-int',has_traffic_filtering=True,id=289e941f-a075-4d4c-804a-7fe3d666037c,network=Network(354bf335-0cac-46d9-acb8-5095411f5db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap289e941f-a0') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b3ad09f2-cf27-58e8-a61d-3231d945a782', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap289e941f-a0, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap289e941f-a0, col_values=(('qos', UUID('246a633a-fc7a-4b4b-bfbd-31d6440b4323')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap289e941f-a0, col_values=(('external_ids', {'iface-id': '289e941f-a075-4d4c-804a-7fe3d666037c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:ab:5c', 'vm-uuid': '1290bdb3-827f-4365-a4f1-4ae063de780d'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:16 user nova-compute[74821]: INFO os_vif [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:ab:5c,bridge_name='br-int',has_traffic_filtering=True,id=289e941f-a075-4d4c-804a-7fe3d666037c,network=Network(354bf335-0cac-46d9-acb8-5095411f5db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap289e941f-a0')
Nov 06 13:25:16 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:25:16 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] No VIF found with MAC fa:16:3e:be:ab:5c, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:25:17 user nova-compute[74821]: DEBUG nova.network.neutron [req-6eea1a50-d977-495e-aa38-5c6dd51ad9b4 req-daf3e364-79c2-4e8f-a319-68d85bafc339 service nova] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Updated VIF entry in instance network info cache for port 289e941f-a075-4d4c-804a-7fe3d666037c. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:25:17 user nova-compute[74821]: DEBUG nova.network.neutron [req-6eea1a50-d977-495e-aa38-5c6dd51ad9b4 req-daf3e364-79c2-4e8f-a319-68d85bafc339 service nova] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Updating instance_info_cache with network_info: [{"id": "289e941f-a075-4d4c-804a-7fe3d666037c", "address": "fa:16:3e:be:ab:5c", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap289e941f-a0", "ovs_interfaceid": "289e941f-a075-4d4c-804a-7fe3d666037c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:25:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6eea1a50-d977-495e-aa38-5c6dd51ad9b4 req-daf3e364-79c2-4e8f-a319-68d85bafc339 service nova] Releasing lock "refresh_cache-1290bdb3-827f-4365-a4f1-4ae063de780d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:25:18 user nova-compute[74821]: DEBUG nova.compute.manager [req-c3f5013d-8d40-4b7f-a70d-7e0223522a0c req-df123697-6b99-4a2f-82e2-06c7139408b3 service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received event network-changed-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:25:18 user nova-compute[74821]: DEBUG nova.compute.manager [req-c3f5013d-8d40-4b7f-a70d-7e0223522a0c req-df123697-6b99-4a2f-82e2-06c7139408b3 service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Refreshing instance network info cache due to event network-changed-b5020053-395f-4341-99be-d522ebb938c7. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:25:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c3f5013d-8d40-4b7f-a70d-7e0223522a0c req-df123697-6b99-4a2f-82e2-06c7139408b3 service nova] Acquiring lock "refresh_cache-61beb251-4345-44e6-a176-5c14c99c9a52" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:25:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c3f5013d-8d40-4b7f-a70d-7e0223522a0c req-df123697-6b99-4a2f-82e2-06c7139408b3 service nova] Acquired lock "refresh_cache-61beb251-4345-44e6-a176-5c14c99c9a52" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:25:18 user nova-compute[74821]: DEBUG nova.network.neutron [req-c3f5013d-8d40-4b7f-a70d-7e0223522a0c req-df123697-6b99-4a2f-82e2-06c7139408b3 service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Refreshing network info cache for port b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:25:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "61beb251-4345-44e6-a176-5c14c99c9a52" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:25:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "61beb251-4345-44e6-a176-5c14c99c9a52" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:25:18 user nova-compute[74821]: INFO nova.compute.manager [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Detaching volume 49867154-3b9b-4759-9ffc-dd03572f28f0
Nov 06 13:25:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:18 user nova-compute[74821]: INFO nova.virt.block_device [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Attempting to driver detach volume 49867154-3b9b-4759-9ffc-dd03572f28f0 from mountpoint /dev/vdb
Nov 06 13:25:18 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Attempting to detach device vdb from instance 61beb251-4345-44e6-a176-5c14c99c9a52 from the persistent domain config. {{(pid=74821) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 13:25:18 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:25:18 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:25:18 user nova-compute[74821]:   <source dev="/dev/sdb"/>
Nov 06 13:25:18 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:25:18 user nova-compute[74821]:   <serial>49867154-3b9b-4759-9ffc-dd03572f28f0</serial>
Nov 06 13:25:18 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:25:18 user nova-compute[74821]: </disk>
Nov 06 13:25:18 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:25:18 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Successfully detached device vdb from instance 61beb251-4345-44e6-a176-5c14c99c9a52 from the persistent domain config.
Nov 06 13:25:18 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 61beb251-4345-44e6-a176-5c14c99c9a52 from the live domain config. {{(pid=74821) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 13:25:18 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:25:18 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:25:18 user nova-compute[74821]:   <source dev="/dev/sdb"/>
Nov 06 13:25:18 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:25:18 user nova-compute[74821]:   <serial>49867154-3b9b-4759-9ffc-dd03572f28f0</serial>
Nov 06 13:25:18 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:25:18 user nova-compute[74821]: </disk>
Nov 06 13:25:18 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:25:18 user nova-compute[74821]: DEBUG nova.compute.manager [req-ea6a5809-d932-46b2-b923-ca49d93ee9fc req-32e1084f-c845-41d9-9486-0e6674ae868c service nova] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Received event network-vif-plugged-289e941f-a075-4d4c-804a-7fe3d666037c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:25:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ea6a5809-d932-46b2-b923-ca49d93ee9fc req-32e1084f-c845-41d9-9486-0e6674ae868c service nova] Acquiring lock "1290bdb3-827f-4365-a4f1-4ae063de780d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:25:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ea6a5809-d932-46b2-b923-ca49d93ee9fc req-32e1084f-c845-41d9-9486-0e6674ae868c service nova] Lock "1290bdb3-827f-4365-a4f1-4ae063de780d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:25:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ea6a5809-d932-46b2-b923-ca49d93ee9fc req-32e1084f-c845-41d9-9486-0e6674ae868c service nova] Lock "1290bdb3-827f-4365-a4f1-4ae063de780d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:25:18 user nova-compute[74821]: DEBUG nova.compute.manager [req-ea6a5809-d932-46b2-b923-ca49d93ee9fc req-32e1084f-c845-41d9-9486-0e6674ae868c service nova] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] No waiting events found dispatching network-vif-plugged-289e941f-a075-4d4c-804a-7fe3d666037c {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:25:18 user nova-compute[74821]: WARNING nova.compute.manager [req-ea6a5809-d932-46b2-b923-ca49d93ee9fc req-32e1084f-c845-41d9-9486-0e6674ae868c service nova] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Received unexpected event network-vif-plugged-289e941f-a075-4d4c-804a-7fe3d666037c for instance with vm_state building and task_state spawning.
Nov 06 13:25:19 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 61beb251-4345-44e6-a176-5c14c99c9a52 {{(pid=74821) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 13:25:19 user nova-compute[74821]: DEBUG nova.network.neutron [req-c3f5013d-8d40-4b7f-a70d-7e0223522a0c req-df123697-6b99-4a2f-82e2-06c7139408b3 service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Updated VIF entry in instance network info cache for port b5020053-395f-4341-99be-d522ebb938c7. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:25:19 user nova-compute[74821]: DEBUG nova.network.neutron [req-c3f5013d-8d40-4b7f-a70d-7e0223522a0c req-df123697-6b99-4a2f-82e2-06c7139408b3 service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Updating instance_info_cache with network_info: [{"id": "b5020053-395f-4341-99be-d522ebb938c7", "address": "fa:16:3e:d4:3e:f8", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5020053-39", "ovs_interfaceid": "b5020053-395f-4341-99be-d522ebb938c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:25:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c3f5013d-8d40-4b7f-a70d-7e0223522a0c req-df123697-6b99-4a2f-82e2-06c7139408b3 service nova] Releasing lock "refresh_cache-61beb251-4345-44e6-a176-5c14c99c9a52" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:25:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:20 user nova-compute[74821]: DEBUG nova.compute.manager [req-37318b4d-0336-4908-a815-106e6ca81c1a req-a09e4a0c-4e0b-4b1d-a8ec-eccc820eaa5c service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received event network-changed-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:25:20 user nova-compute[74821]: DEBUG nova.compute.manager [req-37318b4d-0336-4908-a815-106e6ca81c1a req-a09e4a0c-4e0b-4b1d-a8ec-eccc820eaa5c service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Refreshing instance network info cache due to event network-changed-b5020053-395f-4341-99be-d522ebb938c7. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:25:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-37318b4d-0336-4908-a815-106e6ca81c1a req-a09e4a0c-4e0b-4b1d-a8ec-eccc820eaa5c service nova] Acquiring lock "refresh_cache-61beb251-4345-44e6-a176-5c14c99c9a52" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:25:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-37318b4d-0336-4908-a815-106e6ca81c1a req-a09e4a0c-4e0b-4b1d-a8ec-eccc820eaa5c service nova] Acquired lock "refresh_cache-61beb251-4345-44e6-a176-5c14c99c9a52" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:25:20 user nova-compute[74821]: DEBUG nova.network.neutron [req-37318b4d-0336-4908-a815-106e6ca81c1a req-a09e4a0c-4e0b-4b1d-a8ec-eccc820eaa5c service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Refreshing network info cache for port b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:25:20 user nova-compute[74821]: DEBUG nova.compute.manager [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:25:20 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:25:20 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Instance spawned successfully.
Nov 06 13:25:20 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:25:20 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:25:20 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:25:20 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:25:20 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:25:20 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:25:20 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:25:20 user nova-compute[74821]: INFO nova.compute.manager [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Took 6.77 seconds to spawn the instance on the hypervisor.
Nov 06 13:25:20 user nova-compute[74821]: DEBUG nova.compute.manager [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:25:21 user nova-compute[74821]: DEBUG nova.compute.manager [req-fd0a0690-874a-4d93-a197-82ba993d32ea req-05a72434-152d-4a03-a0fe-ca11a263b968 service nova] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Received event network-vif-plugged-289e941f-a075-4d4c-804a-7fe3d666037c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:25:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fd0a0690-874a-4d93-a197-82ba993d32ea req-05a72434-152d-4a03-a0fe-ca11a263b968 service nova] Acquiring lock "1290bdb3-827f-4365-a4f1-4ae063de780d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:25:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fd0a0690-874a-4d93-a197-82ba993d32ea req-05a72434-152d-4a03-a0fe-ca11a263b968 service nova] Lock "1290bdb3-827f-4365-a4f1-4ae063de780d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:25:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fd0a0690-874a-4d93-a197-82ba993d32ea req-05a72434-152d-4a03-a0fe-ca11a263b968 service nova] Lock "1290bdb3-827f-4365-a4f1-4ae063de780d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:25:21 user nova-compute[74821]: DEBUG nova.compute.manager [req-fd0a0690-874a-4d93-a197-82ba993d32ea req-05a72434-152d-4a03-a0fe-ca11a263b968 service nova] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] No waiting events found dispatching network-vif-plugged-289e941f-a075-4d4c-804a-7fe3d666037c {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:25:21 user nova-compute[74821]: WARNING nova.compute.manager [req-fd0a0690-874a-4d93-a197-82ba993d32ea req-05a72434-152d-4a03-a0fe-ca11a263b968 service nova] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Received unexpected event network-vif-plugged-289e941f-a075-4d4c-804a-7fe3d666037c for instance with vm_state building and task_state spawning.
Nov 06 13:25:21 user nova-compute[74821]: INFO nova.compute.manager [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Took 7.94 seconds to build instance.
Nov 06 13:25:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cca533bb-2971-4aa9-af94-3f8bfe886fcf tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "1290bdb3-827f-4365-a4f1-4ae063de780d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.056s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:25:21 user nova-compute[74821]: INFO nova.compute.manager [None req-ea909dc7-7e43-4906-8363-472d4ee64aeb tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Unrescuing
Nov 06 13:25:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ea909dc7-7e43-4906-8363-472d4ee64aeb tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Acquiring lock "refresh_cache-5a07f64b-5b12-4e7d-a041-ad591141aa17" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:25:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ea909dc7-7e43-4906-8363-472d4ee64aeb tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Acquired lock "refresh_cache-5a07f64b-5b12-4e7d-a041-ad591141aa17" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:25:21 user nova-compute[74821]: DEBUG nova.network.neutron [None req-ea909dc7-7e43-4906-8363-472d4ee64aeb tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:25:21 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:21 user nova-compute[74821]: DEBUG nova.network.neutron [req-37318b4d-0336-4908-a815-106e6ca81c1a req-a09e4a0c-4e0b-4b1d-a8ec-eccc820eaa5c service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Updated VIF entry in instance network info cache for port b5020053-395f-4341-99be-d522ebb938c7. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:25:21 user nova-compute[74821]: DEBUG nova.network.neutron [req-37318b4d-0336-4908-a815-106e6ca81c1a req-a09e4a0c-4e0b-4b1d-a8ec-eccc820eaa5c service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Updating instance_info_cache with network_info: [{"id": "b5020053-395f-4341-99be-d522ebb938c7", "address": "fa:16:3e:d4:3e:f8", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5020053-39", "ovs_interfaceid": "b5020053-395f-4341-99be-d522ebb938c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:25:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-37318b4d-0336-4908-a815-106e6ca81c1a req-a09e4a0c-4e0b-4b1d-a8ec-eccc820eaa5c service nova] Releasing lock "refresh_cache-61beb251-4345-44e6-a176-5c14c99c9a52" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:25:21 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:21 user nova-compute[74821]: DEBUG nova.network.neutron [None req-ea909dc7-7e43-4906-8363-472d4ee64aeb tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Updating instance_info_cache with network_info: [{"id": "db18095e-82aa-407a-b43f-5f060b8c64ec", "address": "fa:16:3e:30:ef:48", "network": {"id": "79eddc13-4e87-497c-af1f-ce215f23e831", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412663699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d867544bce424f90bcb0403e953f59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb18095e-82", "ovs_interfaceid": "db18095e-82aa-407a-b43f-5f060b8c64ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:25:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ea909dc7-7e43-4906-8363-472d4ee64aeb tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Releasing lock "refresh_cache-5a07f64b-5b12-4e7d-a041-ad591141aa17" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:25:21 user nova-compute[74821]: DEBUG nova.objects.instance [None req-ea909dc7-7e43-4906-8363-472d4ee64aeb tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lazy-loading 'flavor' on Instance uuid 5a07f64b-5b12-4e7d-a041-ad591141aa17 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:25:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:22 user nova-compute[74821]: DEBUG nova.compute.manager [req-7cdf7481-04d1-4252-90de-8fc7b1c749e6 req-85152f2a-645b-46dc-99ae-14eec9543ec4 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received event network-vif-unplugged-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:25:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-7cdf7481-04d1-4252-90de-8fc7b1c749e6 req-85152f2a-645b-46dc-99ae-14eec9543ec4 service nova] Acquiring lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:25:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-7cdf7481-04d1-4252-90de-8fc7b1c749e6 req-85152f2a-645b-46dc-99ae-14eec9543ec4 service nova] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:25:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-7cdf7481-04d1-4252-90de-8fc7b1c749e6 req-85152f2a-645b-46dc-99ae-14eec9543ec4 service nova] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:25:22 user nova-compute[74821]: DEBUG nova.compute.manager [req-7cdf7481-04d1-4252-90de-8fc7b1c749e6 req-85152f2a-645b-46dc-99ae-14eec9543ec4 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] No waiting events found dispatching network-vif-unplugged-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:25:22 user nova-compute[74821]: WARNING nova.compute.manager [req-7cdf7481-04d1-4252-90de-8fc7b1c749e6 req-85152f2a-645b-46dc-99ae-14eec9543ec4 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received unexpected event network-vif-unplugged-db18095e-82aa-407a-b43f-5f060b8c64ec for instance with vm_state rescued and task_state unrescuing.
Nov 06 13:25:23 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Instance destroyed successfully.
Nov 06 13:25:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:24 user nova-compute[74821]: DEBUG nova.compute.manager [req-2871828e-d6b8-45fd-8217-0727af386a2b req-2ae17e06-031d-49d0-86aa-24bae2d5615e service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received event network-vif-plugged-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:25:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2871828e-d6b8-45fd-8217-0727af386a2b req-2ae17e06-031d-49d0-86aa-24bae2d5615e service nova] Acquiring lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:25:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2871828e-d6b8-45fd-8217-0727af386a2b req-2ae17e06-031d-49d0-86aa-24bae2d5615e service nova] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:25:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2871828e-d6b8-45fd-8217-0727af386a2b req-2ae17e06-031d-49d0-86aa-24bae2d5615e service nova] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:25:24 user nova-compute[74821]: DEBUG nova.compute.manager [req-2871828e-d6b8-45fd-8217-0727af386a2b req-2ae17e06-031d-49d0-86aa-24bae2d5615e service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] No waiting events found dispatching network-vif-plugged-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:25:24 user nova-compute[74821]: WARNING nova.compute.manager [req-2871828e-d6b8-45fd-8217-0727af386a2b req-2ae17e06-031d-49d0-86aa-24bae2d5615e service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received unexpected event network-vif-plugged-db18095e-82aa-407a-b43f-5f060b8c64ec for instance with vm_state rescued and task_state unrescuing.
Nov 06 13:25:24 user nova-compute[74821]: DEBUG nova.compute.manager [req-2871828e-d6b8-45fd-8217-0727af386a2b req-2ae17e06-031d-49d0-86aa-24bae2d5615e service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received event network-changed-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:25:24 user nova-compute[74821]: DEBUG nova.compute.manager [req-2871828e-d6b8-45fd-8217-0727af386a2b req-2ae17e06-031d-49d0-86aa-24bae2d5615e service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Refreshing instance network info cache due to event network-changed-db18095e-82aa-407a-b43f-5f060b8c64ec. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:25:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2871828e-d6b8-45fd-8217-0727af386a2b req-2ae17e06-031d-49d0-86aa-24bae2d5615e service nova] Acquiring lock "refresh_cache-5a07f64b-5b12-4e7d-a041-ad591141aa17" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:25:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2871828e-d6b8-45fd-8217-0727af386a2b req-2ae17e06-031d-49d0-86aa-24bae2d5615e service nova] Acquired lock "refresh_cache-5a07f64b-5b12-4e7d-a041-ad591141aa17" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:25:24 user nova-compute[74821]: DEBUG nova.network.neutron [req-2871828e-d6b8-45fd-8217-0727af386a2b req-2ae17e06-031d-49d0-86aa-24bae2d5615e service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Refreshing network info cache for port db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:25:25 user nova-compute[74821]: DEBUG nova.network.neutron [req-2871828e-d6b8-45fd-8217-0727af386a2b req-2ae17e06-031d-49d0-86aa-24bae2d5615e service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Updated VIF entry in instance network info cache for port db18095e-82aa-407a-b43f-5f060b8c64ec. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:25:25 user nova-compute[74821]: DEBUG nova.network.neutron [req-2871828e-d6b8-45fd-8217-0727af386a2b req-2ae17e06-031d-49d0-86aa-24bae2d5615e service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Updating instance_info_cache with network_info: [{"id": "db18095e-82aa-407a-b43f-5f060b8c64ec", "address": "fa:16:3e:30:ef:48", "network": {"id": "79eddc13-4e87-497c-af1f-ce215f23e831", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412663699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d867544bce424f90bcb0403e953f59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb18095e-82", "ovs_interfaceid": "db18095e-82aa-407a-b43f-5f060b8c64ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:25:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2871828e-d6b8-45fd-8217-0727af386a2b req-2ae17e06-031d-49d0-86aa-24bae2d5615e service nova] Releasing lock "refresh_cache-5a07f64b-5b12-4e7d-a041-ad591141aa17" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:25:25 user nova-compute[74821]: DEBUG nova.compute.manager [req-2871828e-d6b8-45fd-8217-0727af386a2b req-2ae17e06-031d-49d0-86aa-24bae2d5615e service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received event network-changed-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:25:25 user nova-compute[74821]: DEBUG nova.compute.manager [req-2871828e-d6b8-45fd-8217-0727af386a2b req-2ae17e06-031d-49d0-86aa-24bae2d5615e service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Refreshing instance network info cache due to event network-changed-db18095e-82aa-407a-b43f-5f060b8c64ec. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:25:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2871828e-d6b8-45fd-8217-0727af386a2b req-2ae17e06-031d-49d0-86aa-24bae2d5615e service nova] Acquiring lock "refresh_cache-5a07f64b-5b12-4e7d-a041-ad591141aa17" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:25:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2871828e-d6b8-45fd-8217-0727af386a2b req-2ae17e06-031d-49d0-86aa-24bae2d5615e service nova] Acquired lock "refresh_cache-5a07f64b-5b12-4e7d-a041-ad591141aa17" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:25:25 user nova-compute[74821]: DEBUG nova.network.neutron [req-2871828e-d6b8-45fd-8217-0727af386a2b req-2ae17e06-031d-49d0-86aa-24bae2d5615e service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Refreshing network info cache for port db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:25:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:26 user nova-compute[74821]: DEBUG nova.network.neutron [req-2871828e-d6b8-45fd-8217-0727af386a2b req-2ae17e06-031d-49d0-86aa-24bae2d5615e service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Updated VIF entry in instance network info cache for port db18095e-82aa-407a-b43f-5f060b8c64ec. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:25:26 user nova-compute[74821]: DEBUG nova.network.neutron [req-2871828e-d6b8-45fd-8217-0727af386a2b req-2ae17e06-031d-49d0-86aa-24bae2d5615e service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Updating instance_info_cache with network_info: [{"id": "db18095e-82aa-407a-b43f-5f060b8c64ec", "address": "fa:16:3e:30:ef:48", "network": {"id": "79eddc13-4e87-497c-af1f-ce215f23e831", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412663699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d867544bce424f90bcb0403e953f59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb18095e-82", "ovs_interfaceid": "db18095e-82aa-407a-b43f-5f060b8c64ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:25:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2871828e-d6b8-45fd-8217-0727af386a2b req-2ae17e06-031d-49d0-86aa-24bae2d5615e service nova] Releasing lock "refresh_cache-5a07f64b-5b12-4e7d-a041-ad591141aa17" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:25:26 user nova-compute[74821]: DEBUG nova.compute.manager [req-2871828e-d6b8-45fd-8217-0727af386a2b req-2ae17e06-031d-49d0-86aa-24bae2d5615e service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received event network-vif-plugged-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:25:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2871828e-d6b8-45fd-8217-0727af386a2b req-2ae17e06-031d-49d0-86aa-24bae2d5615e service nova] Acquiring lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:25:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2871828e-d6b8-45fd-8217-0727af386a2b req-2ae17e06-031d-49d0-86aa-24bae2d5615e service nova] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:25:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2871828e-d6b8-45fd-8217-0727af386a2b req-2ae17e06-031d-49d0-86aa-24bae2d5615e service nova] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:25:26 user nova-compute[74821]: DEBUG nova.compute.manager [req-2871828e-d6b8-45fd-8217-0727af386a2b req-2ae17e06-031d-49d0-86aa-24bae2d5615e service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] No waiting events found dispatching network-vif-plugged-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:25:26 user nova-compute[74821]: WARNING nova.compute.manager [req-2871828e-d6b8-45fd-8217-0727af386a2b req-2ae17e06-031d-49d0-86aa-24bae2d5615e service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received unexpected event network-vif-plugged-db18095e-82aa-407a-b43f-5f060b8c64ec for instance with vm_state rescued and task_state unrescuing.
Nov 06 13:25:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:27 user nova-compute[74821]: DEBUG nova.compute.manager [req-b06c52d8-45ae-427f-8df0-87d5a51b0ea0 req-e1779083-e24c-4abb-9109-32ed7f8eb750 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received event network-vif-plugged-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:25:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b06c52d8-45ae-427f-8df0-87d5a51b0ea0 req-e1779083-e24c-4abb-9109-32ed7f8eb750 service nova] Acquiring lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:25:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b06c52d8-45ae-427f-8df0-87d5a51b0ea0 req-e1779083-e24c-4abb-9109-32ed7f8eb750 service nova] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:25:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b06c52d8-45ae-427f-8df0-87d5a51b0ea0 req-e1779083-e24c-4abb-9109-32ed7f8eb750 service nova] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:25:27 user nova-compute[74821]: DEBUG nova.compute.manager [req-b06c52d8-45ae-427f-8df0-87d5a51b0ea0 req-e1779083-e24c-4abb-9109-32ed7f8eb750 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] No waiting events found dispatching network-vif-plugged-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:25:27 user nova-compute[74821]: WARNING nova.compute.manager [req-b06c52d8-45ae-427f-8df0-87d5a51b0ea0 req-e1779083-e24c-4abb-9109-32ed7f8eb750 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received unexpected event network-vif-plugged-db18095e-82aa-407a-b43f-5f060b8c64ec for instance with vm_state rescued and task_state unrescuing.
Nov 06 13:25:27 user nova-compute[74821]: DEBUG nova.compute.manager [None req-ea909dc7-7e43-4906-8363-472d4ee64aeb tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:25:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:31 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:34 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:25:34 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:25:35 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:25:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:36 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:25:36 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:25:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-5a07f64b-5b12-4e7d-a041-ad591141aa17" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:25:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-5a07f64b-5b12-4e7d-a041-ad591141aa17" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:25:37 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:25:37 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Updating instance_info_cache with network_info: [{"id": "db18095e-82aa-407a-b43f-5f060b8c64ec", "address": "fa:16:3e:30:ef:48", "network": {"id": "79eddc13-4e87-497c-af1f-ce215f23e831", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412663699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d867544bce424f90bcb0403e953f59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb18095e-82", "ovs_interfaceid": "db18095e-82aa-407a-b43f-5f060b8c64ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:25:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-5a07f64b-5b12-4e7d-a041-ad591141aa17" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:25:37 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:25:37 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:25:37 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:25:37 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:25:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Acquiring lock "d42894d4-98df-46dc-a8e9-137035b948a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:25:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Lock "d42894d4-98df-46dc-a8e9-137035b948a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:25:38 user nova-compute[74821]: DEBUG nova.compute.manager [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:25:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:25:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:25:38 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:25:38 user nova-compute[74821]: INFO nova.compute.claims [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Claim successful on node user
Nov 06 13:25:39 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:25:39 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 61beb251-4345-44e6-a176-5c14c99c9a52 is timed out.
Nov 06 13:25:39 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Successfully detached device vdb from instance 61beb251-4345-44e6-a176-5c14c99c9a52 from the live domain config.
Nov 06 13:25:39 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ekCMXWZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:25:39 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:25:39 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c707013f-5fae-4668-839b-4946567b9868]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:25:39 user nova-compute[74821]: No targets found.
Nov 06 13:25:39 user nova-compute[74821]: iSNS:
Nov 06 13:25:39 user nova-compute[74821]: No targets found.
Nov 06 13:25:39 user nova-compute[74821]: STATIC:
Nov 06 13:25:39 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af
Nov 06 13:25:39 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:25:39 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:25:39 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a
Nov 06 13:25:39 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:25:39 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:25:39 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979
Nov 06 13:25:39 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:25:39 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:25:39 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0
Nov 06 13:25:39 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:25:39 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:25:39 user nova-compute[74821]: FIRMWARE:
Nov 06 13:25:39 user nova-compute[74821]: No targets found.
Nov 06 13:25:39 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:25:39 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:25:39 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG nova.compute.manager [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[df80c3e5-4dbb-4cbc-a994-a57afd140c75]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc24b7ca-6af1-4933-a7d1-4a041fe5cd4d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:25:39 user nova-compute[74821]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)
Nov 06 13:25:39 user nova-compute[74821]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a (non-flash)
Nov 06 13:25:39 user nova-compute[74821]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:25:39 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:25:39 user nova-compute[74821]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 (non-flash)
Nov 06 13:25:39 user nova-compute[74821]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a (non-flash)
Nov 06 13:25:39 user nova-compute[74821]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:25:39 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e5020e8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0'): ({'sdb'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Removing single pathed devices sdb {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG nova.compute.manager [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG nova.network.neutron [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[441e6f8c-0dde-48de-9357-fe62f42cb169]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:39 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9610b3-b0ca-4bc2-bd2f-ba380ab19cce]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Flushing IO for device /dev/sdb {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG nova.compute.manager [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a9236f-c109-4e74-90ab-a4bec893cd40]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG nova.policy [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '64aebab87680452d85cf96a0d24ac6bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f5c7747bc814d9cb56e1e52d59960ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77803b2-4d7d-4596-9add-bc443a212b3b]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] SCSI volumes sdb have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.047s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[43da505a-3ca4-4b81-b272-d80e03490543]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.120s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d81733-f16c-4555-8e0e-500542c6d4e1]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0, portal: 172.16.0.220,3260]
Nov 06 13:25:39 user nova-compute[74821]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0, portal: 172.16.0.220,3260] successful.
Nov 06 13:25:39 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49867154-3b9b-4759-9ffc-dd03572f28f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ee6176-4b30-4bda-95cd-32864dbe961c]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.419s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] <== disconnect_volume: return (421ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG nova.compute.manager [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:25:39 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Creating image(s)
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Acquiring lock "/opt/stack/data/nova/instances/d42894d4-98df-46dc-a8e9-137035b948a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Lock "/opt/stack/data/nova/instances/d42894d4-98df-46dc-a8e9-137035b948a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Lock "/opt/stack/data/nova/instances/d42894d4-98df-46dc-a8e9-137035b948a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.204s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:39 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:25:40 user nova-compute[74821]: DEBUG nova.network.neutron [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Successfully created port: 55b3b4ff-b981-45c2-806a-d0043dee0233 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:25:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.245s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/d42894d4-98df-46dc-a8e9-137035b948a4/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/d42894d4-98df-46dc-a8e9-137035b948a4/disk 1073741824" returned: 0 in 0.060s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:25:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.201s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:40 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d42894d4-98df-46dc-a8e9-137035b948a4/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:25:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d42894d4-98df-46dc-a8e9-137035b948a4/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d42894d4-98df-46dc-a8e9-137035b948a4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:40 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Cannot resize image /opt/stack/data/nova/instances/d42894d4-98df-46dc-a8e9-137035b948a4/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:25:40 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:25:40 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Ensure instance console log exists: /opt/stack/data/nova/instances/d42894d4-98df-46dc-a8e9-137035b948a4/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:25:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:25:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:25:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.004s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:25:40 user nova-compute[74821]: DEBUG nova.objects.instance [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lazy-loading 'flavor' on Instance uuid 61beb251-4345-44e6-a176-5c14c99c9a52 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:25:40 user nova-compute[74821]: DEBUG nova.network.neutron [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Successfully updated port: 55b3b4ff-b981-45c2-806a-d0043dee0233 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:25:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Acquiring lock "refresh_cache-d42894d4-98df-46dc-a8e9-137035b948a4" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:25:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Acquired lock "refresh_cache-d42894d4-98df-46dc-a8e9-137035b948a4" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:25:40 user nova-compute[74821]: DEBUG nova.network.neutron [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:25:40 user nova-compute[74821]: DEBUG nova.compute.manager [req-2791733c-7122-497a-932e-20fc1d513a3a req-772424e8-77e4-4abd-ae1f-f12f48c2a25b service nova] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Received event network-changed-55b3b4ff-b981-45c2-806a-d0043dee0233 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:25:40 user nova-compute[74821]: DEBUG nova.compute.manager [req-2791733c-7122-497a-932e-20fc1d513a3a req-772424e8-77e4-4abd-ae1f-f12f48c2a25b service nova] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Refreshing instance network info cache due to event network-changed-55b3b4ff-b981-45c2-806a-d0043dee0233. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:25:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2791733c-7122-497a-932e-20fc1d513a3a req-772424e8-77e4-4abd-ae1f-f12f48c2a25b service nova] Acquiring lock "refresh_cache-d42894d4-98df-46dc-a8e9-137035b948a4" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:25:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-18732916-b74a-4a6e-99c9-b982f422a18a tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "61beb251-4345-44e6-a176-5c14c99c9a52" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.139s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:25:40 user nova-compute[74821]: DEBUG nova.network.neutron [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG nova.network.neutron [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Updating instance_info_cache with network_info: [{"id": "55b3b4ff-b981-45c2-806a-d0043dee0233", "address": "fa:16:3e:d1:d7:c2", "network": {"id": "e090393a-3a2f-4fdb-80ab-d9fc72f6c11e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883757599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5c7747bc814d9cb56e1e52d59960ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55b3b4ff-b9", "ovs_interfaceid": "55b3b4ff-b981-45c2-806a-d0043dee0233", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Releasing lock "refresh_cache-d42894d4-98df-46dc-a8e9-137035b948a4" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG nova.compute.manager [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Instance network_info: |[{"id": "55b3b4ff-b981-45c2-806a-d0043dee0233", "address": "fa:16:3e:d1:d7:c2", "network": {"id": "e090393a-3a2f-4fdb-80ab-d9fc72f6c11e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883757599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5c7747bc814d9cb56e1e52d59960ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55b3b4ff-b9", "ovs_interfaceid": "55b3b4ff-b981-45c2-806a-d0043dee0233", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2791733c-7122-497a-932e-20fc1d513a3a req-772424e8-77e4-4abd-ae1f-f12f48c2a25b service nova] Acquired lock "refresh_cache-d42894d4-98df-46dc-a8e9-137035b948a4" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG nova.network.neutron [req-2791733c-7122-497a-932e-20fc1d513a3a req-772424e8-77e4-4abd-ae1f-f12f48c2a25b service nova] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Refreshing network info cache for port 55b3b4ff-b981-45c2-806a-d0043dee0233 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Start _get_guest_xml network_info=[{"id": "55b3b4ff-b981-45c2-806a-d0043dee0233", "address": "fa:16:3e:d1:d7:c2", "network": {"id": "e090393a-3a2f-4fdb-80ab-d9fc72f6c11e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883757599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5c7747bc814d9cb56e1e52d59960ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55b3b4ff-b9", "ovs_interfaceid": "55b3b4ff-b981-45c2-806a-d0043dee0233", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:25:41 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:25:41 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:25:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:25:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-751778563',display_name='tempest-VolumesActionsTest-instance-751778563',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-751778563',id=29,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f5c7747bc814d9cb56e1e52d59960ea',ramdisk_id='',reservation_id='r-jg3cx7pg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1917959047',owner_user_name='tempest-VolumesActionsTest-1917959047-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:25:40Z,user_data=None,user_id='64aebab87680452d85cf96a0d24ac6bc',uuid=d42894d4-98df-46dc-a8e9-137035b948a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55b3b4ff-b981-45c2-806a-d0043dee0233", "address": "fa:16:3e:d1:d7:c2", "network": {"id": "e090393a-3a2f-4fdb-80ab-d9fc72f6c11e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883757599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5c7747bc814d9cb56e1e52d59960ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55b3b4ff-b9", "ovs_interfaceid": "55b3b4ff-b981-45c2-806a-d0043dee0233", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Converting VIF {"id": "55b3b4ff-b981-45c2-806a-d0043dee0233", "address": "fa:16:3e:d1:d7:c2", "network": {"id": "e090393a-3a2f-4fdb-80ab-d9fc72f6c11e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883757599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5c7747bc814d9cb56e1e52d59960ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55b3b4ff-b9", "ovs_interfaceid": "55b3b4ff-b981-45c2-806a-d0043dee0233", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:d7:c2,bridge_name='br-int',has_traffic_filtering=True,id=55b3b4ff-b981-45c2-806a-d0043dee0233,network=Network(e090393a-3a2f-4fdb-80ab-d9fc72f6c11e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55b3b4ff-b9') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG nova.objects.instance [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Lazy-loading 'pci_devices' on Instance uuid d42894d4-98df-46dc-a8e9-137035b948a4 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:25:41 user nova-compute[74821]:   <uuid>d42894d4-98df-46dc-a8e9-137035b948a4</uuid>
Nov 06 13:25:41 user nova-compute[74821]:   <name>instance-0000001d</name>
Nov 06 13:25:41 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:25:41 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:25:41 user nova-compute[74821]:   <metadata>
Nov 06 13:25:41 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:25:41 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:25:41 user nova-compute[74821]:       <nova:name>tempest-VolumesActionsTest-instance-751778563</nova:name>
Nov 06 13:25:41 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:25:41</nova:creationTime>
Nov 06 13:25:41 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:25:41 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:25:41 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:25:41 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:25:41 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:25:41 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:25:41 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:25:41 user nova-compute[74821]:       <nova:owner>
Nov 06 13:25:41 user nova-compute[74821]:         <nova:user uuid="64aebab87680452d85cf96a0d24ac6bc">tempest-VolumesActionsTest-1917959047-project-member</nova:user>
Nov 06 13:25:41 user nova-compute[74821]:         <nova:project uuid="0f5c7747bc814d9cb56e1e52d59960ea">tempest-VolumesActionsTest-1917959047</nova:project>
Nov 06 13:25:41 user nova-compute[74821]:       </nova:owner>
Nov 06 13:25:41 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:25:41 user nova-compute[74821]:       <nova:ports>
Nov 06 13:25:41 user nova-compute[74821]:         <nova:port uuid="55b3b4ff-b981-45c2-806a-d0043dee0233">
Nov 06 13:25:41 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 13:25:41 user nova-compute[74821]:         </nova:port>
Nov 06 13:25:41 user nova-compute[74821]:       </nova:ports>
Nov 06 13:25:41 user nova-compute[74821]:     </nova:instance>
Nov 06 13:25:41 user nova-compute[74821]:   </metadata>
Nov 06 13:25:41 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:25:41 user nova-compute[74821]:     <system>
Nov 06 13:25:41 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:25:41 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:25:41 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:25:41 user nova-compute[74821]:       <entry name="serial">d42894d4-98df-46dc-a8e9-137035b948a4</entry>
Nov 06 13:25:41 user nova-compute[74821]:       <entry name="uuid">d42894d4-98df-46dc-a8e9-137035b948a4</entry>
Nov 06 13:25:41 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:25:41 user nova-compute[74821]:     </system>
Nov 06 13:25:41 user nova-compute[74821]:   </sysinfo>
Nov 06 13:25:41 user nova-compute[74821]:   <os>
Nov 06 13:25:41 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:25:41 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:25:41 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:25:41 user nova-compute[74821]:   </os>
Nov 06 13:25:41 user nova-compute[74821]:   <features>
Nov 06 13:25:41 user nova-compute[74821]:     <acpi/>
Nov 06 13:25:41 user nova-compute[74821]:     <apic/>
Nov 06 13:25:41 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:25:41 user nova-compute[74821]:   </features>
Nov 06 13:25:41 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:25:41 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:25:41 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:25:41 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:25:41 user nova-compute[74821]:   </clock>
Nov 06 13:25:41 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:25:41 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:25:41 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:25:41 user nova-compute[74821]:   </cpu>
Nov 06 13:25:41 user nova-compute[74821]:   <devices>
Nov 06 13:25:41 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:25:41 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:25:41 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/d42894d4-98df-46dc-a8e9-137035b948a4/disk"/>
Nov 06 13:25:41 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:25:41 user nova-compute[74821]:     </disk>
Nov 06 13:25:41 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:25:41 user nova-compute[74821]:       <mac address="fa:16:3e:d1:d7:c2"/>
Nov 06 13:25:41 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:25:41 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:25:41 user nova-compute[74821]:       <target dev="tap55b3b4ff-b9"/>
Nov 06 13:25:41 user nova-compute[74821]:     </interface>
Nov 06 13:25:41 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:25:41 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/d42894d4-98df-46dc-a8e9-137035b948a4/console.log" append="off"/>
Nov 06 13:25:41 user nova-compute[74821]:     </serial>
Nov 06 13:25:41 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:25:41 user nova-compute[74821]:     <video>
Nov 06 13:25:41 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:25:41 user nova-compute[74821]:     </video>
Nov 06 13:25:41 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:25:41 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:25:41 user nova-compute[74821]:     </rng>
Nov 06 13:25:41 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:25:41 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:25:41 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:25:41 user nova-compute[74821]:     </memballoon>
Nov 06 13:25:41 user nova-compute[74821]:   </devices>
Nov 06 13:25:41 user nova-compute[74821]: </domain>
Nov 06 13:25:41 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:25:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-751778563',display_name='tempest-VolumesActionsTest-instance-751778563',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-751778563',id=29,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f5c7747bc814d9cb56e1e52d59960ea',ramdisk_id='',reservation_id='r-jg3cx7pg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1917959047',owner_user_name='tempest-VolumesActionsTest-1917959047-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:25:40Z,user_data=None,user_id='64aebab87680452d85cf96a0d24ac6bc',uuid=d42894d4-98df-46dc-a8e9-137035b948a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55b3b4ff-b981-45c2-806a-d0043dee0233", "address": "fa:16:3e:d1:d7:c2", "network": {"id": "e090393a-3a2f-4fdb-80ab-d9fc72f6c11e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883757599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5c7747bc814d9cb56e1e52d59960ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55b3b4ff-b9", "ovs_interfaceid": "55b3b4ff-b981-45c2-806a-d0043dee0233", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Converting VIF {"id": "55b3b4ff-b981-45c2-806a-d0043dee0233", "address": "fa:16:3e:d1:d7:c2", "network": {"id": "e090393a-3a2f-4fdb-80ab-d9fc72f6c11e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883757599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5c7747bc814d9cb56e1e52d59960ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55b3b4ff-b9", "ovs_interfaceid": "55b3b4ff-b981-45c2-806a-d0043dee0233", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:d7:c2,bridge_name='br-int',has_traffic_filtering=True,id=55b3b4ff-b981-45c2-806a-d0043dee0233,network=Network(e090393a-3a2f-4fdb-80ab-d9fc72f6c11e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55b3b4ff-b9') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG os_vif [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:d7:c2,bridge_name='br-int',has_traffic_filtering=True,id=55b3b4ff-b981-45c2-806a-d0043dee0233,network=Network(e090393a-3a2f-4fdb-80ab-d9fc72f6c11e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55b3b4ff-b9') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ffdebbee-e0a1-5f33-882d-ada3888f028b', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55b3b4ff-b9, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap55b3b4ff-b9, col_values=(('qos', UUID('6f2f8559-999c-4ca3-889a-aa7e4fed31d0')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap55b3b4ff-b9, col_values=(('external_ids', {'iface-id': '55b3b4ff-b981-45c2-806a-d0043dee0233', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:d7:c2', 'vm-uuid': 'd42894d4-98df-46dc-a8e9-137035b948a4'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:41 user nova-compute[74821]: INFO os_vif [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:d7:c2,bridge_name='br-int',has_traffic_filtering=True,id=55b3b4ff-b981-45c2-806a-d0043dee0233,network=Network(e090393a-3a2f-4fdb-80ab-d9fc72f6c11e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55b3b4ff-b9')
Nov 06 13:25:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-247cb46d-c87a-4147-9f0c-30aeb9acfb23 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "290cd798-a041-40c0-8ef9-319d3627ff82" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-247cb46d-c87a-4147-9f0c-30aeb9acfb23 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "290cd798-a041-40c0-8ef9-319d3627ff82" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-247cb46d-c87a-4147-9f0c-30aeb9acfb23 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "290cd798-a041-40c0-8ef9-319d3627ff82-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-247cb46d-c87a-4147-9f0c-30aeb9acfb23 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "290cd798-a041-40c0-8ef9-319d3627ff82-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-247cb46d-c87a-4147-9f0c-30aeb9acfb23 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "290cd798-a041-40c0-8ef9-319d3627ff82-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:25:41 user nova-compute[74821]: INFO nova.compute.manager [None req-247cb46d-c87a-4147-9f0c-30aeb9acfb23 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Terminating instance
Nov 06 13:25:41 user nova-compute[74821]: DEBUG nova.compute.manager [None req-247cb46d-c87a-4147-9f0c-30aeb9acfb23 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] No VIF found with MAC fa:16:3e:d1:d7:c2, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG nova.network.neutron [req-2791733c-7122-497a-932e-20fc1d513a3a req-772424e8-77e4-4abd-ae1f-f12f48c2a25b service nova] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Updated VIF entry in instance network info cache for port 55b3b4ff-b981-45c2-806a-d0043dee0233. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG nova.network.neutron [req-2791733c-7122-497a-932e-20fc1d513a3a req-772424e8-77e4-4abd-ae1f-f12f48c2a25b service nova] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Updating instance_info_cache with network_info: [{"id": "55b3b4ff-b981-45c2-806a-d0043dee0233", "address": "fa:16:3e:d1:d7:c2", "network": {"id": "e090393a-3a2f-4fdb-80ab-d9fc72f6c11e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883757599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5c7747bc814d9cb56e1e52d59960ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55b3b4ff-b9", "ovs_interfaceid": "55b3b4ff-b981-45c2-806a-d0043dee0233", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:25:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2791733c-7122-497a-932e-20fc1d513a3a req-772424e8-77e4-4abd-ae1f-f12f48c2a25b service nova] Releasing lock "refresh_cache-d42894d4-98df-46dc-a8e9-137035b948a4" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:25:42 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Instance destroyed successfully.
Nov 06 13:25:42 user nova-compute[74821]: DEBUG nova.objects.instance [None req-247cb46d-c87a-4147-9f0c-30aeb9acfb23 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lazy-loading 'resources' on Instance uuid 290cd798-a041-40c0-8ef9-319d3627ff82 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:25:42 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-247cb46d-c87a-4147-9f0c-30aeb9acfb23 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T13:18:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-219751972',display_name='tempest-ServerActionsTestOtherA-server-1045248039',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-219751972',id=21,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGVJpgtmRZL9WKhOaXwD5m/EAyvGSguG6jTTT7b4IRvn135izX0urMafelC8vQXZBMR8O1HoZmDg8wWA0Bz8SPSg87ol6FREXNQzdTu5vhYkn54jvZdlsWdAb1XlCYP+3Q==',key_name='tempest-keypair-1473532461',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:22:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77233758870b4fdfbb7ca76829f0f82e',ramdisk_id='',reservation_id='r-4lip00k3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1986828412',owner_user_name='tempest-ServerActionsTestOtherA-1986828412-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:22:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0620d1928d8d434fbe0bc1cdb31a2a89',uuid=290cd798-a041-40c0-8ef9-319d3627ff82,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "address": "fa:16:3e:6c:6c:87", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap741cb43d-19", "ovs_interfaceid": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:25:42 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-247cb46d-c87a-4147-9f0c-30aeb9acfb23 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Converting VIF {"id": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "address": "fa:16:3e:6c:6c:87", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap741cb43d-19", "ovs_interfaceid": "741cb43d-19ba-4edc-92f0-5de562bf4c2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:25:42 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-247cb46d-c87a-4147-9f0c-30aeb9acfb23 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:6c:87,bridge_name='br-int',has_traffic_filtering=True,id=741cb43d-19ba-4edc-92f0-5de562bf4c2c,network=Network(a3838abe-b3bb-4878-9d5d-eb80a8cf60a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap741cb43d-19') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:25:42 user nova-compute[74821]: DEBUG os_vif [None req-247cb46d-c87a-4147-9f0c-30aeb9acfb23 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:6c:87,bridge_name='br-int',has_traffic_filtering=True,id=741cb43d-19ba-4edc-92f0-5de562bf4c2c,network=Network(a3838abe-b3bb-4878-9d5d-eb80a8cf60a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap741cb43d-19') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:25:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap741cb43d-19, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:25:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:25:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b952231b-5da4-49cc-9470-39253cf0d5f2) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:25:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:25:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:42 user nova-compute[74821]: INFO os_vif [None req-247cb46d-c87a-4147-9f0c-30aeb9acfb23 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:6c:87,bridge_name='br-int',has_traffic_filtering=True,id=741cb43d-19ba-4edc-92f0-5de562bf4c2c,network=Network(a3838abe-b3bb-4878-9d5d-eb80a8cf60a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap741cb43d-19')
Nov 06 13:25:42 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-247cb46d-c87a-4147-9f0c-30aeb9acfb23 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Deleting instance files /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82_del
Nov 06 13:25:42 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-247cb46d-c87a-4147-9f0c-30aeb9acfb23 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Deletion of /opt/stack/data/nova/instances/290cd798-a041-40c0-8ef9-319d3627ff82_del complete
Nov 06 13:25:42 user nova-compute[74821]: INFO nova.compute.manager [None req-247cb46d-c87a-4147-9f0c-30aeb9acfb23 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 06 13:25:42 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-247cb46d-c87a-4147-9f0c-30aeb9acfb23 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:25:42 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:25:42 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:25:42 user nova-compute[74821]: DEBUG nova.compute.manager [req-8567f313-a8d9-47a6-bd9e-d6b0467f63e7 req-c73a5a59-f8d3-401f-af10-50619164688f service nova] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Received event network-vif-unplugged-741cb43d-19ba-4edc-92f0-5de562bf4c2c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:25:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8567f313-a8d9-47a6-bd9e-d6b0467f63e7 req-c73a5a59-f8d3-401f-af10-50619164688f service nova] Acquiring lock "290cd798-a041-40c0-8ef9-319d3627ff82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:25:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8567f313-a8d9-47a6-bd9e-d6b0467f63e7 req-c73a5a59-f8d3-401f-af10-50619164688f service nova] Lock "290cd798-a041-40c0-8ef9-319d3627ff82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:25:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8567f313-a8d9-47a6-bd9e-d6b0467f63e7 req-c73a5a59-f8d3-401f-af10-50619164688f service nova] Lock "290cd798-a041-40c0-8ef9-319d3627ff82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:25:42 user nova-compute[74821]: DEBUG nova.compute.manager [req-8567f313-a8d9-47a6-bd9e-d6b0467f63e7 req-c73a5a59-f8d3-401f-af10-50619164688f service nova] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] No waiting events found dispatching network-vif-unplugged-741cb43d-19ba-4edc-92f0-5de562bf4c2c {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:25:42 user nova-compute[74821]: DEBUG nova.compute.manager [req-8567f313-a8d9-47a6-bd9e-d6b0467f63e7 req-c73a5a59-f8d3-401f-af10-50619164688f service nova] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Received event network-vif-unplugged-741cb43d-19ba-4edc-92f0-5de562bf4c2c for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:25:42 user nova-compute[74821]: DEBUG nova.compute.manager [req-8567f313-a8d9-47a6-bd9e-d6b0467f63e7 req-c73a5a59-f8d3-401f-af10-50619164688f service nova] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Received event network-vif-plugged-741cb43d-19ba-4edc-92f0-5de562bf4c2c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:25:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8567f313-a8d9-47a6-bd9e-d6b0467f63e7 req-c73a5a59-f8d3-401f-af10-50619164688f service nova] Acquiring lock "290cd798-a041-40c0-8ef9-319d3627ff82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:25:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8567f313-a8d9-47a6-bd9e-d6b0467f63e7 req-c73a5a59-f8d3-401f-af10-50619164688f service nova] Lock "290cd798-a041-40c0-8ef9-319d3627ff82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:25:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8567f313-a8d9-47a6-bd9e-d6b0467f63e7 req-c73a5a59-f8d3-401f-af10-50619164688f service nova] Lock "290cd798-a041-40c0-8ef9-319d3627ff82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:25:42 user nova-compute[74821]: DEBUG nova.compute.manager [req-8567f313-a8d9-47a6-bd9e-d6b0467f63e7 req-c73a5a59-f8d3-401f-af10-50619164688f service nova] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] No waiting events found dispatching network-vif-plugged-741cb43d-19ba-4edc-92f0-5de562bf4c2c {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:25:42 user nova-compute[74821]: WARNING nova.compute.manager [req-8567f313-a8d9-47a6-bd9e-d6b0467f63e7 req-c73a5a59-f8d3-401f-af10-50619164688f service nova] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Received unexpected event network-vif-plugged-741cb43d-19ba-4edc-92f0-5de562bf4c2c for instance with vm_state active and task_state deleting.
Nov 06 13:25:43 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:43 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:43 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:43 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:44 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:25:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:44 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Took 1.71 seconds to deallocate network for instance.
Nov 06 13:25:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-247cb46d-c87a-4147-9f0c-30aeb9acfb23 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:25:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-247cb46d-c87a-4147-9f0c-30aeb9acfb23 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:25:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:44 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-247cb46d-c87a-4147-9f0c-30aeb9acfb23 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:25:44 user nova-compute[74821]: DEBUG nova.compute.manager [req-bb361aa1-5a67-445f-a151-ccc7708c9768 req-03cbe080-6692-4968-9814-4f385fd02bb4 service nova] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Received event network-vif-plugged-55b3b4ff-b981-45c2-806a-d0043dee0233 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:25:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-bb361aa1-5a67-445f-a151-ccc7708c9768 req-03cbe080-6692-4968-9814-4f385fd02bb4 service nova] Acquiring lock "d42894d4-98df-46dc-a8e9-137035b948a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:25:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-bb361aa1-5a67-445f-a151-ccc7708c9768 req-03cbe080-6692-4968-9814-4f385fd02bb4 service nova] Lock "d42894d4-98df-46dc-a8e9-137035b948a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:25:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-bb361aa1-5a67-445f-a151-ccc7708c9768 req-03cbe080-6692-4968-9814-4f385fd02bb4 service nova] Lock "d42894d4-98df-46dc-a8e9-137035b948a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:25:44 user nova-compute[74821]: DEBUG nova.compute.manager [req-bb361aa1-5a67-445f-a151-ccc7708c9768 req-03cbe080-6692-4968-9814-4f385fd02bb4 service nova] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] No waiting events found dispatching network-vif-plugged-55b3b4ff-b981-45c2-806a-d0043dee0233 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:25:44 user nova-compute[74821]: WARNING nova.compute.manager [req-bb361aa1-5a67-445f-a151-ccc7708c9768 req-03cbe080-6692-4968-9814-4f385fd02bb4 service nova] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Received unexpected event network-vif-plugged-55b3b4ff-b981-45c2-806a-d0043dee0233 for instance with vm_state building and task_state spawning.
Nov 06 13:25:44 user nova-compute[74821]: DEBUG nova.compute.manager [req-bb361aa1-5a67-445f-a151-ccc7708c9768 req-03cbe080-6692-4968-9814-4f385fd02bb4 service nova] [instance: 290cd798-a041-40c0-8ef9-319d3627ff82] Received event network-vif-deleted-741cb43d-19ba-4edc-92f0-5de562bf4c2c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:25:44 user nova-compute[74821]: DEBUG nova.compute.manager [req-bb361aa1-5a67-445f-a151-ccc7708c9768 req-03cbe080-6692-4968-9814-4f385fd02bb4 service nova] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Received event network-vif-plugged-55b3b4ff-b981-45c2-806a-d0043dee0233 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:25:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-bb361aa1-5a67-445f-a151-ccc7708c9768 req-03cbe080-6692-4968-9814-4f385fd02bb4 service nova] Acquiring lock "d42894d4-98df-46dc-a8e9-137035b948a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:25:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-bb361aa1-5a67-445f-a151-ccc7708c9768 req-03cbe080-6692-4968-9814-4f385fd02bb4 service nova] Lock "d42894d4-98df-46dc-a8e9-137035b948a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:25:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-bb361aa1-5a67-445f-a151-ccc7708c9768 req-03cbe080-6692-4968-9814-4f385fd02bb4 service nova] Lock "d42894d4-98df-46dc-a8e9-137035b948a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:25:44 user nova-compute[74821]: DEBUG nova.compute.manager [req-bb361aa1-5a67-445f-a151-ccc7708c9768 req-03cbe080-6692-4968-9814-4f385fd02bb4 service nova] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] No waiting events found dispatching network-vif-plugged-55b3b4ff-b981-45c2-806a-d0043dee0233 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:25:44 user nova-compute[74821]: WARNING nova.compute.manager [req-bb361aa1-5a67-445f-a151-ccc7708c9768 req-03cbe080-6692-4968-9814-4f385fd02bb4 service nova] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Received unexpected event network-vif-plugged-55b3b4ff-b981-45c2-806a-d0043dee0233 for instance with vm_state building and task_state spawning.
Nov 06 13:25:44 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-247cb46d-c87a-4147-9f0c-30aeb9acfb23 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:25:44 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:25:44 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:25:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-247cb46d-c87a-4147-9f0c-30aeb9acfb23 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.594s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:25:45 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-247cb46d-c87a-4147-9f0c-30aeb9acfb23 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Deleted allocations for instance 290cd798-a041-40c0-8ef9-319d3627ff82
Nov 06 13:25:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:25:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:25:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:25:45 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:25:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-247cb46d-c87a-4147-9f0c-30aeb9acfb23 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "290cd798-a041-40c0-8ef9-319d3627ff82" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.844s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:25:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d42894d4-98df-46dc-a8e9-137035b948a4/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:46 user nova-compute[74821]: DEBUG nova.compute.manager [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:25:46 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:25:46 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Instance spawned successfully.
Nov 06 13:25:46 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:25:46 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:25:46 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:25:46 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:25:46 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:25:46 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:25:46 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:25:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d42894d4-98df-46dc-a8e9-137035b948a4/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d42894d4-98df-46dc-a8e9-137035b948a4/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:46 user nova-compute[74821]: INFO nova.compute.manager [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Took 6.62 seconds to spawn the instance on the hypervisor.
Nov 06 13:25:46 user nova-compute[74821]: DEBUG nova.compute.manager [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:25:46 user nova-compute[74821]: INFO nova.compute.manager [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Took 7.60 seconds to build instance.
Nov 06 13:25:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ab71e84a-00f6-4247-ba90-0c9784cefa3d tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Lock "d42894d4-98df-46dc-a8e9-137035b948a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.711s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:25:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d42894d4-98df-46dc-a8e9-137035b948a4/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:46 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:25:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json" returned: 0 in 0.339s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:25:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:25:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:25:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:25:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:49 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:25:49 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:25:49 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=7541MB free_disk=25.11579132080078GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:25:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:25:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:25:49 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 3e21d005-f190-478a-a911-e483e1235057 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:25:49 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 311817c5-7b08-4da9-98eb-c685f37e6fd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:25:49 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 2de346cb-9858-47b8-a86c-4fde720d6127 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:25:49 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 49c65aca-8392-46ba-8fa3-b47ff2416cb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:25:49 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 5a07f64b-5b12-4e7d-a041-ad591141aa17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:25:49 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 61beb251-4345-44e6-a176-5c14c99c9a52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:25:49 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 496f8213-4b32-4211-a354-e33a4a088848 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:25:49 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:25:49 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 1290bdb3-827f-4365-a4f1-4ae063de780d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:25:49 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance d42894d4-98df-46dc-a8e9-137035b948a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:25:49 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:25:49 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:25:50 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:25:50 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:25:50 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:25:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.557s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:25:51 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Acquiring lock "5a07f64b-5b12-4e7d-a041-ad591141aa17" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:25:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:25:55 user nova-compute[74821]: INFO nova.compute.manager [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Detaching volume b42dbce4-83ea-498c-abcf-86517f54ae3a
Nov 06 13:25:55 user nova-compute[74821]: INFO nova.virt.block_device [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Attempting to driver detach volume b42dbce4-83ea-498c-abcf-86517f54ae3a from mountpoint /dev/vdb
Nov 06 13:25:55 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Attempting to detach device vdb from instance 5a07f64b-5b12-4e7d-a041-ad591141aa17 from the persistent domain config. {{(pid=74821) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 13:25:55 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:25:55 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:25:55 user nova-compute[74821]:   <source dev="/dev/sdg"/>
Nov 06 13:25:55 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:25:55 user nova-compute[74821]:   <serial>b42dbce4-83ea-498c-abcf-86517f54ae3a</serial>
Nov 06 13:25:55 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:25:55 user nova-compute[74821]: </disk>
Nov 06 13:25:55 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:25:55 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Successfully detached device vdb from instance 5a07f64b-5b12-4e7d-a041-ad591141aa17 from the persistent domain config.
Nov 06 13:25:55 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5a07f64b-5b12-4e7d-a041-ad591141aa17 from the live domain config. {{(pid=74821) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 13:25:55 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:25:55 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:25:55 user nova-compute[74821]:   <source dev="/dev/sdg"/>
Nov 06 13:25:55 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:25:55 user nova-compute[74821]:   <serial>b42dbce4-83ea-498c-abcf-86517f54ae3a</serial>
Nov 06 13:25:55 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:25:55 user nova-compute[74821]: </disk>
Nov 06 13:25:55 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:25:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5a07f64b-5b12-4e7d-a041-ad591141aa17 {{(pid=74821) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 13:25:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:25:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Acquiring lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:07 user nova-compute[74821]: DEBUG nova.compute.manager [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:26:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:07 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:26:07 user nova-compute[74821]: INFO nova.compute.claims [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Claim successful on node user
Nov 06 13:26:08 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:26:08 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:26:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.594s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:08 user nova-compute[74821]: DEBUG nova.compute.manager [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:26:08 user nova-compute[74821]: DEBUG nova.compute.manager [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:26:08 user nova-compute[74821]: DEBUG nova.network.neutron [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:26:08 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:26:08 user nova-compute[74821]: DEBUG nova.compute.manager [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:26:08 user nova-compute[74821]: DEBUG nova.policy [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '88e8b4a7235140488a7b9cd34bd10f85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56107e2c08004a26a96765ec143a6d6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:26:08 user nova-compute[74821]: DEBUG nova.compute.manager [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:26:08 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:26:08 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Creating image(s)
Nov 06 13:26:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "/opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "/opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:08 user nova-compute[74821]: DEBUG nova.compute.manager [req-6d516639-7dbd-467c-b10e-ef6cf1043d71 req-f425a18f-6c43-4270-a81f-ce902a907b13 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Received event network-changed-f35b642a-825f-4e17-9b97-3c8eba32a08e {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:26:08 user nova-compute[74821]: DEBUG nova.compute.manager [req-6d516639-7dbd-467c-b10e-ef6cf1043d71 req-f425a18f-6c43-4270-a81f-ce902a907b13 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Refreshing instance network info cache due to event network-changed-f35b642a-825f-4e17-9b97-3c8eba32a08e. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:26:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6d516639-7dbd-467c-b10e-ef6cf1043d71 req-f425a18f-6c43-4270-a81f-ce902a907b13 service nova] Acquiring lock "refresh_cache-9cf1a0c3-4719-4637-a88d-e5864b2f1c3c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:26:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6d516639-7dbd-467c-b10e-ef6cf1043d71 req-f425a18f-6c43-4270-a81f-ce902a907b13 service nova] Acquired lock "refresh_cache-9cf1a0c3-4719-4637-a88d-e5864b2f1c3c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:26:08 user nova-compute[74821]: DEBUG nova.network.neutron [req-6d516639-7dbd-467c-b10e-ef6cf1043d71 req-f425a18f-6c43-4270-a81f-ce902a907b13 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Refreshing network info cache for port f35b642a-825f-4e17-9b97-3c8eba32a08e {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:26:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.197s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.194s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk 1073741824" returned: 0 in 0.081s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Acquiring lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:09 user nova-compute[74821]: INFO nova.compute.manager [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Shelve offloading
Nov 06 13:26:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.227s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:09 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:26:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e6d91405-fdd4-4cac-b5e3-13a70a7281ef tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "61beb251-4345-44e6-a176-5c14c99c9a52" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e6d91405-fdd4-4cac-b5e3-13a70a7281ef tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "61beb251-4345-44e6-a176-5c14c99c9a52" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e6d91405-fdd4-4cac-b5e3-13a70a7281ef tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e6d91405-fdd4-4cac-b5e3-13a70a7281ef tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e6d91405-fdd4-4cac-b5e3-13a70a7281ef tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:09 user nova-compute[74821]: INFO nova.compute.manager [None req-e6d91405-fdd4-4cac-b5e3-13a70a7281ef tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Terminating instance
Nov 06 13:26:09 user nova-compute[74821]: DEBUG nova.compute.manager [None req-e6d91405-fdd4-4cac-b5e3-13a70a7281ef tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:26:09 user nova-compute[74821]: DEBUG nova.network.neutron [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Successfully created port: f768a2c5-10b0-4442-9c76-3b2365a15ea1 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:26:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:09 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Cannot resize image /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:26:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:26:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Ensure instance console log exists: /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:26:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:09 user nova-compute[74821]: DEBUG nova.compute.manager [req-6a34f74a-1095-4b71-acdc-88fee833c242 req-f87214d6-d4c4-4a4d-abf3-57bb3aefb033 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Received event network-vif-unplugged-f35b642a-825f-4e17-9b97-3c8eba32a08e {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:26:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6a34f74a-1095-4b71-acdc-88fee833c242 req-f87214d6-d4c4-4a4d-abf3-57bb3aefb033 service nova] Acquiring lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6a34f74a-1095-4b71-acdc-88fee833c242 req-f87214d6-d4c4-4a4d-abf3-57bb3aefb033 service nova] Lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6a34f74a-1095-4b71-acdc-88fee833c242 req-f87214d6-d4c4-4a4d-abf3-57bb3aefb033 service nova] Lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:09 user nova-compute[74821]: DEBUG nova.compute.manager [req-6a34f74a-1095-4b71-acdc-88fee833c242 req-f87214d6-d4c4-4a4d-abf3-57bb3aefb033 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] No waiting events found dispatching network-vif-unplugged-f35b642a-825f-4e17-9b97-3c8eba32a08e {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:26:09 user nova-compute[74821]: WARNING nova.compute.manager [req-6a34f74a-1095-4b71-acdc-88fee833c242 req-f87214d6-d4c4-4a4d-abf3-57bb3aefb033 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Received unexpected event network-vif-unplugged-f35b642a-825f-4e17-9b97-3c8eba32a08e for instance with vm_state active and task_state shelving.
Nov 06 13:26:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:09 user nova-compute[74821]: DEBUG nova.network.neutron [req-6d516639-7dbd-467c-b10e-ef6cf1043d71 req-f425a18f-6c43-4270-a81f-ce902a907b13 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Updated VIF entry in instance network info cache for port f35b642a-825f-4e17-9b97-3c8eba32a08e. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:26:09 user nova-compute[74821]: DEBUG nova.network.neutron [req-6d516639-7dbd-467c-b10e-ef6cf1043d71 req-f425a18f-6c43-4270-a81f-ce902a907b13 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Updating instance_info_cache with network_info: [{"id": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "address": "fa:16:3e:3f:5e:be", "network": {"id": "20103956-1e64-4c7a-bed2-24edd5ae7724", "bridge": "br-int", "label": "tempest-TestShelveInstance-307843308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d32bd8dc1c9419b90607e20dfa5d50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35b642a-82", "ovs_interfaceid": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:26:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6d516639-7dbd-467c-b10e-ef6cf1043d71 req-f425a18f-6c43-4270-a81f-ce902a907b13 service nova] Releasing lock "refresh_cache-9cf1a0c3-4719-4637-a88d-e5864b2f1c3c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:26:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:10 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Instance destroyed successfully.
Nov 06 13:26:10 user nova-compute[74821]: DEBUG nova.compute.manager [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:10 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Instance destroyed successfully.
Nov 06 13:26:10 user nova-compute[74821]: DEBUG nova.objects.instance [None req-e6d91405-fdd4-4cac-b5e3-13a70a7281ef tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lazy-loading 'resources' on Instance uuid 61beb251-4345-44e6-a176-5c14c99c9a52 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Acquiring lock "refresh_cache-9cf1a0c3-4719-4637-a88d-e5864b2f1c3c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Acquired lock "refresh_cache-9cf1a0c3-4719-4637-a88d-e5864b2f1c3c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG nova.network.neutron [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-e6d91405-fdd4-4cac-b5e3-13a70a7281ef tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:19:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-654751200',display_name='tempest-ServerRescueNegativeTestJSON-server-654751200',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-654751200',id=23,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG84x+NylQWBd2g1pTgN6nYOGcxuM7ptMYLF1iYUf4C/EmePaiAY94KGATgiwZv/MCDbgtJ1U0U0tBBU4OAE3ODDx+p2CM+mUmjEW5IGA4t+YMPmSLPcZoG14d2vm4joFQ==',key_name='tempest-keypair-200545764',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:21:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e246e1fd12054401988f9d49f6ad9373',ramdisk_id='',reservation_id='r-2f5gtrij',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1107947568',owner_user_name='tempest-ServerRescueNegativeTestJSON-1107947568-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:23:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a0f35998b664c32990f079ca1cd5e6d',uuid=61beb251-4345-44e6-a176-5c14c99c9a52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5020053-395f-4341-99be-d522ebb938c7", "address": "fa:16:3e:d4:3e:f8", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5020053-39", "ovs_interfaceid": "b5020053-395f-4341-99be-d522ebb938c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-e6d91405-fdd4-4cac-b5e3-13a70a7281ef tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Converting VIF {"id": "b5020053-395f-4341-99be-d522ebb938c7", "address": "fa:16:3e:d4:3e:f8", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5020053-39", "ovs_interfaceid": "b5020053-395f-4341-99be-d522ebb938c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-e6d91405-fdd4-4cac-b5e3-13a70a7281ef tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:3e:f8,bridge_name='br-int',has_traffic_filtering=True,id=b5020053-395f-4341-99be-d522ebb938c7,network=Network(45ec1f7e-dbfa-4746-8d35-e32f7c938a0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5020053-39') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG os_vif [None req-e6d91405-fdd4-4cac-b5e3-13a70a7281ef tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:3e:f8,bridge_name='br-int',has_traffic_filtering=True,id=b5020053-395f-4341-99be-d522ebb938c7,network=Network(45ec1f7e-dbfa-4746-8d35-e32f7c938a0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5020053-39') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5020053-39, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=44d8bbd1-37bb-4871-94e9-a40f32421966) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:10 user nova-compute[74821]: INFO os_vif [None req-e6d91405-fdd4-4cac-b5e3-13a70a7281ef tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:3e:f8,bridge_name='br-int',has_traffic_filtering=True,id=b5020053-395f-4341-99be-d522ebb938c7,network=Network(45ec1f7e-dbfa-4746-8d35-e32f7c938a0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5020053-39')
Nov 06 13:26:10 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-e6d91405-fdd4-4cac-b5e3-13a70a7281ef tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Deleting instance files /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52_del
Nov 06 13:26:10 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-e6d91405-fdd4-4cac-b5e3-13a70a7281ef tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Deletion of /opt/stack/data/nova/instances/61beb251-4345-44e6-a176-5c14c99c9a52_del complete
Nov 06 13:26:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:10 user nova-compute[74821]: INFO nova.compute.manager [None req-e6d91405-fdd4-4cac-b5e3-13a70a7281ef tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 06 13:26:10 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-e6d91405-fdd4-4cac-b5e3-13a70a7281ef tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG nova.compute.manager [req-88977a63-4153-41ea-af94-8df6d26b0db4 req-636d8bc3-0aa8-4c9a-a87c-53955f42810a service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received event network-vif-unplugged-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-88977a63-4153-41ea-af94-8df6d26b0db4 req-636d8bc3-0aa8-4c9a-a87c-53955f42810a service nova] Acquiring lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-88977a63-4153-41ea-af94-8df6d26b0db4 req-636d8bc3-0aa8-4c9a-a87c-53955f42810a service nova] Lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-88977a63-4153-41ea-af94-8df6d26b0db4 req-636d8bc3-0aa8-4c9a-a87c-53955f42810a service nova] Lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG nova.compute.manager [req-88977a63-4153-41ea-af94-8df6d26b0db4 req-636d8bc3-0aa8-4c9a-a87c-53955f42810a service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] No waiting events found dispatching network-vif-unplugged-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG nova.compute.manager [req-88977a63-4153-41ea-af94-8df6d26b0db4 req-636d8bc3-0aa8-4c9a-a87c-53955f42810a service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received event network-vif-unplugged-b5020053-395f-4341-99be-d522ebb938c7 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG nova.compute.manager [req-88977a63-4153-41ea-af94-8df6d26b0db4 req-636d8bc3-0aa8-4c9a-a87c-53955f42810a service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received event network-vif-plugged-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-88977a63-4153-41ea-af94-8df6d26b0db4 req-636d8bc3-0aa8-4c9a-a87c-53955f42810a service nova] Acquiring lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-88977a63-4153-41ea-af94-8df6d26b0db4 req-636d8bc3-0aa8-4c9a-a87c-53955f42810a service nova] Lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-88977a63-4153-41ea-af94-8df6d26b0db4 req-636d8bc3-0aa8-4c9a-a87c-53955f42810a service nova] Lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG nova.compute.manager [req-88977a63-4153-41ea-af94-8df6d26b0db4 req-636d8bc3-0aa8-4c9a-a87c-53955f42810a service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] No waiting events found dispatching network-vif-plugged-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:26:10 user nova-compute[74821]: WARNING nova.compute.manager [req-88977a63-4153-41ea-af94-8df6d26b0db4 req-636d8bc3-0aa8-4c9a-a87c-53955f42810a service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received unexpected event network-vif-plugged-b5020053-395f-4341-99be-d522ebb938c7 for instance with vm_state active and task_state deleting.
Nov 06 13:26:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG nova.network.neutron [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Successfully updated port: f768a2c5-10b0-4442-9c76-3b2365a15ea1 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Acquiring lock "refresh_cache-2d8da345-f66d-45c2-8ccd-d22fdf79a14d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Acquired lock "refresh_cache-2d8da345-f66d-45c2-8ccd-d22fdf79a14d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG nova.network.neutron [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG nova.network.neutron [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG nova.network.neutron [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Updating instance_info_cache with network_info: [{"id": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "address": "fa:16:3e:69:f1:92", "network": {"id": "fc4369de-77c4-4f2f-a73c-d556ca3ff47c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1805761900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56107e2c08004a26a96765ec143a6d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf768a2c5-10", "ovs_interfaceid": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Releasing lock "refresh_cache-2d8da345-f66d-45c2-8ccd-d22fdf79a14d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG nova.compute.manager [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Instance network_info: |[{"id": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "address": "fa:16:3e:69:f1:92", "network": {"id": "fc4369de-77c4-4f2f-a73c-d556ca3ff47c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1805761900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56107e2c08004a26a96765ec143a6d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf768a2c5-10", "ovs_interfaceid": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Start _get_guest_xml network_info=[{"id": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "address": "fa:16:3e:69:f1:92", "network": {"id": "fc4369de-77c4-4f2f-a73c-d556ca3ff47c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1805761900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56107e2c08004a26a96765ec143a6d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf768a2c5-10", "ovs_interfaceid": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:26:11 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:26:11 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:26:11 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:26:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-233244178',display_name='tempest-ServerActionsTestOtherB-server-233244178',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-233244178',id=30,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuJC1d4ehn860a5pUveloxEygkvx5gY8ln8i6Wkpyz/+95f+bQsPWUnUI4RTUqfdZx4+FPFbRCNSl970GfIGv9UYxW4qb3i2YKmZKus6nAHjmjCWQpj73f7nF5ypuSRew==',key_name='tempest-keypair-821004257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56107e2c08004a26a96765ec143a6d6f',ramdisk_id='',reservation_id='r-l2lbl00l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1724377265',owner_user_name='tempest-ServerActionsTestOtherB-1724377265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:26:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88e8b4a7235140488a7b9cd34bd10f85',uuid=2d8da345-f66d-45c2-8ccd-d22fdf79a14d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "address": "fa:16:3e:69:f1:92", "network": {"id": "fc4369de-77c4-4f2f-a73c-d556ca3ff47c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1805761900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56107e2c08004a26a96765ec143a6d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf768a2c5-10", "ovs_interfaceid": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Converting VIF {"id": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "address": "fa:16:3e:69:f1:92", "network": {"id": "fc4369de-77c4-4f2f-a73c-d556ca3ff47c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1805761900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56107e2c08004a26a96765ec143a6d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf768a2c5-10", "ovs_interfaceid": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:f1:92,bridge_name='br-int',has_traffic_filtering=True,id=f768a2c5-10b0-4442-9c76-3b2365a15ea1,network=Network(fc4369de-77c4-4f2f-a73c-d556ca3ff47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf768a2c5-10') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG nova.objects.instance [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d8da345-f66d-45c2-8ccd-d22fdf79a14d {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:26:11 user nova-compute[74821]:   <uuid>2d8da345-f66d-45c2-8ccd-d22fdf79a14d</uuid>
Nov 06 13:26:11 user nova-compute[74821]:   <name>instance-0000001e</name>
Nov 06 13:26:11 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:26:11 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:26:11 user nova-compute[74821]:   <metadata>
Nov 06 13:26:11 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:26:11 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:26:11 user nova-compute[74821]:       <nova:name>tempest-ServerActionsTestOtherB-server-233244178</nova:name>
Nov 06 13:26:11 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:26:11</nova:creationTime>
Nov 06 13:26:11 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:26:11 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:26:11 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:26:11 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:26:11 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:26:11 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:26:11 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:26:11 user nova-compute[74821]:       <nova:owner>
Nov 06 13:26:11 user nova-compute[74821]:         <nova:user uuid="88e8b4a7235140488a7b9cd34bd10f85">tempest-ServerActionsTestOtherB-1724377265-project-member</nova:user>
Nov 06 13:26:11 user nova-compute[74821]:         <nova:project uuid="56107e2c08004a26a96765ec143a6d6f">tempest-ServerActionsTestOtherB-1724377265</nova:project>
Nov 06 13:26:11 user nova-compute[74821]:       </nova:owner>
Nov 06 13:26:11 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:26:11 user nova-compute[74821]:       <nova:ports>
Nov 06 13:26:11 user nova-compute[74821]:         <nova:port uuid="f768a2c5-10b0-4442-9c76-3b2365a15ea1">
Nov 06 13:26:11 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 06 13:26:11 user nova-compute[74821]:         </nova:port>
Nov 06 13:26:11 user nova-compute[74821]:       </nova:ports>
Nov 06 13:26:11 user nova-compute[74821]:     </nova:instance>
Nov 06 13:26:11 user nova-compute[74821]:   </metadata>
Nov 06 13:26:11 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:26:11 user nova-compute[74821]:     <system>
Nov 06 13:26:11 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:26:11 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:26:11 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:26:11 user nova-compute[74821]:       <entry name="serial">2d8da345-f66d-45c2-8ccd-d22fdf79a14d</entry>
Nov 06 13:26:11 user nova-compute[74821]:       <entry name="uuid">2d8da345-f66d-45c2-8ccd-d22fdf79a14d</entry>
Nov 06 13:26:11 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:26:11 user nova-compute[74821]:     </system>
Nov 06 13:26:11 user nova-compute[74821]:   </sysinfo>
Nov 06 13:26:11 user nova-compute[74821]:   <os>
Nov 06 13:26:11 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:26:11 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:26:11 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:26:11 user nova-compute[74821]:   </os>
Nov 06 13:26:11 user nova-compute[74821]:   <features>
Nov 06 13:26:11 user nova-compute[74821]:     <acpi/>
Nov 06 13:26:11 user nova-compute[74821]:     <apic/>
Nov 06 13:26:11 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:26:11 user nova-compute[74821]:   </features>
Nov 06 13:26:11 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:26:11 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:26:11 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:26:11 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:26:11 user nova-compute[74821]:   </clock>
Nov 06 13:26:11 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:26:11 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:26:11 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:26:11 user nova-compute[74821]:   </cpu>
Nov 06 13:26:11 user nova-compute[74821]:   <devices>
Nov 06 13:26:11 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:26:11 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:26:11 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk"/>
Nov 06 13:26:11 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:26:11 user nova-compute[74821]:     </disk>
Nov 06 13:26:11 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:26:11 user nova-compute[74821]:       <mac address="fa:16:3e:69:f1:92"/>
Nov 06 13:26:11 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:26:11 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:26:11 user nova-compute[74821]:       <target dev="tapf768a2c5-10"/>
Nov 06 13:26:11 user nova-compute[74821]:     </interface>
Nov 06 13:26:11 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:26:11 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/console.log" append="off"/>
Nov 06 13:26:11 user nova-compute[74821]:     </serial>
Nov 06 13:26:11 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:26:11 user nova-compute[74821]:     <video>
Nov 06 13:26:11 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:26:11 user nova-compute[74821]:     </video>
Nov 06 13:26:11 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:26:11 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:26:11 user nova-compute[74821]:     </rng>
Nov 06 13:26:11 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:26:11 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:26:11 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:26:11 user nova-compute[74821]:     </memballoon>
Nov 06 13:26:11 user nova-compute[74821]:   </devices>
Nov 06 13:26:11 user nova-compute[74821]: </domain>
Nov 06 13:26:11 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:26:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-233244178',display_name='tempest-ServerActionsTestOtherB-server-233244178',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-233244178',id=30,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuJC1d4ehn860a5pUveloxEygkvx5gY8ln8i6Wkpyz/+95f+bQsPWUnUI4RTUqfdZx4+FPFbRCNSl970GfIGv9UYxW4qb3i2YKmZKus6nAHjmjCWQpj73f7nF5ypuSRew==',key_name='tempest-keypair-821004257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56107e2c08004a26a96765ec143a6d6f',ramdisk_id='',reservation_id='r-l2lbl00l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1724377265',owner_user_name='tempest-ServerActionsTestOtherB-1724377265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:26:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88e8b4a7235140488a7b9cd34bd10f85',uuid=2d8da345-f66d-45c2-8ccd-d22fdf79a14d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "address": "fa:16:3e:69:f1:92", "network": {"id": "fc4369de-77c4-4f2f-a73c-d556ca3ff47c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1805761900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56107e2c08004a26a96765ec143a6d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf768a2c5-10", "ovs_interfaceid": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Converting VIF {"id": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "address": "fa:16:3e:69:f1:92", "network": {"id": "fc4369de-77c4-4f2f-a73c-d556ca3ff47c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1805761900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56107e2c08004a26a96765ec143a6d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf768a2c5-10", "ovs_interfaceid": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:f1:92,bridge_name='br-int',has_traffic_filtering=True,id=f768a2c5-10b0-4442-9c76-3b2365a15ea1,network=Network(fc4369de-77c4-4f2f-a73c-d556ca3ff47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf768a2c5-10') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG os_vif [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:f1:92,bridge_name='br-int',has_traffic_filtering=True,id=f768a2c5-10b0-4442-9c76-3b2365a15ea1,network=Network(fc4369de-77c4-4f2f-a73c-d556ca3ff47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf768a2c5-10') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c3570c2b-e326-5ff2-9a73-a94f5497905f', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf768a2c5-10, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf768a2c5-10, col_values=(('qos', UUID('fa98fa6f-74bf-426d-8432-83dea70666f1')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf768a2c5-10, col_values=(('external_ids', {'iface-id': 'f768a2c5-10b0-4442-9c76-3b2365a15ea1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:f1:92', 'vm-uuid': '2d8da345-f66d-45c2-8ccd-d22fdf79a14d'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:11 user nova-compute[74821]: INFO os_vif [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:f1:92,bridge_name='br-int',has_traffic_filtering=True,id=f768a2c5-10b0-4442-9c76-3b2365a15ea1,network=Network(fc4369de-77c4-4f2f-a73c-d556ca3ff47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf768a2c5-10')
Nov 06 13:26:11 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] No VIF found with MAC fa:16:3e:69:f1:92, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG nova.network.neutron [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Updating instance_info_cache with network_info: [{"id": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "address": "fa:16:3e:3f:5e:be", "network": {"id": "20103956-1e64-4c7a-bed2-24edd5ae7724", "bridge": "br-int", "label": "tempest-TestShelveInstance-307843308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d32bd8dc1c9419b90607e20dfa5d50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35b642a-82", "ovs_interfaceid": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Releasing lock "refresh_cache-9cf1a0c3-4719-4637-a88d-e5864b2f1c3c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG nova.compute.manager [req-5fb9866b-bb8d-4208-aca9-adf616fa9363 req-c910e1df-465b-4937-9aa8-018ff0fdabea service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Received event network-vif-plugged-f35b642a-825f-4e17-9b97-3c8eba32a08e {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5fb9866b-bb8d-4208-aca9-adf616fa9363 req-c910e1df-465b-4937-9aa8-018ff0fdabea service nova] Acquiring lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5fb9866b-bb8d-4208-aca9-adf616fa9363 req-c910e1df-465b-4937-9aa8-018ff0fdabea service nova] Lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5fb9866b-bb8d-4208-aca9-adf616fa9363 req-c910e1df-465b-4937-9aa8-018ff0fdabea service nova] Lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG nova.compute.manager [req-5fb9866b-bb8d-4208-aca9-adf616fa9363 req-c910e1df-465b-4937-9aa8-018ff0fdabea service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] No waiting events found dispatching network-vif-plugged-f35b642a-825f-4e17-9b97-3c8eba32a08e {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:26:11 user nova-compute[74821]: WARNING nova.compute.manager [req-5fb9866b-bb8d-4208-aca9-adf616fa9363 req-c910e1df-465b-4937-9aa8-018ff0fdabea service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Received unexpected event network-vif-plugged-f35b642a-825f-4e17-9b97-3c8eba32a08e for instance with vm_state active and task_state shelving.
Nov 06 13:26:11 user nova-compute[74821]: DEBUG nova.compute.manager [req-5fb9866b-bb8d-4208-aca9-adf616fa9363 req-c910e1df-465b-4937-9aa8-018ff0fdabea service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Received event network-changed-f768a2c5-10b0-4442-9c76-3b2365a15ea1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG nova.compute.manager [req-5fb9866b-bb8d-4208-aca9-adf616fa9363 req-c910e1df-465b-4937-9aa8-018ff0fdabea service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Refreshing instance network info cache due to event network-changed-f768a2c5-10b0-4442-9c76-3b2365a15ea1. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5fb9866b-bb8d-4208-aca9-adf616fa9363 req-c910e1df-465b-4937-9aa8-018ff0fdabea service nova] Acquiring lock "refresh_cache-2d8da345-f66d-45c2-8ccd-d22fdf79a14d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5fb9866b-bb8d-4208-aca9-adf616fa9363 req-c910e1df-465b-4937-9aa8-018ff0fdabea service nova] Acquired lock "refresh_cache-2d8da345-f66d-45c2-8ccd-d22fdf79a14d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:26:11 user nova-compute[74821]: DEBUG nova.network.neutron [req-5fb9866b-bb8d-4208-aca9-adf616fa9363 req-c910e1df-465b-4937-9aa8-018ff0fdabea service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Refreshing network info cache for port f768a2c5-10b0-4442-9c76-3b2365a15ea1 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:26:12 user nova-compute[74821]: DEBUG nova.network.neutron [req-5fb9866b-bb8d-4208-aca9-adf616fa9363 req-c910e1df-465b-4937-9aa8-018ff0fdabea service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Updated VIF entry in instance network info cache for port f768a2c5-10b0-4442-9c76-3b2365a15ea1. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:26:12 user nova-compute[74821]: DEBUG nova.network.neutron [req-5fb9866b-bb8d-4208-aca9-adf616fa9363 req-c910e1df-465b-4937-9aa8-018ff0fdabea service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Updating instance_info_cache with network_info: [{"id": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "address": "fa:16:3e:69:f1:92", "network": {"id": "fc4369de-77c4-4f2f-a73c-d556ca3ff47c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1805761900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56107e2c08004a26a96765ec143a6d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf768a2c5-10", "ovs_interfaceid": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:26:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5fb9866b-bb8d-4208-aca9-adf616fa9363 req-c910e1df-465b-4937-9aa8-018ff0fdabea service nova] Releasing lock "refresh_cache-2d8da345-f66d-45c2-8ccd-d22fdf79a14d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:26:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-bc138248-0412-41e4-8489-bc463b6c675e req-54808dbd-c507-4345-885f-b22c0146b5ed service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received event network-vif-plugged-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:26:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-bc138248-0412-41e4-8489-bc463b6c675e req-54808dbd-c507-4345-885f-b22c0146b5ed service nova] Acquiring lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-bc138248-0412-41e4-8489-bc463b6c675e req-54808dbd-c507-4345-885f-b22c0146b5ed service nova] Lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-bc138248-0412-41e4-8489-bc463b6c675e req-54808dbd-c507-4345-885f-b22c0146b5ed service nova] Lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-bc138248-0412-41e4-8489-bc463b6c675e req-54808dbd-c507-4345-885f-b22c0146b5ed service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] No waiting events found dispatching network-vif-plugged-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:26:12 user nova-compute[74821]: WARNING nova.compute.manager [req-bc138248-0412-41e4-8489-bc463b6c675e req-54808dbd-c507-4345-885f-b22c0146b5ed service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received unexpected event network-vif-plugged-b5020053-395f-4341-99be-d522ebb938c7 for instance with vm_state active and task_state deleting.
Nov 06 13:26:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-bc138248-0412-41e4-8489-bc463b6c675e req-54808dbd-c507-4345-885f-b22c0146b5ed service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received event network-vif-plugged-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:26:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-bc138248-0412-41e4-8489-bc463b6c675e req-54808dbd-c507-4345-885f-b22c0146b5ed service nova] Acquiring lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-bc138248-0412-41e4-8489-bc463b6c675e req-54808dbd-c507-4345-885f-b22c0146b5ed service nova] Lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-bc138248-0412-41e4-8489-bc463b6c675e req-54808dbd-c507-4345-885f-b22c0146b5ed service nova] Lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-bc138248-0412-41e4-8489-bc463b6c675e req-54808dbd-c507-4345-885f-b22c0146b5ed service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] No waiting events found dispatching network-vif-plugged-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:26:12 user nova-compute[74821]: WARNING nova.compute.manager [req-bc138248-0412-41e4-8489-bc463b6c675e req-54808dbd-c507-4345-885f-b22c0146b5ed service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received unexpected event network-vif-plugged-b5020053-395f-4341-99be-d522ebb938c7 for instance with vm_state active and task_state deleting.
Nov 06 13:26:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-bc138248-0412-41e4-8489-bc463b6c675e req-54808dbd-c507-4345-885f-b22c0146b5ed service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received event network-vif-unplugged-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:26:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-bc138248-0412-41e4-8489-bc463b6c675e req-54808dbd-c507-4345-885f-b22c0146b5ed service nova] Acquiring lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-bc138248-0412-41e4-8489-bc463b6c675e req-54808dbd-c507-4345-885f-b22c0146b5ed service nova] Lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-bc138248-0412-41e4-8489-bc463b6c675e req-54808dbd-c507-4345-885f-b22c0146b5ed service nova] Lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-bc138248-0412-41e4-8489-bc463b6c675e req-54808dbd-c507-4345-885f-b22c0146b5ed service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] No waiting events found dispatching network-vif-unplugged-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:26:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-bc138248-0412-41e4-8489-bc463b6c675e req-54808dbd-c507-4345-885f-b22c0146b5ed service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received event network-vif-unplugged-b5020053-395f-4341-99be-d522ebb938c7 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:26:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-bc138248-0412-41e4-8489-bc463b6c675e req-54808dbd-c507-4345-885f-b22c0146b5ed service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received event network-vif-plugged-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:26:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-bc138248-0412-41e4-8489-bc463b6c675e req-54808dbd-c507-4345-885f-b22c0146b5ed service nova] Acquiring lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-bc138248-0412-41e4-8489-bc463b6c675e req-54808dbd-c507-4345-885f-b22c0146b5ed service nova] Lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-bc138248-0412-41e4-8489-bc463b6c675e req-54808dbd-c507-4345-885f-b22c0146b5ed service nova] Lock "61beb251-4345-44e6-a176-5c14c99c9a52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-bc138248-0412-41e4-8489-bc463b6c675e req-54808dbd-c507-4345-885f-b22c0146b5ed service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] No waiting events found dispatching network-vif-plugged-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:26:12 user nova-compute[74821]: WARNING nova.compute.manager [req-bc138248-0412-41e4-8489-bc463b6c675e req-54808dbd-c507-4345-885f-b22c0146b5ed service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received unexpected event network-vif-plugged-b5020053-395f-4341-99be-d522ebb938c7 for instance with vm_state active and task_state deleting.
Nov 06 13:26:12 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:26:12 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Took 2.38 seconds to deallocate network for instance.
Nov 06 13:26:13 user nova-compute[74821]: DEBUG nova.compute.manager [req-6b9d5131-7e56-44a6-b2b0-115a6a99990e req-0885716c-d85a-4b7e-bb81-82980271a2e4 service nova] [instance: 61beb251-4345-44e6-a176-5c14c99c9a52] Received event network-vif-deleted-b5020053-395f-4341-99be-d522ebb938c7 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e6d91405-fdd4-4cac-b5e3-13a70a7281ef tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e6d91405-fdd4-4cac-b5e3-13a70a7281ef tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:13 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Instance destroyed successfully.
Nov 06 13:26:13 user nova-compute[74821]: DEBUG nova.objects.instance [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lazy-loading 'resources' on Instance uuid 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:24:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2121328163',display_name='tempest-TestShelveInstance-server-2121328163',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2121328163',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwfuvsbviphz947EVvwS0hBLH0hqkvelFZBVA/BbW13Na0YbmBH7ZF7KDI0Bt918tlo46Bl4nxkVdoSqlbR//uOE/jWGnGmLRd26zKs/LiEE+tlAwNPK69p2mKNICzRTw==',key_name='tempest-TestShelveInstance-1104151437',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:25:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d32bd8dc1c9419b90607e20dfa5d50b',ramdisk_id='',reservation_id='r-14h61fxg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-570916377',owner_user_name='tempest-TestShelveInstance-570916377-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:25:02Z,user_data=None,user_id='59d98c278c9349f3a010b526679a67b3',uuid=9cf1a0c3-4719-4637-a88d-e5864b2f1c3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "address": "fa:16:3e:3f:5e:be", "network": {"id": "20103956-1e64-4c7a-bed2-24edd5ae7724", "bridge": "br-int", "label": "tempest-TestShelveInstance-307843308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d32bd8dc1c9419b90607e20dfa5d50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35b642a-82", "ovs_interfaceid": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Converting VIF {"id": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "address": "fa:16:3e:3f:5e:be", "network": {"id": "20103956-1e64-4c7a-bed2-24edd5ae7724", "bridge": "br-int", "label": "tempest-TestShelveInstance-307843308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d32bd8dc1c9419b90607e20dfa5d50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35b642a-82", "ovs_interfaceid": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:5e:be,bridge_name='br-int',has_traffic_filtering=True,id=f35b642a-825f-4e17-9b97-3c8eba32a08e,network=Network(20103956-1e64-4c7a-bed2-24edd5ae7724),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf35b642a-82') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG os_vif [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:5e:be,bridge_name='br-int',has_traffic_filtering=True,id=f35b642a-825f-4e17-9b97-3c8eba32a08e,network=Network(20103956-1e64-4c7a-bed2-24edd5ae7724),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf35b642a-82') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf35b642a-82, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7c8fa9c9-8743-46e5-98a5-0aa5299681ad) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:13 user nova-compute[74821]: INFO os_vif [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:5e:be,bridge_name='br-int',has_traffic_filtering=True,id=f35b642a-825f-4e17-9b97-3c8eba32a08e,network=Network(20103956-1e64-4c7a-bed2-24edd5ae7724),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf35b642a-82')
Nov 06 13:26:13 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VqnwLbMR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:26:13 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:26:13 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e66661-71b1-44ce-816c-d6a268d2c1be]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:26:13 user nova-compute[74821]: No targets found.
Nov 06 13:26:13 user nova-compute[74821]: iSNS:
Nov 06 13:26:13 user nova-compute[74821]: No targets found.
Nov 06 13:26:13 user nova-compute[74821]: STATIC:
Nov 06 13:26:13 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af
Nov 06 13:26:13 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:26:13 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:26:13 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a
Nov 06 13:26:13 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:26:13 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:26:13 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979
Nov 06 13:26:13 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:26:13 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:26:13 user nova-compute[74821]: FIRMWARE:
Nov 06 13:26:13 user nova-compute[74821]: No targets found.
Nov 06 13:26:13 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:26:13 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:26:13 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ee025a-ecda-451d-ae62-5bf1cef5ff47]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4bd10f-4dd8-4227-9421-0031c1c9d844]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:26:13 user nova-compute[74821]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a (non-flash)
Nov 06 13:26:13 user nova-compute[74821]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:26:13 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:26:13 user nova-compute[74821]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a (non-flash)
Nov 06 13:26:13 user nova-compute[74821]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:26:13 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e40586710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af'): ({'sdc'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Removing single pathed devices sdc {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-e6d91405-fdd4-4cac-b5e3-13a70a7281ef tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-e6d91405-fdd4-4cac-b5e3-13a70a7281ef tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b527bdff-c569-4bc5-ae2c-a5a8b3491a0a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[de011b9f-c17c-41cc-a97e-e3696866697f]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Flushing IO for device /dev/sdc {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e6d91405-fdd4-4cac-b5e3-13a70a7281ef tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.586s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4064e8a-a641-4d18-bada-08ef93c65996]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[46829833-71d1-4958-bedc-b965c7499293]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] SCSI volumes sdc have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:26:13 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-e6d91405-fdd4-4cac-b5e3-13a70a7281ef tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Deleted allocations for instance 61beb251-4345-44e6-a176-5c14c99c9a52
Nov 06 13:26:13 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e368b2c4-1b7d-45d2-b8e7-c307fe7b7c78]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2aee99-0f2c-4a6a-a9a4-a0b06a448036]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af, portal: 172.16.0.220,3260]
Nov 06 13:26:13 user nova-compute[74821]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af, portal: 172.16.0.220,3260] successful.
Nov 06 13:26:13 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e6d91405-fdd4-4cac-b5e3-13a70a7281ef tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "61beb251-4345-44e6-a176-5c14c99c9a52" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.485s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[468e89bc-a5e1-4c86-ace1-509c267b628f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] <== disconnect_volume: return (378ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:26:13 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Deleting instance files /opt/stack/data/nova/instances/9cf1a0c3-4719-4637-a88d-e5864b2f1c3c_del
Nov 06 13:26:13 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Deletion of /opt/stack/data/nova/instances/9cf1a0c3-4719-4637-a88d-e5864b2f1c3c_del complete
Nov 06 13:26:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:14 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:14 user nova-compute[74821]: DEBUG nova.compute.manager [req-2756a791-4423-4d8e-bef7-4d96bd4ab894 req-212a2f84-5729-4351-b8bc-d123d0c78ab4 service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Received event network-vif-plugged-f768a2c5-10b0-4442-9c76-3b2365a15ea1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:26:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2756a791-4423-4d8e-bef7-4d96bd4ab894 req-212a2f84-5729-4351-b8bc-d123d0c78ab4 service nova] Acquiring lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2756a791-4423-4d8e-bef7-4d96bd4ab894 req-212a2f84-5729-4351-b8bc-d123d0c78ab4 service nova] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2756a791-4423-4d8e-bef7-4d96bd4ab894 req-212a2f84-5729-4351-b8bc-d123d0c78ab4 service nova] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:14 user nova-compute[74821]: DEBUG nova.compute.manager [req-2756a791-4423-4d8e-bef7-4d96bd4ab894 req-212a2f84-5729-4351-b8bc-d123d0c78ab4 service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] No waiting events found dispatching network-vif-plugged-f768a2c5-10b0-4442-9c76-3b2365a15ea1 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:26:14 user nova-compute[74821]: WARNING nova.compute.manager [req-2756a791-4423-4d8e-bef7-4d96bd4ab894 req-212a2f84-5729-4351-b8bc-d123d0c78ab4 service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Received unexpected event network-vif-plugged-f768a2c5-10b0-4442-9c76-3b2365a15ea1 for instance with vm_state building and task_state spawning.
Nov 06 13:26:14 user nova-compute[74821]: DEBUG nova.compute.manager [req-2756a791-4423-4d8e-bef7-4d96bd4ab894 req-212a2f84-5729-4351-b8bc-d123d0c78ab4 service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Received event network-vif-plugged-f768a2c5-10b0-4442-9c76-3b2365a15ea1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:26:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2756a791-4423-4d8e-bef7-4d96bd4ab894 req-212a2f84-5729-4351-b8bc-d123d0c78ab4 service nova] Acquiring lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2756a791-4423-4d8e-bef7-4d96bd4ab894 req-212a2f84-5729-4351-b8bc-d123d0c78ab4 service nova] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2756a791-4423-4d8e-bef7-4d96bd4ab894 req-212a2f84-5729-4351-b8bc-d123d0c78ab4 service nova] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:14 user nova-compute[74821]: DEBUG nova.compute.manager [req-2756a791-4423-4d8e-bef7-4d96bd4ab894 req-212a2f84-5729-4351-b8bc-d123d0c78ab4 service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] No waiting events found dispatching network-vif-plugged-f768a2c5-10b0-4442-9c76-3b2365a15ea1 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:26:14 user nova-compute[74821]: WARNING nova.compute.manager [req-2756a791-4423-4d8e-bef7-4d96bd4ab894 req-212a2f84-5729-4351-b8bc-d123d0c78ab4 service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Received unexpected event network-vif-plugged-f768a2c5-10b0-4442-9c76-3b2365a15ea1 for instance with vm_state building and task_state spawning.
Nov 06 13:26:15 user nova-compute[74821]: DEBUG nova.compute.manager [req-47b33a8c-8887-459e-828b-fcc4899152ff req-e19f8b8d-bff0-4970-abcf-35204e360863 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Received event network-changed-f35b642a-825f-4e17-9b97-3c8eba32a08e {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:26:15 user nova-compute[74821]: DEBUG nova.compute.manager [req-47b33a8c-8887-459e-828b-fcc4899152ff req-e19f8b8d-bff0-4970-abcf-35204e360863 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Refreshing instance network info cache due to event network-changed-f35b642a-825f-4e17-9b97-3c8eba32a08e. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:26:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-47b33a8c-8887-459e-828b-fcc4899152ff req-e19f8b8d-bff0-4970-abcf-35204e360863 service nova] Acquiring lock "refresh_cache-9cf1a0c3-4719-4637-a88d-e5864b2f1c3c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:26:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-47b33a8c-8887-459e-828b-fcc4899152ff req-e19f8b8d-bff0-4970-abcf-35204e360863 service nova] Acquired lock "refresh_cache-9cf1a0c3-4719-4637-a88d-e5864b2f1c3c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:26:15 user nova-compute[74821]: DEBUG nova.network.neutron [req-47b33a8c-8887-459e-828b-fcc4899152ff req-e19f8b8d-bff0-4970-abcf-35204e360863 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Refreshing network info cache for port f35b642a-825f-4e17-9b97-3c8eba32a08e {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:26:15 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Deleted allocations for instance 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c
Nov 06 13:26:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:15 user nova-compute[74821]: DEBUG nova.objects.instance [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lazy-loading 'numa_topology' on Instance uuid 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:26:15 user nova-compute[74821]: DEBUG nova.objects.base [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Object Instance<9cf1a0c3-4719-4637-a88d-e5864b2f1c3c> lazy-loaded attributes: resources,numa_topology {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:26:15 user nova-compute[74821]: DEBUG nova.compute.manager [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:26:15 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:26:15 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Instance spawned successfully.
Nov 06 13:26:15 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:26:15 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:26:15 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:26:15 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:26:15 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:26:15 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:26:15 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:26:15 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:26:15 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:26:15 user nova-compute[74821]: DEBUG nova.network.neutron [req-47b33a8c-8887-459e-828b-fcc4899152ff req-e19f8b8d-bff0-4970-abcf-35204e360863 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Updated VIF entry in instance network info cache for port f35b642a-825f-4e17-9b97-3c8eba32a08e. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:26:15 user nova-compute[74821]: DEBUG nova.network.neutron [req-47b33a8c-8887-459e-828b-fcc4899152ff req-e19f8b8d-bff0-4970-abcf-35204e360863 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Updating instance_info_cache with network_info: [{"id": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "address": "fa:16:3e:3f:5e:be", "network": {"id": "20103956-1e64-4c7a-bed2-24edd5ae7724", "bridge": null, "label": "tempest-TestShelveInstance-307843308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d32bd8dc1c9419b90607e20dfa5d50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapf35b642a-82", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:26:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-47b33a8c-8887-459e-828b-fcc4899152ff req-e19f8b8d-bff0-4970-abcf-35204e360863 service nova] Releasing lock "refresh_cache-9cf1a0c3-4719-4637-a88d-e5864b2f1c3c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:26:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.487s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:15 user nova-compute[74821]: INFO nova.compute.manager [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Took 7.36 seconds to spawn the instance on the hypervisor.
Nov 06 13:26:15 user nova-compute[74821]: DEBUG nova.compute.manager [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:26:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-cf024bf1-8453-423f-9c0e-bc1f9d215217 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 6.826s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:15 user nova-compute[74821]: INFO nova.compute.manager [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Took 8.40 seconds to build instance.
Nov 06 13:26:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7483fc30-ae41-4a4b-bf7d-ba082e0cb459 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.534s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:16 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5a07f64b-5b12-4e7d-a041-ad591141aa17 is timed out.
Nov 06 13:26:16 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Successfully detached device vdb from instance 5a07f64b-5b12-4e7d-a041-ad591141aa17 from the live domain config.
Nov 06 13:26:16 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ktZqSKLl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:26:16 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:26:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52a76d6-82f6-45be-af37-7361c4e79aff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:26:16 user nova-compute[74821]: No targets found.
Nov 06 13:26:16 user nova-compute[74821]: iSNS:
Nov 06 13:26:16 user nova-compute[74821]: No targets found.
Nov 06 13:26:16 user nova-compute[74821]: STATIC:
Nov 06 13:26:16 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a
Nov 06 13:26:16 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:26:16 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:26:16 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979
Nov 06 13:26:16 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:26:16 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:26:16 user nova-compute[74821]: FIRMWARE:
Nov 06 13:26:16 user nova-compute[74821]: No targets found.
Nov 06 13:26:16 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:26:16 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:26:16 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4397f0c-aa77-4bc7-b873-454f153c2932]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c89751a-bd3b-4706-b637-331d228d7fea]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:26:16 user nova-compute[74821]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a (non-flash)
Nov 06 13:26:16 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:26:16 user nova-compute[74821]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a (non-flash)
Nov 06 13:26:16 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e405f11b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a'): ({'sdg'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Removing single pathed devices sdg {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad1fb42-683e-4759-afde-3e0044485fa6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5997b9-67cd-4c10-98f6-40f088b43459]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Flushing IO for device /dev/sdg {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbc6cdd-b527-412f-8c43-cf581c2dabdd]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.057s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a97f90-3a9c-4e10-a0b0-eab1a3c64bcd]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] SCSI volumes sdg have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2231562-77a9-4b67-b991-a93811f20be9]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb96e35e-f21c-4f55-950e-5de1b9cbd71e]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a, portal: 172.16.0.220,3260]
Nov 06 13:26:16 user nova-compute[74821]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a, portal: 172.16.0.220,3260] successful.
Nov 06 13:26:16 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b42dbce4-83ea-498c-abcf-86517f54ae3a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd617f83-5f85-4c25-9dca-34c30dbd2a8f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] <== disconnect_volume: return (348ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:26:16 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:26:17 user nova-compute[74821]: DEBUG nova.objects.instance [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lazy-loading 'flavor' on Instance uuid 5a07f64b-5b12-4e7d-a041-ad591141aa17 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:26:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-69133ada-dbe1-4842-ae6d-3c868ddd2bd8 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.191s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:31 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:34 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:26:34 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:26:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Acquiring lock "4bc6444e-b55d-4d81-88d1-f4d147255119" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "4bc6444e-b55d-4d81-88d1-f4d147255119" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:35 user nova-compute[74821]: DEBUG nova.compute.manager [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:26:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:35 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:26:35 user nova-compute[74821]: INFO nova.compute.claims [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Claim successful on node user
Nov 06 13:26:35 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:26:36 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:26:36 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:26:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.497s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:36 user nova-compute[74821]: DEBUG nova.compute.manager [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:26:36 user nova-compute[74821]: DEBUG nova.compute.manager [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:26:36 user nova-compute[74821]: DEBUG nova.network.neutron [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:26:36 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:26:36 user nova-compute[74821]: DEBUG nova.compute.manager [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:26:36 user nova-compute[74821]: DEBUG nova.policy [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '188b10f8df7848288e07c92dd9a33597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608cf017c43942a4a94982b1d5d4d2b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:26:36 user nova-compute[74821]: DEBUG nova.compute.manager [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:26:36 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:26:36 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Creating image(s)
Nov 06 13:26:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Acquiring lock "/opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "/opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "/opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.207s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.185s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk 1073741824" returned: 0 in 0.055s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.178s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:37 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:26:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:37 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Cannot resize image /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:26:37 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:26:37 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Ensure instance console log exists: /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:26:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:37 user nova-compute[74821]: DEBUG nova.network.neutron [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Successfully created port: b317cb51-20ab-4f25-b3de-4c2981a97993 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:26:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:38 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:26:38 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Didn't find any instances for network info cache update. {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG nova.network.neutron [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Successfully updated port: b317cb51-20ab-4f25-b3de-4c2981a97993 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Acquiring lock "refresh_cache-4bc6444e-b55d-4d81-88d1-f4d147255119" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Acquired lock "refresh_cache-4bc6444e-b55d-4d81-88d1-f4d147255119" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG nova.network.neutron [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG nova.compute.manager [req-8b558f80-bfd8-4781-8991-0d49cd6b54b8 req-25f66ed0-19fd-40de-a2cb-17e4b3a95ee3 service nova] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Received event network-changed-b317cb51-20ab-4f25-b3de-4c2981a97993 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG nova.compute.manager [req-8b558f80-bfd8-4781-8991-0d49cd6b54b8 req-25f66ed0-19fd-40de-a2cb-17e4b3a95ee3 service nova] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Refreshing instance network info cache due to event network-changed-b317cb51-20ab-4f25-b3de-4c2981a97993. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8b558f80-bfd8-4781-8991-0d49cd6b54b8 req-25f66ed0-19fd-40de-a2cb-17e4b3a95ee3 service nova] Acquiring lock "refresh_cache-4bc6444e-b55d-4d81-88d1-f4d147255119" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG nova.network.neutron [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Acquiring lock "89b04a09-41d8-461f-8d14-bb3b9c72ed76" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "89b04a09-41d8-461f-8d14-bb3b9c72ed76" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG nova.compute.manager [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG nova.network.neutron [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Updating instance_info_cache with network_info: [{"id": "b317cb51-20ab-4f25-b3de-4c2981a97993", "address": "fa:16:3e:28:c0:6e", "network": {"id": "5e673907-9763-4136-845d-b3154200d004", "bridge": "br-int", "label": "tempest-TestStampPattern-539864653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608cf017c43942a4a94982b1d5d4d2b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb317cb51-20", "ovs_interfaceid": "b317cb51-20ab-4f25-b3de-4c2981a97993", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Releasing lock "refresh_cache-4bc6444e-b55d-4d81-88d1-f4d147255119" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG nova.compute.manager [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Instance network_info: |[{"id": "b317cb51-20ab-4f25-b3de-4c2981a97993", "address": "fa:16:3e:28:c0:6e", "network": {"id": "5e673907-9763-4136-845d-b3154200d004", "bridge": "br-int", "label": "tempest-TestStampPattern-539864653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608cf017c43942a4a94982b1d5d4d2b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb317cb51-20", "ovs_interfaceid": "b317cb51-20ab-4f25-b3de-4c2981a97993", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8b558f80-bfd8-4781-8991-0d49cd6b54b8 req-25f66ed0-19fd-40de-a2cb-17e4b3a95ee3 service nova] Acquired lock "refresh_cache-4bc6444e-b55d-4d81-88d1-f4d147255119" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG nova.network.neutron [req-8b558f80-bfd8-4781-8991-0d49cd6b54b8 req-25f66ed0-19fd-40de-a2cb-17e4b3a95ee3 service nova] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Refreshing network info cache for port b317cb51-20ab-4f25-b3de-4c2981a97993 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Start _get_guest_xml network_info=[{"id": "b317cb51-20ab-4f25-b3de-4c2981a97993", "address": "fa:16:3e:28:c0:6e", "network": {"id": "5e673907-9763-4136-845d-b3154200d004", "bridge": "br-int", "label": "tempest-TestStampPattern-539864653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608cf017c43942a4a94982b1d5d4d2b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb317cb51-20", "ovs_interfaceid": "b317cb51-20ab-4f25-b3de-4c2981a97993", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:26:39 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:26:39 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:26:39 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:26:39 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:26:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-123752075',display_name='tempest-TestStampPattern-server-123752075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-123752075',id=31,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHT6BbspfsGKU4w7+rfCb2XbPvdRdiCIBLtNBrG2m7ivVKQnsl1fkuukzo4FgDo5nmrAQDc2oBOGBF9X5srYArFAUxnzu0ECbQ5DvrtDTtn/zmxbYwAAp1N2mi6fR8VQRQ==',key_name='tempest-TestStampPattern-1150007784',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='608cf017c43942a4a94982b1d5d4d2b9',ramdisk_id='',reservation_id='r-f8sf1s9g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1706680780',owner_user_name='tempest-TestStampPattern-1706680780-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:26:37Z,user_data=None,user_id='188b10f8df7848288e07c92dd9a33597',uuid=4bc6444e-b55d-4d81-88d1-f4d147255119,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b317cb51-20ab-4f25-b3de-4c2981a97993", "address": "fa:16:3e:28:c0:6e", "network": {"id": "5e673907-9763-4136-845d-b3154200d004", "bridge": "br-int", "label": "tempest-TestStampPattern-539864653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608cf017c43942a4a94982b1d5d4d2b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb317cb51-20", "ovs_interfaceid": "b317cb51-20ab-4f25-b3de-4c2981a97993", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Converting VIF {"id": "b317cb51-20ab-4f25-b3de-4c2981a97993", "address": "fa:16:3e:28:c0:6e", "network": {"id": "5e673907-9763-4136-845d-b3154200d004", "bridge": "br-int", "label": "tempest-TestStampPattern-539864653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608cf017c43942a4a94982b1d5d4d2b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb317cb51-20", "ovs_interfaceid": "b317cb51-20ab-4f25-b3de-4c2981a97993", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:c0:6e,bridge_name='br-int',has_traffic_filtering=True,id=b317cb51-20ab-4f25-b3de-4c2981a97993,network=Network(5e673907-9763-4136-845d-b3154200d004),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb317cb51-20') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG nova.objects.instance [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lazy-loading 'pci_devices' on Instance uuid 4bc6444e-b55d-4d81-88d1-f4d147255119 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:26:40 user nova-compute[74821]: INFO nova.compute.claims [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Claim successful on node user
Nov 06 13:26:40 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:26:40 user nova-compute[74821]:   <uuid>4bc6444e-b55d-4d81-88d1-f4d147255119</uuid>
Nov 06 13:26:40 user nova-compute[74821]:   <name>instance-0000001f</name>
Nov 06 13:26:40 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:26:40 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:26:40 user nova-compute[74821]:   <metadata>
Nov 06 13:26:40 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:26:40 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:26:40 user nova-compute[74821]:       <nova:name>tempest-TestStampPattern-server-123752075</nova:name>
Nov 06 13:26:40 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:26:39</nova:creationTime>
Nov 06 13:26:40 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:26:40 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:26:40 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:26:40 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:26:40 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:26:40 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:26:40 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:26:40 user nova-compute[74821]:       <nova:owner>
Nov 06 13:26:40 user nova-compute[74821]:         <nova:user uuid="188b10f8df7848288e07c92dd9a33597">tempest-TestStampPattern-1706680780-project-member</nova:user>
Nov 06 13:26:40 user nova-compute[74821]:         <nova:project uuid="608cf017c43942a4a94982b1d5d4d2b9">tempest-TestStampPattern-1706680780</nova:project>
Nov 06 13:26:40 user nova-compute[74821]:       </nova:owner>
Nov 06 13:26:40 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:26:40 user nova-compute[74821]:       <nova:ports>
Nov 06 13:26:40 user nova-compute[74821]:         <nova:port uuid="b317cb51-20ab-4f25-b3de-4c2981a97993">
Nov 06 13:26:40 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 06 13:26:40 user nova-compute[74821]:         </nova:port>
Nov 06 13:26:40 user nova-compute[74821]:       </nova:ports>
Nov 06 13:26:40 user nova-compute[74821]:     </nova:instance>
Nov 06 13:26:40 user nova-compute[74821]:   </metadata>
Nov 06 13:26:40 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:26:40 user nova-compute[74821]:     <system>
Nov 06 13:26:40 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:26:40 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:26:40 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:26:40 user nova-compute[74821]:       <entry name="serial">4bc6444e-b55d-4d81-88d1-f4d147255119</entry>
Nov 06 13:26:40 user nova-compute[74821]:       <entry name="uuid">4bc6444e-b55d-4d81-88d1-f4d147255119</entry>
Nov 06 13:26:40 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:26:40 user nova-compute[74821]:     </system>
Nov 06 13:26:40 user nova-compute[74821]:   </sysinfo>
Nov 06 13:26:40 user nova-compute[74821]:   <os>
Nov 06 13:26:40 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:26:40 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:26:40 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:26:40 user nova-compute[74821]:   </os>
Nov 06 13:26:40 user nova-compute[74821]:   <features>
Nov 06 13:26:40 user nova-compute[74821]:     <acpi/>
Nov 06 13:26:40 user nova-compute[74821]:     <apic/>
Nov 06 13:26:40 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:26:40 user nova-compute[74821]:   </features>
Nov 06 13:26:40 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:26:40 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:26:40 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:26:40 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:26:40 user nova-compute[74821]:   </clock>
Nov 06 13:26:40 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:26:40 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:26:40 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:26:40 user nova-compute[74821]:   </cpu>
Nov 06 13:26:40 user nova-compute[74821]:   <devices>
Nov 06 13:26:40 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:26:40 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:26:40 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk"/>
Nov 06 13:26:40 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:26:40 user nova-compute[74821]:     </disk>
Nov 06 13:26:40 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:26:40 user nova-compute[74821]:       <mac address="fa:16:3e:28:c0:6e"/>
Nov 06 13:26:40 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:26:40 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:26:40 user nova-compute[74821]:       <target dev="tapb317cb51-20"/>
Nov 06 13:26:40 user nova-compute[74821]:     </interface>
Nov 06 13:26:40 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:26:40 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/console.log" append="off"/>
Nov 06 13:26:40 user nova-compute[74821]:     </serial>
Nov 06 13:26:40 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:26:40 user nova-compute[74821]:     <video>
Nov 06 13:26:40 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:26:40 user nova-compute[74821]:     </video>
Nov 06 13:26:40 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:26:40 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:26:40 user nova-compute[74821]:     </rng>
Nov 06 13:26:40 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:26:40 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:26:40 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:26:40 user nova-compute[74821]:     </memballoon>
Nov 06 13:26:40 user nova-compute[74821]:   </devices>
Nov 06 13:26:40 user nova-compute[74821]: </domain>
Nov 06 13:26:40 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:26:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-123752075',display_name='tempest-TestStampPattern-server-123752075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-123752075',id=31,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHT6BbspfsGKU4w7+rfCb2XbPvdRdiCIBLtNBrG2m7ivVKQnsl1fkuukzo4FgDo5nmrAQDc2oBOGBF9X5srYArFAUxnzu0ECbQ5DvrtDTtn/zmxbYwAAp1N2mi6fR8VQRQ==',key_name='tempest-TestStampPattern-1150007784',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='608cf017c43942a4a94982b1d5d4d2b9',ramdisk_id='',reservation_id='r-f8sf1s9g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1706680780',owner_user_name='tempest-TestStampPattern-1706680780-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:26:37Z,user_data=None,user_id='188b10f8df7848288e07c92dd9a33597',uuid=4bc6444e-b55d-4d81-88d1-f4d147255119,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b317cb51-20ab-4f25-b3de-4c2981a97993", "address": "fa:16:3e:28:c0:6e", "network": {"id": "5e673907-9763-4136-845d-b3154200d004", "bridge": "br-int", "label": "tempest-TestStampPattern-539864653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608cf017c43942a4a94982b1d5d4d2b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb317cb51-20", "ovs_interfaceid": "b317cb51-20ab-4f25-b3de-4c2981a97993", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Converting VIF {"id": "b317cb51-20ab-4f25-b3de-4c2981a97993", "address": "fa:16:3e:28:c0:6e", "network": {"id": "5e673907-9763-4136-845d-b3154200d004", "bridge": "br-int", "label": "tempest-TestStampPattern-539864653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608cf017c43942a4a94982b1d5d4d2b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb317cb51-20", "ovs_interfaceid": "b317cb51-20ab-4f25-b3de-4c2981a97993", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:c0:6e,bridge_name='br-int',has_traffic_filtering=True,id=b317cb51-20ab-4f25-b3de-4c2981a97993,network=Network(5e673907-9763-4136-845d-b3154200d004),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb317cb51-20') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG os_vif [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:c0:6e,bridge_name='br-int',has_traffic_filtering=True,id=b317cb51-20ab-4f25-b3de-4c2981a97993,network=Network(5e673907-9763-4136-845d-b3154200d004),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb317cb51-20') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c14c7598-dfff-521b-bc04-58a1d771d890', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb317cb51-20, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb317cb51-20, col_values=(('qos', UUID('ae559ee2-87fc-48dd-a1db-4d45b141e8fa')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb317cb51-20, col_values=(('external_ids', {'iface-id': 'b317cb51-20ab-4f25-b3de-4c2981a97993', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:c0:6e', 'vm-uuid': '4bc6444e-b55d-4d81-88d1-f4d147255119'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:40 user nova-compute[74821]: INFO os_vif [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:c0:6e,bridge_name='br-int',has_traffic_filtering=True,id=b317cb51-20ab-4f25-b3de-4c2981a97993,network=Network(5e673907-9763-4136-845d-b3154200d004),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb317cb51-20')
Nov 06 13:26:40 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] No VIF found with MAC fa:16:3e:28:c0:6e, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG nova.network.neutron [req-8b558f80-bfd8-4781-8991-0d49cd6b54b8 req-25f66ed0-19fd-40de-a2cb-17e4b3a95ee3 service nova] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Updated VIF entry in instance network info cache for port b317cb51-20ab-4f25-b3de-4c2981a97993. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG nova.network.neutron [req-8b558f80-bfd8-4781-8991-0d49cd6b54b8 req-25f66ed0-19fd-40de-a2cb-17e4b3a95ee3 service nova] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Updating instance_info_cache with network_info: [{"id": "b317cb51-20ab-4f25-b3de-4c2981a97993", "address": "fa:16:3e:28:c0:6e", "network": {"id": "5e673907-9763-4136-845d-b3154200d004", "bridge": "br-int", "label": "tempest-TestStampPattern-539864653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608cf017c43942a4a94982b1d5d4d2b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb317cb51-20", "ovs_interfaceid": "b317cb51-20ab-4f25-b3de-4c2981a97993", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8b558f80-bfd8-4781-8991-0d49cd6b54b8 req-25f66ed0-19fd-40de-a2cb-17e4b3a95ee3 service nova] Releasing lock "refresh_cache-4bc6444e-b55d-4d81-88d1-f4d147255119" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.546s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG nova.compute.manager [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG nova.compute.manager [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG nova.network.neutron [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:26:40 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:26:40 user nova-compute[74821]: DEBUG nova.compute.manager [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG nova.policy [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d34c030545b43f8a1ab4d071189d7fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f25eb95045d145c99d728e5d007ec1b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG nova.compute.manager [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:26:40 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Creating image(s)
Nov 06 13:26:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Acquiring lock "/opt/stack/data/nova/instances/89b04a09-41d8-461f-8d14-bb3b9c72ed76/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "/opt/stack/data/nova/instances/89b04a09-41d8-461f-8d14-bb3b9c72ed76/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "/opt/stack/data/nova/instances/89b04a09-41d8-461f-8d14-bb3b9c72ed76/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.200s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.190s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/89b04a09-41d8-461f-8d14-bb3b9c72ed76/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/89b04a09-41d8-461f-8d14-bb3b9c72ed76/disk 1073741824" returned: 0 in 0.059s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.209s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:41 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Checking if we can resize image /opt/stack/data/nova/instances/89b04a09-41d8-461f-8d14-bb3b9c72ed76/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:26:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b04a09-41d8-461f-8d14-bb3b9c72ed76/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:41 user nova-compute[74821]: DEBUG nova.network.neutron [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Successfully created port: aa074cf5-9a21-409b-8200-453a48485332 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:26:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b04a09-41d8-461f-8d14-bb3b9c72ed76/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:41 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Cannot resize image /opt/stack/data/nova/instances/89b04a09-41d8-461f-8d14-bb3b9c72ed76/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:26:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:26:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Ensure instance console log exists: /opt/stack/data/nova/instances/89b04a09-41d8-461f-8d14-bb3b9c72ed76/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:26:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:41 user nova-compute[74821]: DEBUG nova.compute.manager [req-a3faab3e-0b67-4c49-ad35-7b444bfc0415 req-0cc625a6-dfc2-4389-9ab4-efcd556e47a8 service nova] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Received event network-vif-plugged-b317cb51-20ab-4f25-b3de-4c2981a97993 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:26:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-a3faab3e-0b67-4c49-ad35-7b444bfc0415 req-0cc625a6-dfc2-4389-9ab4-efcd556e47a8 service nova] Acquiring lock "4bc6444e-b55d-4d81-88d1-f4d147255119-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-a3faab3e-0b67-4c49-ad35-7b444bfc0415 req-0cc625a6-dfc2-4389-9ab4-efcd556e47a8 service nova] Lock "4bc6444e-b55d-4d81-88d1-f4d147255119-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-a3faab3e-0b67-4c49-ad35-7b444bfc0415 req-0cc625a6-dfc2-4389-9ab4-efcd556e47a8 service nova] Lock "4bc6444e-b55d-4d81-88d1-f4d147255119-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:41 user nova-compute[74821]: DEBUG nova.compute.manager [req-a3faab3e-0b67-4c49-ad35-7b444bfc0415 req-0cc625a6-dfc2-4389-9ab4-efcd556e47a8 service nova] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] No waiting events found dispatching network-vif-plugged-b317cb51-20ab-4f25-b3de-4c2981a97993 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:26:41 user nova-compute[74821]: WARNING nova.compute.manager [req-a3faab3e-0b67-4c49-ad35-7b444bfc0415 req-0cc625a6-dfc2-4389-9ab4-efcd556e47a8 service nova] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Received unexpected event network-vif-plugged-b317cb51-20ab-4f25-b3de-4c2981a97993 for instance with vm_state building and task_state spawning.
Nov 06 13:26:41 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:26:41 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:26:41 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Cleaning up deleted instances {{(pid=74821) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] There are 0 instances to clean {{(pid=74821) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.network.neutron [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Successfully updated port: aa074cf5-9a21-409b-8200-453a48485332 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Acquiring lock "refresh_cache-89b04a09-41d8-461f-8d14-bb3b9c72ed76" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Acquired lock "refresh_cache-89b04a09-41d8-461f-8d14-bb3b9c72ed76" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.network.neutron [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.compute.manager [req-7bd061a7-57e5-4a9d-8e11-7071d0009e4a req-c5a4ff27-44ea-4181-9207-4fb0ef917ca4 service nova] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Received event network-changed-aa074cf5-9a21-409b-8200-453a48485332 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.compute.manager [req-7bd061a7-57e5-4a9d-8e11-7071d0009e4a req-c5a4ff27-44ea-4181-9207-4fb0ef917ca4 service nova] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Refreshing instance network info cache due to event network-changed-aa074cf5-9a21-409b-8200-453a48485332. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-7bd061a7-57e5-4a9d-8e11-7071d0009e4a req-c5a4ff27-44ea-4181-9207-4fb0ef917ca4 service nova] Acquiring lock "refresh_cache-89b04a09-41d8-461f-8d14-bb3b9c72ed76" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.network.neutron [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.network.neutron [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Updating instance_info_cache with network_info: [{"id": "aa074cf5-9a21-409b-8200-453a48485332", "address": "fa:16:3e:af:cb:31", "network": {"id": "9fe30aa2-5c5b-448b-8bd5-cdeda2721e6b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2097801930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f25eb95045d145c99d728e5d007ec1b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa074cf5-9a", "ovs_interfaceid": "aa074cf5-9a21-409b-8200-453a48485332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Releasing lock "refresh_cache-89b04a09-41d8-461f-8d14-bb3b9c72ed76" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.compute.manager [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Instance network_info: |[{"id": "aa074cf5-9a21-409b-8200-453a48485332", "address": "fa:16:3e:af:cb:31", "network": {"id": "9fe30aa2-5c5b-448b-8bd5-cdeda2721e6b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2097801930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f25eb95045d145c99d728e5d007ec1b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa074cf5-9a", "ovs_interfaceid": "aa074cf5-9a21-409b-8200-453a48485332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-7bd061a7-57e5-4a9d-8e11-7071d0009e4a req-c5a4ff27-44ea-4181-9207-4fb0ef917ca4 service nova] Acquired lock "refresh_cache-89b04a09-41d8-461f-8d14-bb3b9c72ed76" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.network.neutron [req-7bd061a7-57e5-4a9d-8e11-7071d0009e4a req-c5a4ff27-44ea-4181-9207-4fb0ef917ca4 service nova] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Refreshing network info cache for port aa074cf5-9a21-409b-8200-453a48485332 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Start _get_guest_xml network_info=[{"id": "aa074cf5-9a21-409b-8200-453a48485332", "address": "fa:16:3e:af:cb:31", "network": {"id": "9fe30aa2-5c5b-448b-8bd5-cdeda2721e6b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2097801930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f25eb95045d145c99d728e5d007ec1b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa074cf5-9a", "ovs_interfaceid": "aa074cf5-9a21-409b-8200-453a48485332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:26:42 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:26:42 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:26:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-899326587',display_name='tempest-VolumesSnapshotTestJSON-instance-899326587',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-899326587',id=32,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCOy7DwGbcANolD65+FZ4hSu7p2w6YSA9X0IjZDwI5q2Yj2a/maudSFXH9hOYXHHIhD4XNrdqAMO2EIILQMv6ov5Ydpo6W6JXRrgcfrkrXdNKJU8LTugugxJPfU42EasA==',key_name='tempest-keypair-1680964766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f25eb95045d145c99d728e5d007ec1b6',ramdisk_id='',reservation_id='r-fb4kdg6t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1889603116',owner_user_name='tempest-VolumesSnapshotTestJSON-1889603116-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:26:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d34c030545b43f8a1ab4d071189d7fc',uuid=89b04a09-41d8-461f-8d14-bb3b9c72ed76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa074cf5-9a21-409b-8200-453a48485332", "address": "fa:16:3e:af:cb:31", "network": {"id": "9fe30aa2-5c5b-448b-8bd5-cdeda2721e6b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2097801930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f25eb95045d145c99d728e5d007ec1b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa074cf5-9a", "ovs_interfaceid": "aa074cf5-9a21-409b-8200-453a48485332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Converting VIF {"id": "aa074cf5-9a21-409b-8200-453a48485332", "address": "fa:16:3e:af:cb:31", "network": {"id": "9fe30aa2-5c5b-448b-8bd5-cdeda2721e6b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2097801930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f25eb95045d145c99d728e5d007ec1b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa074cf5-9a", "ovs_interfaceid": "aa074cf5-9a21-409b-8200-453a48485332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:cb:31,bridge_name='br-int',has_traffic_filtering=True,id=aa074cf5-9a21-409b-8200-453a48485332,network=Network(9fe30aa2-5c5b-448b-8bd5-cdeda2721e6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa074cf5-9a') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.objects.instance [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lazy-loading 'pci_devices' on Instance uuid 89b04a09-41d8-461f-8d14-bb3b9c72ed76 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:26:42 user nova-compute[74821]:   <uuid>89b04a09-41d8-461f-8d14-bb3b9c72ed76</uuid>
Nov 06 13:26:42 user nova-compute[74821]:   <name>instance-00000020</name>
Nov 06 13:26:42 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:26:42 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:26:42 user nova-compute[74821]:   <metadata>
Nov 06 13:26:42 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:26:42 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:26:42 user nova-compute[74821]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-899326587</nova:name>
Nov 06 13:26:42 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:26:42</nova:creationTime>
Nov 06 13:26:42 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:26:42 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:26:42 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:26:42 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:26:42 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:26:42 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:26:42 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:26:42 user nova-compute[74821]:       <nova:owner>
Nov 06 13:26:42 user nova-compute[74821]:         <nova:user uuid="4d34c030545b43f8a1ab4d071189d7fc">tempest-VolumesSnapshotTestJSON-1889603116-project-member</nova:user>
Nov 06 13:26:42 user nova-compute[74821]:         <nova:project uuid="f25eb95045d145c99d728e5d007ec1b6">tempest-VolumesSnapshotTestJSON-1889603116</nova:project>
Nov 06 13:26:42 user nova-compute[74821]:       </nova:owner>
Nov 06 13:26:42 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:26:42 user nova-compute[74821]:       <nova:ports>
Nov 06 13:26:42 user nova-compute[74821]:         <nova:port uuid="aa074cf5-9a21-409b-8200-453a48485332">
Nov 06 13:26:42 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 06 13:26:42 user nova-compute[74821]:         </nova:port>
Nov 06 13:26:42 user nova-compute[74821]:       </nova:ports>
Nov 06 13:26:42 user nova-compute[74821]:     </nova:instance>
Nov 06 13:26:42 user nova-compute[74821]:   </metadata>
Nov 06 13:26:42 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:26:42 user nova-compute[74821]:     <system>
Nov 06 13:26:42 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:26:42 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:26:42 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:26:42 user nova-compute[74821]:       <entry name="serial">89b04a09-41d8-461f-8d14-bb3b9c72ed76</entry>
Nov 06 13:26:42 user nova-compute[74821]:       <entry name="uuid">89b04a09-41d8-461f-8d14-bb3b9c72ed76</entry>
Nov 06 13:26:42 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:26:42 user nova-compute[74821]:     </system>
Nov 06 13:26:42 user nova-compute[74821]:   </sysinfo>
Nov 06 13:26:42 user nova-compute[74821]:   <os>
Nov 06 13:26:42 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:26:42 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:26:42 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:26:42 user nova-compute[74821]:   </os>
Nov 06 13:26:42 user nova-compute[74821]:   <features>
Nov 06 13:26:42 user nova-compute[74821]:     <acpi/>
Nov 06 13:26:42 user nova-compute[74821]:     <apic/>
Nov 06 13:26:42 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:26:42 user nova-compute[74821]:   </features>
Nov 06 13:26:42 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:26:42 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:26:42 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:26:42 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:26:42 user nova-compute[74821]:   </clock>
Nov 06 13:26:42 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:26:42 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:26:42 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:26:42 user nova-compute[74821]:   </cpu>
Nov 06 13:26:42 user nova-compute[74821]:   <devices>
Nov 06 13:26:42 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:26:42 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:26:42 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/89b04a09-41d8-461f-8d14-bb3b9c72ed76/disk"/>
Nov 06 13:26:42 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:26:42 user nova-compute[74821]:     </disk>
Nov 06 13:26:42 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:26:42 user nova-compute[74821]:       <mac address="fa:16:3e:af:cb:31"/>
Nov 06 13:26:42 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:26:42 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:26:42 user nova-compute[74821]:       <target dev="tapaa074cf5-9a"/>
Nov 06 13:26:42 user nova-compute[74821]:     </interface>
Nov 06 13:26:42 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:26:42 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/89b04a09-41d8-461f-8d14-bb3b9c72ed76/console.log" append="off"/>
Nov 06 13:26:42 user nova-compute[74821]:     </serial>
Nov 06 13:26:42 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:26:42 user nova-compute[74821]:     <video>
Nov 06 13:26:42 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:26:42 user nova-compute[74821]:     </video>
Nov 06 13:26:42 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:26:42 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:26:42 user nova-compute[74821]:     </rng>
Nov 06 13:26:42 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:26:42 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:26:42 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:26:42 user nova-compute[74821]:     </memballoon>
Nov 06 13:26:42 user nova-compute[74821]:   </devices>
Nov 06 13:26:42 user nova-compute[74821]: </domain>
Nov 06 13:26:42 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:26:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-899326587',display_name='tempest-VolumesSnapshotTestJSON-instance-899326587',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-899326587',id=32,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCOy7DwGbcANolD65+FZ4hSu7p2w6YSA9X0IjZDwI5q2Yj2a/maudSFXH9hOYXHHIhD4XNrdqAMO2EIILQMv6ov5Ydpo6W6JXRrgcfrkrXdNKJU8LTugugxJPfU42EasA==',key_name='tempest-keypair-1680964766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f25eb95045d145c99d728e5d007ec1b6',ramdisk_id='',reservation_id='r-fb4kdg6t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1889603116',owner_user_name='tempest-VolumesSnapshotTestJSON-1889603116-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:26:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d34c030545b43f8a1ab4d071189d7fc',uuid=89b04a09-41d8-461f-8d14-bb3b9c72ed76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa074cf5-9a21-409b-8200-453a48485332", "address": "fa:16:3e:af:cb:31", "network": {"id": "9fe30aa2-5c5b-448b-8bd5-cdeda2721e6b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2097801930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f25eb95045d145c99d728e5d007ec1b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa074cf5-9a", "ovs_interfaceid": "aa074cf5-9a21-409b-8200-453a48485332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Converting VIF {"id": "aa074cf5-9a21-409b-8200-453a48485332", "address": "fa:16:3e:af:cb:31", "network": {"id": "9fe30aa2-5c5b-448b-8bd5-cdeda2721e6b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2097801930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f25eb95045d145c99d728e5d007ec1b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa074cf5-9a", "ovs_interfaceid": "aa074cf5-9a21-409b-8200-453a48485332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:cb:31,bridge_name='br-int',has_traffic_filtering=True,id=aa074cf5-9a21-409b-8200-453a48485332,network=Network(9fe30aa2-5c5b-448b-8bd5-cdeda2721e6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa074cf5-9a') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG os_vif [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:cb:31,bridge_name='br-int',has_traffic_filtering=True,id=aa074cf5-9a21-409b-8200-453a48485332,network=Network(9fe30aa2-5c5b-448b-8bd5-cdeda2721e6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa074cf5-9a') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cee3284f-99a3-5175-b80a-1c46d8b697f2', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa074cf5-9a, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaa074cf5-9a, col_values=(('qos', UUID('a00b49e2-ed34-415b-af5d-3fe580befa2d')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaa074cf5-9a, col_values=(('external_ids', {'iface-id': 'aa074cf5-9a21-409b-8200-453a48485332', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:cb:31', 'vm-uuid': '89b04a09-41d8-461f-8d14-bb3b9c72ed76'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:42 user nova-compute[74821]: INFO os_vif [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:cb:31,bridge_name='br-int',has_traffic_filtering=True,id=aa074cf5-9a21-409b-8200-453a48485332,network=Network(9fe30aa2-5c5b-448b-8bd5-cdeda2721e6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa074cf5-9a')
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] No VIF found with MAC fa:16:3e:af:cb:31, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.network.neutron [req-7bd061a7-57e5-4a9d-8e11-7071d0009e4a req-c5a4ff27-44ea-4181-9207-4fb0ef917ca4 service nova] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Updated VIF entry in instance network info cache for port aa074cf5-9a21-409b-8200-453a48485332. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:26:42 user nova-compute[74821]: DEBUG nova.network.neutron [req-7bd061a7-57e5-4a9d-8e11-7071d0009e4a req-c5a4ff27-44ea-4181-9207-4fb0ef917ca4 service nova] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Updating instance_info_cache with network_info: [{"id": "aa074cf5-9a21-409b-8200-453a48485332", "address": "fa:16:3e:af:cb:31", "network": {"id": "9fe30aa2-5c5b-448b-8bd5-cdeda2721e6b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2097801930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f25eb95045d145c99d728e5d007ec1b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa074cf5-9a", "ovs_interfaceid": "aa074cf5-9a21-409b-8200-453a48485332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:26:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-7bd061a7-57e5-4a9d-8e11-7071d0009e4a req-c5a4ff27-44ea-4181-9207-4fb0ef917ca4 service nova] Releasing lock "refresh_cache-89b04a09-41d8-461f-8d14-bb3b9c72ed76" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:26:43 user nova-compute[74821]: DEBUG nova.compute.manager [req-0ef5d2a2-97c1-4979-942b-814d033d9ba7 req-31b6251b-2518-40aa-b464-6152721fa9bf service nova] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Received event network-vif-plugged-b317cb51-20ab-4f25-b3de-4c2981a97993 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:26:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0ef5d2a2-97c1-4979-942b-814d033d9ba7 req-31b6251b-2518-40aa-b464-6152721fa9bf service nova] Acquiring lock "4bc6444e-b55d-4d81-88d1-f4d147255119-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0ef5d2a2-97c1-4979-942b-814d033d9ba7 req-31b6251b-2518-40aa-b464-6152721fa9bf service nova] Lock "4bc6444e-b55d-4d81-88d1-f4d147255119-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0ef5d2a2-97c1-4979-942b-814d033d9ba7 req-31b6251b-2518-40aa-b464-6152721fa9bf service nova] Lock "4bc6444e-b55d-4d81-88d1-f4d147255119-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:43 user nova-compute[74821]: DEBUG nova.compute.manager [req-0ef5d2a2-97c1-4979-942b-814d033d9ba7 req-31b6251b-2518-40aa-b464-6152721fa9bf service nova] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] No waiting events found dispatching network-vif-plugged-b317cb51-20ab-4f25-b3de-4c2981a97993 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:26:43 user nova-compute[74821]: WARNING nova.compute.manager [req-0ef5d2a2-97c1-4979-942b-814d033d9ba7 req-31b6251b-2518-40aa-b464-6152721fa9bf service nova] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Received unexpected event network-vif-plugged-b317cb51-20ab-4f25-b3de-4c2981a97993 for instance with vm_state building and task_state spawning.
Nov 06 13:26:44 user nova-compute[74821]: DEBUG nova.compute.manager [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:26:44 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:26:44 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Instance spawned successfully.
Nov 06 13:26:44 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:26:44 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:26:44 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:26:44 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:26:44 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:26:44 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:26:44 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:26:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:44 user nova-compute[74821]: INFO nova.compute.manager [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Took 7.32 seconds to spawn the instance on the hypervisor.
Nov 06 13:26:44 user nova-compute[74821]: DEBUG nova.compute.manager [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:26:44 user nova-compute[74821]: INFO nova.compute.manager [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Took 8.46 seconds to build instance.
Nov 06 13:26:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-716a9cb1-4878-4d4b-a146-807f5d71e674 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "4bc6444e-b55d-4d81-88d1-f4d147255119" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.603s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:44 user nova-compute[74821]: DEBUG nova.compute.manager [req-c8eb0ceb-d704-433b-9613-664a969c81e5 req-76fde97f-19bc-4a15-bbf5-f294717e9d9c service nova] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Received event network-vif-plugged-aa074cf5-9a21-409b-8200-453a48485332 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:26:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c8eb0ceb-d704-433b-9613-664a969c81e5 req-76fde97f-19bc-4a15-bbf5-f294717e9d9c service nova] Acquiring lock "89b04a09-41d8-461f-8d14-bb3b9c72ed76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c8eb0ceb-d704-433b-9613-664a969c81e5 req-76fde97f-19bc-4a15-bbf5-f294717e9d9c service nova] Lock "89b04a09-41d8-461f-8d14-bb3b9c72ed76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c8eb0ceb-d704-433b-9613-664a969c81e5 req-76fde97f-19bc-4a15-bbf5-f294717e9d9c service nova] Lock "89b04a09-41d8-461f-8d14-bb3b9c72ed76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:44 user nova-compute[74821]: DEBUG nova.compute.manager [req-c8eb0ceb-d704-433b-9613-664a969c81e5 req-76fde97f-19bc-4a15-bbf5-f294717e9d9c service nova] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] No waiting events found dispatching network-vif-plugged-aa074cf5-9a21-409b-8200-453a48485332 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:26:44 user nova-compute[74821]: WARNING nova.compute.manager [req-c8eb0ceb-d704-433b-9613-664a969c81e5 req-76fde97f-19bc-4a15-bbf5-f294717e9d9c service nova] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Received unexpected event network-vif-plugged-aa074cf5-9a21-409b-8200-453a48485332 for instance with vm_state building and task_state spawning.
Nov 06 13:26:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:44 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:26:44 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Cleaning up deleted instances with incomplete migration  {{(pid=74821) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 13:26:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:45 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:26:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:46 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:26:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-bd837f59-9c97-4aa1-b21b-679614b08a96 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Acquiring lock "5a07f64b-5b12-4e7d-a041-ad591141aa17" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-bd837f59-9c97-4aa1-b21b-679614b08a96 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-bd837f59-9c97-4aa1-b21b-679614b08a96 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Acquiring lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-bd837f59-9c97-4aa1-b21b-679614b08a96 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-bd837f59-9c97-4aa1-b21b-679614b08a96 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:46 user nova-compute[74821]: INFO nova.compute.manager [None req-bd837f59-9c97-4aa1-b21b-679614b08a96 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Terminating instance
Nov 06 13:26:46 user nova-compute[74821]: DEBUG nova.compute.manager [None req-bd837f59-9c97-4aa1-b21b-679614b08a96 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:26:46 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:46 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:46 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:46 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:46 user nova-compute[74821]: DEBUG nova.compute.manager [req-5cd25f2a-ea28-4bd9-ad90-cfc49424d71b req-4b86a15c-5704-4510-b173-0bb26db2b9c4 service nova] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Received event network-vif-plugged-aa074cf5-9a21-409b-8200-453a48485332 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:26:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5cd25f2a-ea28-4bd9-ad90-cfc49424d71b req-4b86a15c-5704-4510-b173-0bb26db2b9c4 service nova] Acquiring lock "89b04a09-41d8-461f-8d14-bb3b9c72ed76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5cd25f2a-ea28-4bd9-ad90-cfc49424d71b req-4b86a15c-5704-4510-b173-0bb26db2b9c4 service nova] Lock "89b04a09-41d8-461f-8d14-bb3b9c72ed76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5cd25f2a-ea28-4bd9-ad90-cfc49424d71b req-4b86a15c-5704-4510-b173-0bb26db2b9c4 service nova] Lock "89b04a09-41d8-461f-8d14-bb3b9c72ed76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:46 user nova-compute[74821]: DEBUG nova.compute.manager [req-5cd25f2a-ea28-4bd9-ad90-cfc49424d71b req-4b86a15c-5704-4510-b173-0bb26db2b9c4 service nova] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] No waiting events found dispatching network-vif-plugged-aa074cf5-9a21-409b-8200-453a48485332 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:26:46 user nova-compute[74821]: WARNING nova.compute.manager [req-5cd25f2a-ea28-4bd9-ad90-cfc49424d71b req-4b86a15c-5704-4510-b173-0bb26db2b9c4 service nova] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Received unexpected event network-vif-plugged-aa074cf5-9a21-409b-8200-453a48485332 for instance with vm_state building and task_state spawning.
Nov 06 13:26:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b04a09-41d8-461f-8d14-bb3b9c72ed76/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:46 user nova-compute[74821]: DEBUG nova.compute.manager [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:26:46 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:26:46 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Instance spawned successfully.
Nov 06 13:26:46 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:26:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b04a09-41d8-461f-8d14-bb3b9c72ed76/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b04a09-41d8-461f-8d14-bb3b9c72ed76/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:47 user nova-compute[74821]: DEBUG nova.compute.manager [req-befdd6d7-e39e-447f-81e3-a25d3e1f61a5 req-dc365502-6f47-4676-b5b5-7be9ca4f3fc9 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received event network-vif-unplugged-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:26:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-befdd6d7-e39e-447f-81e3-a25d3e1f61a5 req-dc365502-6f47-4676-b5b5-7be9ca4f3fc9 service nova] Acquiring lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-befdd6d7-e39e-447f-81e3-a25d3e1f61a5 req-dc365502-6f47-4676-b5b5-7be9ca4f3fc9 service nova] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-befdd6d7-e39e-447f-81e3-a25d3e1f61a5 req-dc365502-6f47-4676-b5b5-7be9ca4f3fc9 service nova] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:47 user nova-compute[74821]: DEBUG nova.compute.manager [req-befdd6d7-e39e-447f-81e3-a25d3e1f61a5 req-dc365502-6f47-4676-b5b5-7be9ca4f3fc9 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] No waiting events found dispatching network-vif-unplugged-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:26:47 user nova-compute[74821]: DEBUG nova.compute.manager [req-befdd6d7-e39e-447f-81e3-a25d3e1f61a5 req-dc365502-6f47-4676-b5b5-7be9ca4f3fc9 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received event network-vif-unplugged-db18095e-82aa-407a-b43f-5f060b8c64ec for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:26:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:26:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:26:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:26:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:26:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:26:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:26:47 user nova-compute[74821]: INFO nova.compute.manager [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Took 6.36 seconds to spawn the instance on the hypervisor.
Nov 06 13:26:47 user nova-compute[74821]: DEBUG nova.compute.manager [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:26:47 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Instance destroyed successfully.
Nov 06 13:26:47 user nova-compute[74821]: DEBUG nova.objects.instance [None req-bd837f59-9c97-4aa1-b21b-679614b08a96 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lazy-loading 'resources' on Instance uuid 5a07f64b-5b12-4e7d-a041-ad591141aa17 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:26:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b04a09-41d8-461f-8d14-bb3b9c72ed76/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-bd837f59-9c97-4aa1-b21b-679614b08a96 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:19:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1004493493',display_name='tempest-ServerStableDeviceRescueTest-server-1004493493',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1004493493',id=22,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBv29rmsLsLYiSk9kbTOijARa8gu+ah6i2bQrZxKfobLwcDnuJUCtjfp+YJRgwX32aeI6MDK+wE0irmaV53pFlnbi+Na7GAsfUUsSfu+9E+Izyqg0uf2ImUG12ugRFqtGw==',key_name='tempest-keypair-1601620280',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:23:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63d867544bce424f90bcb0403e953f59',ramdisk_id='',reservation_id='r-h5j27ucc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-273439640',owner_user_name='tempest-ServerStableDeviceRescueTest-273439640-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:25:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c788f2d8493b4bbab80872eba4045fb0',uuid=5a07f64b-5b12-4e7d-a041-ad591141aa17,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db18095e-82aa-407a-b43f-5f060b8c64ec", "address": "fa:16:3e:30:ef:48", "network": {"id": "79eddc13-4e87-497c-af1f-ce215f23e831", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412663699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d867544bce424f90bcb0403e953f59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb18095e-82", "ovs_interfaceid": "db18095e-82aa-407a-b43f-5f060b8c64ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:26:47 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-bd837f59-9c97-4aa1-b21b-679614b08a96 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Converting VIF {"id": "db18095e-82aa-407a-b43f-5f060b8c64ec", "address": "fa:16:3e:30:ef:48", "network": {"id": "79eddc13-4e87-497c-af1f-ce215f23e831", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412663699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63d867544bce424f90bcb0403e953f59", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb18095e-82", "ovs_interfaceid": "db18095e-82aa-407a-b43f-5f060b8c64ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:26:47 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-bd837f59-9c97-4aa1-b21b-679614b08a96 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:ef:48,bridge_name='br-int',has_traffic_filtering=True,id=db18095e-82aa-407a-b43f-5f060b8c64ec,network=Network(79eddc13-4e87-497c-af1f-ce215f23e831),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb18095e-82') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:26:47 user nova-compute[74821]: DEBUG os_vif [None req-bd837f59-9c97-4aa1-b21b-679614b08a96 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:ef:48,bridge_name='br-int',has_traffic_filtering=True,id=db18095e-82aa-407a-b43f-5f060b8c64ec,network=Network(79eddc13-4e87-497c-af1f-ce215f23e831),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb18095e-82') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:26:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb18095e-82, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:26:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:26:47 user nova-compute[74821]: INFO nova.compute.manager [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Took 7.33 seconds to build instance.
Nov 06 13:26:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3546c493-a409-40de-ba11-8472920680a1) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:26:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1c60a1e6-a6c1-4696-865e-126100137439 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "89b04a09-41d8-461f-8d14-bb3b9c72ed76" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.483s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:47 user nova-compute[74821]: INFO os_vif [None req-bd837f59-9c97-4aa1-b21b-679614b08a96 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:ef:48,bridge_name='br-int',has_traffic_filtering=True,id=db18095e-82aa-407a-b43f-5f060b8c64ec,network=Network(79eddc13-4e87-497c-af1f-ce215f23e831),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb18095e-82')
Nov 06 13:26:47 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-bd837f59-9c97-4aa1-b21b-679614b08a96 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Deleting instance files /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17_del
Nov 06 13:26:47 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-bd837f59-9c97-4aa1-b21b-679614b08a96 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Deletion of /opt/stack/data/nova/instances/5a07f64b-5b12-4e7d-a041-ad591141aa17_del complete
Nov 06 13:26:47 user nova-compute[74821]: INFO nova.compute.manager [None req-bd837f59-9c97-4aa1-b21b-679614b08a96 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 06 13:26:47 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-bd837f59-9c97-4aa1-b21b-679614b08a96 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:26:47 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:26:47 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:26:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d42894d4-98df-46dc-a8e9-137035b948a4/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d42894d4-98df-46dc-a8e9-137035b948a4/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d42894d4-98df-46dc-a8e9-137035b948a4/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d42894d4-98df-46dc-a8e9-137035b948a4/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:48 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Error from libvirt while getting description of instance-00000016: [Error Code 42] Domain not found: no domain with matching uuid '5a07f64b-5b12-4e7d-a041-ad591141aa17' (instance-00000016): libvirt.libvirtError: Domain not found: no domain with matching uuid '5a07f64b-5b12-4e7d-a041-ad591141aa17' (instance-00000016)
Nov 06 13:26:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:48 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:26:48 user nova-compute[74821]: DEBUG nova.compute.manager [req-ef355cf2-ec20-417d-8289-c5ed1bf882d1 req-e396c5cc-5d4d-417e-88b3-5773ad42b362 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received event network-vif-deleted-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:26:48 user nova-compute[74821]: INFO nova.compute.manager [req-ef355cf2-ec20-417d-8289-c5ed1bf882d1 req-e396c5cc-5d4d-417e-88b3-5773ad42b362 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Neutron deleted interface db18095e-82aa-407a-b43f-5f060b8c64ec; detaching it from the instance and deleting it from the info cache
Nov 06 13:26:48 user nova-compute[74821]: DEBUG nova.network.neutron [req-ef355cf2-ec20-417d-8289-c5ed1bf882d1 req-e396c5cc-5d4d-417e-88b3-5773ad42b362 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:26:48 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Took 1.14 seconds to deallocate network for instance.
Nov 06 13:26:48 user nova-compute[74821]: DEBUG nova.compute.manager [req-ef355cf2-ec20-417d-8289-c5ed1bf882d1 req-e396c5cc-5d4d-417e-88b3-5773ad42b362 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Detach interface failed, port_id=db18095e-82aa-407a-b43f-5f060b8c64ec, reason: Instance 5a07f64b-5b12-4e7d-a041-ad591141aa17 could not be found. {{(pid=74821) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 13:26:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-bd837f59-9c97-4aa1-b21b-679614b08a96 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-bd837f59-9c97-4aa1-b21b-679614b08a96 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:48 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-bd837f59-9c97-4aa1-b21b-679614b08a96 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Refreshing inventories for resource provider a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 13:26:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:48 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-bd837f59-9c97-4aa1-b21b-679614b08a96 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Updating ProviderTree inventory for provider a45ec519-15f5-48fe-877b-466db09f8afe from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 13:26:48 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-bd837f59-9c97-4aa1-b21b-679614b08a96 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Updating inventory in ProviderTree for provider a45ec519-15f5-48fe-877b-466db09f8afe with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 13:26:48 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-bd837f59-9c97-4aa1-b21b-679614b08a96 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Refreshing aggregate associations for resource provider a45ec519-15f5-48fe-877b-466db09f8afe, aggregates: None {{(pid=74821) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 13:26:49 user nova-compute[74821]: DEBUG nova.compute.manager [req-99ae4602-eb5a-4fe6-baf7-0b277fd7ebc8 req-18b469e1-98f1-4921-b353-5fe78a1ba1e0 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received event network-vif-plugged-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:26:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-99ae4602-eb5a-4fe6-baf7-0b277fd7ebc8 req-18b469e1-98f1-4921-b353-5fe78a1ba1e0 service nova] Acquiring lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-99ae4602-eb5a-4fe6-baf7-0b277fd7ebc8 req-18b469e1-98f1-4921-b353-5fe78a1ba1e0 service nova] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-99ae4602-eb5a-4fe6-baf7-0b277fd7ebc8 req-18b469e1-98f1-4921-b353-5fe78a1ba1e0 service nova] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:49 user nova-compute[74821]: DEBUG nova.compute.manager [req-99ae4602-eb5a-4fe6-baf7-0b277fd7ebc8 req-18b469e1-98f1-4921-b353-5fe78a1ba1e0 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] No waiting events found dispatching network-vif-plugged-db18095e-82aa-407a-b43f-5f060b8c64ec {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:26:49 user nova-compute[74821]: WARNING nova.compute.manager [req-99ae4602-eb5a-4fe6-baf7-0b277fd7ebc8 req-18b469e1-98f1-4921-b353-5fe78a1ba1e0 service nova] [instance: 5a07f64b-5b12-4e7d-a041-ad591141aa17] Received unexpected event network-vif-plugged-db18095e-82aa-407a-b43f-5f060b8c64ec for instance with vm_state deleted and task_state None.
Nov 06 13:26:49 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-bd837f59-9c97-4aa1-b21b-679614b08a96 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Refreshing trait associations for resource provider a45ec519-15f5-48fe-877b-466db09f8afe, traits: COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42 {{(pid=74821) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 13:26:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:49 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-bd837f59-9c97-4aa1-b21b-679614b08a96 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:26:49 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-bd837f59-9c97-4aa1-b21b-679614b08a96 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:26:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-bd837f59-9c97-4aa1-b21b-679614b08a96 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.954s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:49 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-bd837f59-9c97-4aa1-b21b-679614b08a96 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Deleted allocations for instance 5a07f64b-5b12-4e7d-a041-ad591141aa17
Nov 06 13:26:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-bd837f59-9c97-4aa1-b21b-679614b08a96 tempest-ServerStableDeviceRescueTest-273439640 tempest-ServerStableDeviceRescueTest-273439640-project-member] Lock "5a07f64b-5b12-4e7d-a041-ad591141aa17" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.543s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:26:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:26:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:26:51 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:26:51 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:26:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=7555MB free_disk=25.11666488647461GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:26:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:26:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:26:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 3e21d005-f190-478a-a911-e483e1235057 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:26:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 311817c5-7b08-4da9-98eb-c685f37e6fd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:26:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 2de346cb-9858-47b8-a86c-4fde720d6127 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:26:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 49c65aca-8392-46ba-8fa3-b47ff2416cb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:26:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 496f8213-4b32-4211-a354-e33a4a088848 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:26:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 1290bdb3-827f-4365-a4f1-4ae063de780d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:26:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance d42894d4-98df-46dc-a8e9-137035b948a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:26:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 2d8da345-f66d-45c2-8ccd-d22fdf79a14d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:26:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 4bc6444e-b55d-4d81-88d1-f4d147255119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:26:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 89b04a09-41d8-461f-8d14-bb3b9c72ed76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:26:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:26:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:26:51 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:26:51 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:26:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:26:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.468s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:26:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:52 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:26:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:55 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:26:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:26:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:00 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:04 user nova-compute[74821]: DEBUG nova.compute.manager [None req-4249621e-bdb9-4588-b3fa-1240762065b8 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:27:04 user nova-compute[74821]: INFO nova.compute.manager [None req-4249621e-bdb9-4588-b3fa-1240762065b8 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] instance snapshotting
Nov 06 13:27:04 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-4249621e-bdb9-4588-b3fa-1240762065b8 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Beginning live snapshot process
Nov 06 13:27:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-4249621e-bdb9-4588-b3fa-1240762065b8 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json -f qcow2 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:27:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-4249621e-bdb9-4588-b3fa-1240762065b8 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json -f qcow2" returned: 0 in 0.194s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:27:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-4249621e-bdb9-4588-b3fa-1240762065b8 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json -f qcow2 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:27:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-4249621e-bdb9-4588-b3fa-1240762065b8 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json -f qcow2" returned: 0 in 0.197s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:27:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-4249621e-bdb9-4588-b3fa-1240762065b8 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:27:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-4249621e-bdb9-4588-b3fa-1240762065b8 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.195s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:27:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-4249621e-bdb9-4588-b3fa-1240762065b8 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvx0k20dy/1e996576b5c0459ba15cbd1fded4d807.delta 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:27:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-4249621e-bdb9-4588-b3fa-1240762065b8 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvx0k20dy/1e996576b5c0459ba15cbd1fded4d807.delta 1073741824" returned: 0 in 0.069s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:27:05 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-4249621e-bdb9-4588-b3fa-1240762065b8 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 06 13:27:06 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-4249621e-bdb9-4588-b3fa-1240762065b8 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] COPY block job progress, current cursor: 65536 final cursor: 75497472 {{(pid=74821) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 13:27:06 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-4249621e-bdb9-4588-b3fa-1240762065b8 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] COPY block job progress, current cursor: 25362432 final cursor: 75497472 {{(pid=74821) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 13:27:07 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-4249621e-bdb9-4588-b3fa-1240762065b8 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74821) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 13:27:07 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-4249621e-bdb9-4588-b3fa-1240762065b8 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 06 13:27:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:07 user nova-compute[74821]: DEBUG nova.privsep.utils [None req-4249621e-bdb9-4588-b3fa-1240762065b8 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74821) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 13:27:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-4249621e-bdb9-4588-b3fa-1240762065b8 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvx0k20dy/1e996576b5c0459ba15cbd1fded4d807.delta /opt/stack/data/nova/instances/snapshots/tmpvx0k20dy/1e996576b5c0459ba15cbd1fded4d807 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:27:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-4249621e-bdb9-4588-b3fa-1240762065b8 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvx0k20dy/1e996576b5c0459ba15cbd1fded4d807.delta /opt/stack/data/nova/instances/snapshots/tmpvx0k20dy/1e996576b5c0459ba15cbd1fded4d807" returned: 0 in 0.818s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:27:08 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-4249621e-bdb9-4588-b3fa-1240762065b8 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Snapshot extracted, beginning image upload
Nov 06 13:27:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:11 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-4249621e-bdb9-4588-b3fa-1240762065b8 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Snapshot image upload complete
Nov 06 13:27:11 user nova-compute[74821]: INFO nova.compute.manager [None req-4249621e-bdb9-4588-b3fa-1240762065b8 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Took 6.81 seconds to snapshot the instance on the hypervisor.
Nov 06 13:27:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:14 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Acquiring lock "b8d249b8-752d-434a-be2c-b8c2b5233503" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:27:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Lock "b8d249b8-752d-434a-be2c-b8c2b5233503" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:27:20 user nova-compute[74821]: DEBUG nova.compute.manager [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:27:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:27:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:27:20 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:27:20 user nova-compute[74821]: INFO nova.compute.claims [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Claim successful on node user
Nov 06 13:27:21 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:27:21 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:27:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:27:21 user nova-compute[74821]: DEBUG nova.compute.manager [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:27:21 user nova-compute[74821]: DEBUG nova.compute.manager [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:27:21 user nova-compute[74821]: DEBUG nova.network.neutron [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:27:21 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:27:21 user nova-compute[74821]: DEBUG nova.compute.manager [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:27:21 user nova-compute[74821]: DEBUG nova.policy [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a85a40deac9e46bbbf9d54f2565c57eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613db6de324d47929d4f270bc503368b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:27:21 user nova-compute[74821]: DEBUG nova.compute.manager [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:27:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:27:21 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Creating image(s)
Nov 06 13:27:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8d249b8-752d-434a-be2c-b8c2b5233503/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:27:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Lock "/opt/stack/data/nova/instances/b8d249b8-752d-434a-be2c-b8c2b5233503/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:27:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Lock "/opt/stack/data/nova/instances/b8d249b8-752d-434a-be2c-b8c2b5233503/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:27:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:27:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.201s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:27:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:27:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:27:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:27:22 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.185s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:27:22 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/b8d249b8-752d-434a-be2c-b8c2b5233503/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:27:22 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/b8d249b8-752d-434a-be2c-b8c2b5233503/disk 1073741824" returned: 0 in 0.059s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:27:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:27:22 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:27:22 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.194s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:27:22 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b8d249b8-752d-434a-be2c-b8c2b5233503/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:27:22 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8d249b8-752d-434a-be2c-b8c2b5233503/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:27:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:22 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8d249b8-752d-434a-be2c-b8c2b5233503/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:27:22 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Cannot resize image /opt/stack/data/nova/instances/b8d249b8-752d-434a-be2c-b8c2b5233503/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:27:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:27:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Ensure instance console log exists: /opt/stack/data/nova/instances/b8d249b8-752d-434a-be2c-b8c2b5233503/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:27:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:27:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:27:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:27:22 user nova-compute[74821]: DEBUG nova.network.neutron [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Successfully created port: f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.network.neutron [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Successfully updated port: f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Acquiring lock "refresh_cache-b8d249b8-752d-434a-be2c-b8c2b5233503" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Acquired lock "refresh_cache-b8d249b8-752d-434a-be2c-b8c2b5233503" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.network.neutron [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.compute.manager [req-569f20ad-f7dc-4275-9c2a-d8945e18bf23 req-e764a0c3-9806-463d-a8c6-94a5e0057ec1 service nova] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Received event network-changed-f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.compute.manager [req-569f20ad-f7dc-4275-9c2a-d8945e18bf23 req-e764a0c3-9806-463d-a8c6-94a5e0057ec1 service nova] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Refreshing instance network info cache due to event network-changed-f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-569f20ad-f7dc-4275-9c2a-d8945e18bf23 req-e764a0c3-9806-463d-a8c6-94a5e0057ec1 service nova] Acquiring lock "refresh_cache-b8d249b8-752d-434a-be2c-b8c2b5233503" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.network.neutron [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.network.neutron [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Updating instance_info_cache with network_info: [{"id": "f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6", "address": "fa:16:3e:0f:da:57", "network": {"id": "0aea8982-fb58-4067-ad58-99deecae4887", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "46171fd82e804115aa775e4d69ffe44c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf316d8ce-9f", "ovs_interfaceid": "f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Releasing lock "refresh_cache-b8d249b8-752d-434a-be2c-b8c2b5233503" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.compute.manager [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Instance network_info: |[{"id": "f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6", "address": "fa:16:3e:0f:da:57", "network": {"id": "0aea8982-fb58-4067-ad58-99deecae4887", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "46171fd82e804115aa775e4d69ffe44c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf316d8ce-9f", "ovs_interfaceid": "f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-569f20ad-f7dc-4275-9c2a-d8945e18bf23 req-e764a0c3-9806-463d-a8c6-94a5e0057ec1 service nova] Acquired lock "refresh_cache-b8d249b8-752d-434a-be2c-b8c2b5233503" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.network.neutron [req-569f20ad-f7dc-4275-9c2a-d8945e18bf23 req-e764a0c3-9806-463d-a8c6-94a5e0057ec1 service nova] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Refreshing network info cache for port f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Start _get_guest_xml network_info=[{"id": "f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6", "address": "fa:16:3e:0f:da:57", "network": {"id": "0aea8982-fb58-4067-ad58-99deecae4887", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "46171fd82e804115aa775e4d69ffe44c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf316d8ce-9f", "ovs_interfaceid": "f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:27:23 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:27:23 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:27:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-847530245',display_name='tempest-VolumesNegativeTest-instance-847530245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-847530245',id=33,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='613db6de324d47929d4f270bc503368b',ramdisk_id='',reservation_id='r-cr5x4e94',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1935745041',owner_user_name='tempest-VolumesNegativeTest-1935745041-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:27:22Z,user_data=None,user_id='a85a40deac9e46bbbf9d54f2565c57eb',uuid=b8d249b8-752d-434a-be2c-b8c2b5233503,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6", "address": "fa:16:3e:0f:da:57", "network": {"id": "0aea8982-fb58-4067-ad58-99deecae4887", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "46171fd82e804115aa775e4d69ffe44c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf316d8ce-9f", "ovs_interfaceid": "f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Converting VIF {"id": "f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6", "address": "fa:16:3e:0f:da:57", "network": {"id": "0aea8982-fb58-4067-ad58-99deecae4887", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "46171fd82e804115aa775e4d69ffe44c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf316d8ce-9f", "ovs_interfaceid": "f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:da:57,bridge_name='br-int',has_traffic_filtering=True,id=f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6,network=Network(0aea8982-fb58-4067-ad58-99deecae4887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf316d8ce-9f') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.objects.instance [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Lazy-loading 'pci_devices' on Instance uuid b8d249b8-752d-434a-be2c-b8c2b5233503 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:27:23 user nova-compute[74821]:   <uuid>b8d249b8-752d-434a-be2c-b8c2b5233503</uuid>
Nov 06 13:27:23 user nova-compute[74821]:   <name>instance-00000021</name>
Nov 06 13:27:23 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:27:23 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:27:23 user nova-compute[74821]:   <metadata>
Nov 06 13:27:23 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:27:23 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:27:23 user nova-compute[74821]:       <nova:name>tempest-VolumesNegativeTest-instance-847530245</nova:name>
Nov 06 13:27:23 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:27:23</nova:creationTime>
Nov 06 13:27:23 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:27:23 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:27:23 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:27:23 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:27:23 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:27:23 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:27:23 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:27:23 user nova-compute[74821]:       <nova:owner>
Nov 06 13:27:23 user nova-compute[74821]:         <nova:user uuid="a85a40deac9e46bbbf9d54f2565c57eb">tempest-VolumesNegativeTest-1935745041-project-member</nova:user>
Nov 06 13:27:23 user nova-compute[74821]:         <nova:project uuid="613db6de324d47929d4f270bc503368b">tempest-VolumesNegativeTest-1935745041</nova:project>
Nov 06 13:27:23 user nova-compute[74821]:       </nova:owner>
Nov 06 13:27:23 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:27:23 user nova-compute[74821]:       <nova:ports>
Nov 06 13:27:23 user nova-compute[74821]:         <nova:port uuid="f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6">
Nov 06 13:27:23 user nova-compute[74821]:           <nova:ip type="fixed" address="192.168.233.90" ipVersion="4"/>
Nov 06 13:27:23 user nova-compute[74821]:         </nova:port>
Nov 06 13:27:23 user nova-compute[74821]:       </nova:ports>
Nov 06 13:27:23 user nova-compute[74821]:     </nova:instance>
Nov 06 13:27:23 user nova-compute[74821]:   </metadata>
Nov 06 13:27:23 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:27:23 user nova-compute[74821]:     <system>
Nov 06 13:27:23 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:27:23 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:27:23 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:27:23 user nova-compute[74821]:       <entry name="serial">b8d249b8-752d-434a-be2c-b8c2b5233503</entry>
Nov 06 13:27:23 user nova-compute[74821]:       <entry name="uuid">b8d249b8-752d-434a-be2c-b8c2b5233503</entry>
Nov 06 13:27:23 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:27:23 user nova-compute[74821]:     </system>
Nov 06 13:27:23 user nova-compute[74821]:   </sysinfo>
Nov 06 13:27:23 user nova-compute[74821]:   <os>
Nov 06 13:27:23 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:27:23 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:27:23 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:27:23 user nova-compute[74821]:   </os>
Nov 06 13:27:23 user nova-compute[74821]:   <features>
Nov 06 13:27:23 user nova-compute[74821]:     <acpi/>
Nov 06 13:27:23 user nova-compute[74821]:     <apic/>
Nov 06 13:27:23 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:27:23 user nova-compute[74821]:   </features>
Nov 06 13:27:23 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:27:23 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:27:23 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:27:23 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:27:23 user nova-compute[74821]:   </clock>
Nov 06 13:27:23 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:27:23 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:27:23 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:27:23 user nova-compute[74821]:   </cpu>
Nov 06 13:27:23 user nova-compute[74821]:   <devices>
Nov 06 13:27:23 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:27:23 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:27:23 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/b8d249b8-752d-434a-be2c-b8c2b5233503/disk"/>
Nov 06 13:27:23 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:27:23 user nova-compute[74821]:     </disk>
Nov 06 13:27:23 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:27:23 user nova-compute[74821]:       <mac address="fa:16:3e:0f:da:57"/>
Nov 06 13:27:23 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:27:23 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:27:23 user nova-compute[74821]:       <target dev="tapf316d8ce-9f"/>
Nov 06 13:27:23 user nova-compute[74821]:     </interface>
Nov 06 13:27:23 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:27:23 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/b8d249b8-752d-434a-be2c-b8c2b5233503/console.log" append="off"/>
Nov 06 13:27:23 user nova-compute[74821]:     </serial>
Nov 06 13:27:23 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:27:23 user nova-compute[74821]:     <video>
Nov 06 13:27:23 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:27:23 user nova-compute[74821]:     </video>
Nov 06 13:27:23 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:27:23 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:27:23 user nova-compute[74821]:     </rng>
Nov 06 13:27:23 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:27:23 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:27:23 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:27:23 user nova-compute[74821]:     </memballoon>
Nov 06 13:27:23 user nova-compute[74821]:   </devices>
Nov 06 13:27:23 user nova-compute[74821]: </domain>
Nov 06 13:27:23 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:27:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-847530245',display_name='tempest-VolumesNegativeTest-instance-847530245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-847530245',id=33,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='613db6de324d47929d4f270bc503368b',ramdisk_id='',reservation_id='r-cr5x4e94',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1935745041',owner_user_name='tempest-VolumesNegativeTest-1935745041-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:27:22Z,user_data=None,user_id='a85a40deac9e46bbbf9d54f2565c57eb',uuid=b8d249b8-752d-434a-be2c-b8c2b5233503,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6", "address": "fa:16:3e:0f:da:57", "network": {"id": "0aea8982-fb58-4067-ad58-99deecae4887", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "46171fd82e804115aa775e4d69ffe44c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf316d8ce-9f", "ovs_interfaceid": "f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Converting VIF {"id": "f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6", "address": "fa:16:3e:0f:da:57", "network": {"id": "0aea8982-fb58-4067-ad58-99deecae4887", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "46171fd82e804115aa775e4d69ffe44c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf316d8ce-9f", "ovs_interfaceid": "f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:da:57,bridge_name='br-int',has_traffic_filtering=True,id=f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6,network=Network(0aea8982-fb58-4067-ad58-99deecae4887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf316d8ce-9f') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG os_vif [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:da:57,bridge_name='br-int',has_traffic_filtering=True,id=f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6,network=Network(0aea8982-fb58-4067-ad58-99deecae4887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf316d8ce-9f') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45d25bfd-18b3-5156-86e2-d1fed4de7460', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf316d8ce-9f, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf316d8ce-9f, col_values=(('qos', UUID('6042926a-059e-4b32-852b-7da35e956584')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf316d8ce-9f, col_values=(('external_ids', {'iface-id': 'f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:da:57', 'vm-uuid': 'b8d249b8-752d-434a-be2c-b8c2b5233503'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:23 user nova-compute[74821]: INFO os_vif [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:da:57,bridge_name='br-int',has_traffic_filtering=True,id=f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6,network=Network(0aea8982-fb58-4067-ad58-99deecae4887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf316d8ce-9f')
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] No VIF found with MAC fa:16:3e:0f:da:57, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.network.neutron [req-569f20ad-f7dc-4275-9c2a-d8945e18bf23 req-e764a0c3-9806-463d-a8c6-94a5e0057ec1 service nova] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Updated VIF entry in instance network info cache for port f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG nova.network.neutron [req-569f20ad-f7dc-4275-9c2a-d8945e18bf23 req-e764a0c3-9806-463d-a8c6-94a5e0057ec1 service nova] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Updating instance_info_cache with network_info: [{"id": "f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6", "address": "fa:16:3e:0f:da:57", "network": {"id": "0aea8982-fb58-4067-ad58-99deecae4887", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "46171fd82e804115aa775e4d69ffe44c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf316d8ce-9f", "ovs_interfaceid": "f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:27:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-569f20ad-f7dc-4275-9c2a-d8945e18bf23 req-e764a0c3-9806-463d-a8c6-94a5e0057ec1 service nova] Releasing lock "refresh_cache-b8d249b8-752d-434a-be2c-b8c2b5233503" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:27:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:25 user nova-compute[74821]: DEBUG nova.compute.manager [req-0da51f07-a1e1-44eb-85cf-6fcd62e9a928 req-2a0bbc67-f7cc-4c23-ab01-836b4382c38d service nova] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Received event network-vif-plugged-f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:27:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0da51f07-a1e1-44eb-85cf-6fcd62e9a928 req-2a0bbc67-f7cc-4c23-ab01-836b4382c38d service nova] Acquiring lock "b8d249b8-752d-434a-be2c-b8c2b5233503-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:27:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0da51f07-a1e1-44eb-85cf-6fcd62e9a928 req-2a0bbc67-f7cc-4c23-ab01-836b4382c38d service nova] Lock "b8d249b8-752d-434a-be2c-b8c2b5233503-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:27:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0da51f07-a1e1-44eb-85cf-6fcd62e9a928 req-2a0bbc67-f7cc-4c23-ab01-836b4382c38d service nova] Lock "b8d249b8-752d-434a-be2c-b8c2b5233503-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:27:25 user nova-compute[74821]: DEBUG nova.compute.manager [req-0da51f07-a1e1-44eb-85cf-6fcd62e9a928 req-2a0bbc67-f7cc-4c23-ab01-836b4382c38d service nova] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] No waiting events found dispatching network-vif-plugged-f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:27:25 user nova-compute[74821]: WARNING nova.compute.manager [req-0da51f07-a1e1-44eb-85cf-6fcd62e9a928 req-2a0bbc67-f7cc-4c23-ab01-836b4382c38d service nova] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Received unexpected event network-vif-plugged-f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6 for instance with vm_state building and task_state spawning.
Nov 06 13:27:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._sync_power_states {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Triggering sync for uuid 3e21d005-f190-478a-a911-e483e1235057 {{(pid=74821) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Triggering sync for uuid 311817c5-7b08-4da9-98eb-c685f37e6fd3 {{(pid=74821) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Triggering sync for uuid 2de346cb-9858-47b8-a86c-4fde720d6127 {{(pid=74821) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Triggering sync for uuid 49c65aca-8392-46ba-8fa3-b47ff2416cb9 {{(pid=74821) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Triggering sync for uuid 496f8213-4b32-4211-a354-e33a4a088848 {{(pid=74821) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Triggering sync for uuid 1290bdb3-827f-4365-a4f1-4ae063de780d {{(pid=74821) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Triggering sync for uuid d42894d4-98df-46dc-a8e9-137035b948a4 {{(pid=74821) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Triggering sync for uuid 2d8da345-f66d-45c2-8ccd-d22fdf79a14d {{(pid=74821) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Triggering sync for uuid 4bc6444e-b55d-4d81-88d1-f4d147255119 {{(pid=74821) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Triggering sync for uuid 89b04a09-41d8-461f-8d14-bb3b9c72ed76 {{(pid=74821) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Triggering sync for uuid b8d249b8-752d-434a-be2c-b8c2b5233503 {{(pid=74821) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "3e21d005-f190-478a-a911-e483e1235057" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "3e21d005-f190-478a-a911-e483e1235057" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "311817c5-7b08-4da9-98eb-c685f37e6fd3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "311817c5-7b08-4da9-98eb-c685f37e6fd3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "2de346cb-9858-47b8-a86c-4fde720d6127" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "2de346cb-9858-47b8-a86c-4fde720d6127" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "49c65aca-8392-46ba-8fa3-b47ff2416cb9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "49c65aca-8392-46ba-8fa3-b47ff2416cb9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "496f8213-4b32-4211-a354-e33a4a088848" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "496f8213-4b32-4211-a354-e33a4a088848" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "1290bdb3-827f-4365-a4f1-4ae063de780d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "1290bdb3-827f-4365-a4f1-4ae063de780d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "d42894d4-98df-46dc-a8e9-137035b948a4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "d42894d4-98df-46dc-a8e9-137035b948a4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "4bc6444e-b55d-4d81-88d1-f4d147255119" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "4bc6444e-b55d-4d81-88d1-f4d147255119" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "89b04a09-41d8-461f-8d14-bb3b9c72ed76" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "89b04a09-41d8-461f-8d14-bb3b9c72ed76" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "b8d249b8-752d-434a-be2c-b8c2b5233503" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "3e21d005-f190-478a-a911-e483e1235057" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "311817c5-7b08-4da9-98eb-c685f37e6fd3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "2de346cb-9858-47b8-a86c-4fde720d6127" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "49c65aca-8392-46ba-8fa3-b47ff2416cb9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "496f8213-4b32-4211-a354-e33a4a088848" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "1290bdb3-827f-4365-a4f1-4ae063de780d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "d42894d4-98df-46dc-a8e9-137035b948a4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "4bc6444e-b55d-4d81-88d1-f4d147255119" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "89b04a09-41d8-461f-8d14-bb3b9c72ed76" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2f57764d-622d-4997-8927-e361cbb4547b tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "311817c5-7b08-4da9-98eb-c685f37e6fd3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2f57764d-622d-4997-8927-e361cbb4547b tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "311817c5-7b08-4da9-98eb-c685f37e6fd3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2f57764d-622d-4997-8927-e361cbb4547b tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "311817c5-7b08-4da9-98eb-c685f37e6fd3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2f57764d-622d-4997-8927-e361cbb4547b tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "311817c5-7b08-4da9-98eb-c685f37e6fd3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2f57764d-622d-4997-8927-e361cbb4547b tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "311817c5-7b08-4da9-98eb-c685f37e6fd3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:27:26 user nova-compute[74821]: INFO nova.compute.manager [None req-2f57764d-622d-4997-8927-e361cbb4547b tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Terminating instance
Nov 06 13:27:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-2f57764d-622d-4997-8927-e361cbb4547b tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG nova.compute.manager [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:27:27 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Instance spawned successfully.
Nov 06 13:27:27 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:27:27 user nova-compute[74821]: INFO nova.compute.manager [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Took 5.77 seconds to spawn the instance on the hypervisor.
Nov 06 13:27:27 user nova-compute[74821]: DEBUG nova.compute.manager [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG nova.compute.manager [req-27dd2062-8c69-46ea-85e7-fb900d91a3ac req-54f9b0a1-db95-48c3-8e2a-8397746dce19 service nova] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Received event network-vif-plugged-f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-27dd2062-8c69-46ea-85e7-fb900d91a3ac req-54f9b0a1-db95-48c3-8e2a-8397746dce19 service nova] Acquiring lock "b8d249b8-752d-434a-be2c-b8c2b5233503-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-27dd2062-8c69-46ea-85e7-fb900d91a3ac req-54f9b0a1-db95-48c3-8e2a-8397746dce19 service nova] Lock "b8d249b8-752d-434a-be2c-b8c2b5233503-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-27dd2062-8c69-46ea-85e7-fb900d91a3ac req-54f9b0a1-db95-48c3-8e2a-8397746dce19 service nova] Lock "b8d249b8-752d-434a-be2c-b8c2b5233503-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG nova.compute.manager [req-27dd2062-8c69-46ea-85e7-fb900d91a3ac req-54f9b0a1-db95-48c3-8e2a-8397746dce19 service nova] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] No waiting events found dispatching network-vif-plugged-f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:27:27 user nova-compute[74821]: WARNING nova.compute.manager [req-27dd2062-8c69-46ea-85e7-fb900d91a3ac req-54f9b0a1-db95-48c3-8e2a-8397746dce19 service nova] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Received unexpected event network-vif-plugged-f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6 for instance with vm_state building and task_state spawning.
Nov 06 13:27:27 user nova-compute[74821]: DEBUG nova.compute.manager [req-27dd2062-8c69-46ea-85e7-fb900d91a3ac req-54f9b0a1-db95-48c3-8e2a-8397746dce19 service nova] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Received event network-vif-unplugged-be99c620-c497-4810-8aac-8793f2b2baa7 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-27dd2062-8c69-46ea-85e7-fb900d91a3ac req-54f9b0a1-db95-48c3-8e2a-8397746dce19 service nova] Acquiring lock "311817c5-7b08-4da9-98eb-c685f37e6fd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-27dd2062-8c69-46ea-85e7-fb900d91a3ac req-54f9b0a1-db95-48c3-8e2a-8397746dce19 service nova] Lock "311817c5-7b08-4da9-98eb-c685f37e6fd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-27dd2062-8c69-46ea-85e7-fb900d91a3ac req-54f9b0a1-db95-48c3-8e2a-8397746dce19 service nova] Lock "311817c5-7b08-4da9-98eb-c685f37e6fd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG nova.compute.manager [req-27dd2062-8c69-46ea-85e7-fb900d91a3ac req-54f9b0a1-db95-48c3-8e2a-8397746dce19 service nova] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] No waiting events found dispatching network-vif-unplugged-be99c620-c497-4810-8aac-8793f2b2baa7 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG nova.compute.manager [req-27dd2062-8c69-46ea-85e7-fb900d91a3ac req-54f9b0a1-db95-48c3-8e2a-8397746dce19 service nova] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Received event network-vif-unplugged-be99c620-c497-4810-8aac-8793f2b2baa7 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG nova.compute.manager [req-27dd2062-8c69-46ea-85e7-fb900d91a3ac req-54f9b0a1-db95-48c3-8e2a-8397746dce19 service nova] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Received event network-vif-plugged-be99c620-c497-4810-8aac-8793f2b2baa7 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-27dd2062-8c69-46ea-85e7-fb900d91a3ac req-54f9b0a1-db95-48c3-8e2a-8397746dce19 service nova] Acquiring lock "311817c5-7b08-4da9-98eb-c685f37e6fd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-27dd2062-8c69-46ea-85e7-fb900d91a3ac req-54f9b0a1-db95-48c3-8e2a-8397746dce19 service nova] Lock "311817c5-7b08-4da9-98eb-c685f37e6fd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-27dd2062-8c69-46ea-85e7-fb900d91a3ac req-54f9b0a1-db95-48c3-8e2a-8397746dce19 service nova] Lock "311817c5-7b08-4da9-98eb-c685f37e6fd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG nova.compute.manager [req-27dd2062-8c69-46ea-85e7-fb900d91a3ac req-54f9b0a1-db95-48c3-8e2a-8397746dce19 service nova] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] No waiting events found dispatching network-vif-plugged-be99c620-c497-4810-8aac-8793f2b2baa7 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:27:27 user nova-compute[74821]: WARNING nova.compute.manager [req-27dd2062-8c69-46ea-85e7-fb900d91a3ac req-54f9b0a1-db95-48c3-8e2a-8397746dce19 service nova] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Received unexpected event network-vif-plugged-be99c620-c497-4810-8aac-8793f2b2baa7 for instance with vm_state rescued and task_state deleting.
Nov 06 13:27:27 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Instance destroyed successfully.
Nov 06 13:27:27 user nova-compute[74821]: DEBUG nova.objects.instance [None req-2f57764d-622d-4997-8927-e361cbb4547b tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lazy-loading 'resources' on Instance uuid 311817c5-7b08-4da9-98eb-c685f37e6fd3 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-2f57764d-622d-4997-8927-e361cbb4547b tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:10:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1158306045',display_name='tempest-ServerRescueNegativeTestJSON-server-1158306045',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1158306045',id=2,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:12:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e246e1fd12054401988f9d49f6ad9373',ramdisk_id='',reservation_id='r-xaq5aeap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1107947568',owner_user_name='tempest-ServerRescueNegativeTestJSON-1107947568-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:12:26Z,user_data=None,user_id='4a0f35998b664c32990f079ca1cd5e6d',uuid=311817c5-7b08-4da9-98eb-c685f37e6fd3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "be99c620-c497-4810-8aac-8793f2b2baa7", "address": "fa:16:3e:2e:e6:6b", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe99c620-c4", "ovs_interfaceid": "be99c620-c497-4810-8aac-8793f2b2baa7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-2f57764d-622d-4997-8927-e361cbb4547b tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Converting VIF {"id": "be99c620-c497-4810-8aac-8793f2b2baa7", "address": "fa:16:3e:2e:e6:6b", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe99c620-c4", "ovs_interfaceid": "be99c620-c497-4810-8aac-8793f2b2baa7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-2f57764d-622d-4997-8927-e361cbb4547b tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:e6:6b,bridge_name='br-int',has_traffic_filtering=True,id=be99c620-c497-4810-8aac-8793f2b2baa7,network=Network(45ec1f7e-dbfa-4746-8d35-e32f7c938a0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe99c620-c4') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG os_vif [None req-2f57764d-622d-4997-8927-e361cbb4547b tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:e6:6b,bridge_name='br-int',has_traffic_filtering=True,id=be99c620-c497-4810-8aac-8793f2b2baa7,network=Network(45ec1f7e-dbfa-4746-8d35-e32f7c938a0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe99c620-c4') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe99c620-c4, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0e9ac8e-9625-4a3a-b503-a657046f6697) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:27 user nova-compute[74821]: INFO os_vif [None req-2f57764d-622d-4997-8927-e361cbb4547b tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:e6:6b,bridge_name='br-int',has_traffic_filtering=True,id=be99c620-c497-4810-8aac-8793f2b2baa7,network=Network(45ec1f7e-dbfa-4746-8d35-e32f7c938a0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe99c620-c4')
Nov 06 13:27:27 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-2f57764d-622d-4997-8927-e361cbb4547b tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Deleting instance files /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3_del
Nov 06 13:27:27 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-2f57764d-622d-4997-8927-e361cbb4547b tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Deletion of /opt/stack/data/nova/instances/311817c5-7b08-4da9-98eb-c685f37e6fd3_del complete
Nov 06 13:27:27 user nova-compute[74821]: INFO nova.compute.manager [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Took 6.70 seconds to build instance.
Nov 06 13:27:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-70f9f452-f14c-4534-96a9-776ec76bc9bb tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Lock "b8d249b8-752d-434a-be2c-b8c2b5233503" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.812s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "b8d249b8-752d-434a-be2c-b8c2b5233503" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.141s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:27:27 user nova-compute[74821]: INFO nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 06 13:27:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "b8d249b8-752d-434a-be2c-b8c2b5233503" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:27:27 user nova-compute[74821]: INFO nova.compute.manager [None req-2f57764d-622d-4997-8927-e361cbb4547b tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 06 13:27:27 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-2f57764d-622d-4997-8927-e361cbb4547b tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:27:27 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:27:28 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:27:28 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Took 0.56 seconds to deallocate network for instance.
Nov 06 13:27:28 user nova-compute[74821]: DEBUG nova.compute.manager [req-950defae-d8da-4fd8-9211-1dd19b2d6679 req-da7a5672-f95a-456e-8e25-202545f8d30c service nova] [instance: 311817c5-7b08-4da9-98eb-c685f37e6fd3] Received event network-vif-deleted-be99c620-c497-4810-8aac-8793f2b2baa7 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:27:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2f57764d-622d-4997-8927-e361cbb4547b tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:27:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2f57764d-622d-4997-8927-e361cbb4547b tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:27:28 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-2f57764d-622d-4997-8927-e361cbb4547b tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:27:28 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-2f57764d-622d-4997-8927-e361cbb4547b tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:27:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2f57764d-622d-4997-8927-e361cbb4547b tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:27:28 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-2f57764d-622d-4997-8927-e361cbb4547b tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Deleted allocations for instance 311817c5-7b08-4da9-98eb-c685f37e6fd3
Nov 06 13:27:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2f57764d-622d-4997-8927-e361cbb4547b tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "311817c5-7b08-4da9-98eb-c685f37e6fd3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.152s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:27:29 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:27:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:33 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:27:36 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:27:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:38 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:27:38 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:27:38 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Rebuilding the list of instances to heal {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 13:27:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-3e21d005-f190-478a-a911-e483e1235057" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:27:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-3e21d005-f190-478a-a911-e483e1235057" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:27:39 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 3e21d005-f190-478a-a911-e483e1235057] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:27:39 user nova-compute[74821]: DEBUG nova.objects.instance [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lazy-loading 'info_cache' on Instance uuid 3e21d005-f190-478a-a911-e483e1235057 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:27:39 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 3e21d005-f190-478a-a911-e483e1235057] Updating instance_info_cache with network_info: [{"id": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "address": "fa:16:3e:e0:fc:40", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6fb684-24", "ovs_interfaceid": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:27:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-3e21d005-f190-478a-a911-e483e1235057" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:27:39 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 3e21d005-f190-478a-a911-e483e1235057] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:27:39 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:27:39 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:27:39 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:27:41 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:27:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:27:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:27:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:27:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:27:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:45 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:27:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:27:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:27:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:27:45 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:27:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8d249b8-752d-434a-be2c-b8c2b5233503/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:27:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8d249b8-752d-434a-be2c-b8c2b5233503/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:27:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8d249b8-752d-434a-be2c-b8c2b5233503/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:27:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8d249b8-752d-434a-be2c-b8c2b5233503/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:27:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b04a09-41d8-461f-8d14-bb3b9c72ed76/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:27:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-777fe5a7-5ca4-400b-8654-4857bca1fba9 tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Acquiring lock "d42894d4-98df-46dc-a8e9-137035b948a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:27:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-777fe5a7-5ca4-400b-8654-4857bca1fba9 tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Lock "d42894d4-98df-46dc-a8e9-137035b948a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:27:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-777fe5a7-5ca4-400b-8654-4857bca1fba9 tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Acquiring lock "d42894d4-98df-46dc-a8e9-137035b948a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:27:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-777fe5a7-5ca4-400b-8654-4857bca1fba9 tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Lock "d42894d4-98df-46dc-a8e9-137035b948a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:27:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-777fe5a7-5ca4-400b-8654-4857bca1fba9 tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Lock "d42894d4-98df-46dc-a8e9-137035b948a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:27:46 user nova-compute[74821]: INFO nova.compute.manager [None req-777fe5a7-5ca4-400b-8654-4857bca1fba9 tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Terminating instance
Nov 06 13:27:46 user nova-compute[74821]: DEBUG nova.compute.manager [None req-777fe5a7-5ca4-400b-8654-4857bca1fba9 tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:27:46 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:46 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:46 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b04a09-41d8-461f-8d14-bb3b9c72ed76/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:27:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b04a09-41d8-461f-8d14-bb3b9c72ed76/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:27:46 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:47 user nova-compute[74821]: DEBUG nova.compute.manager [req-bc3d1cea-f1d1-4fab-b05c-67383513235e req-46c3bbd9-d8f7-41ec-aad8-53e30a8e4028 service nova] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Received event network-vif-unplugged-55b3b4ff-b981-45c2-806a-d0043dee0233 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:27:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-bc3d1cea-f1d1-4fab-b05c-67383513235e req-46c3bbd9-d8f7-41ec-aad8-53e30a8e4028 service nova] Acquiring lock "d42894d4-98df-46dc-a8e9-137035b948a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:27:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-bc3d1cea-f1d1-4fab-b05c-67383513235e req-46c3bbd9-d8f7-41ec-aad8-53e30a8e4028 service nova] Lock "d42894d4-98df-46dc-a8e9-137035b948a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:27:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-bc3d1cea-f1d1-4fab-b05c-67383513235e req-46c3bbd9-d8f7-41ec-aad8-53e30a8e4028 service nova] Lock "d42894d4-98df-46dc-a8e9-137035b948a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:27:47 user nova-compute[74821]: DEBUG nova.compute.manager [req-bc3d1cea-f1d1-4fab-b05c-67383513235e req-46c3bbd9-d8f7-41ec-aad8-53e30a8e4028 service nova] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] No waiting events found dispatching network-vif-unplugged-55b3b4ff-b981-45c2-806a-d0043dee0233 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:27:47 user nova-compute[74821]: DEBUG nova.compute.manager [req-bc3d1cea-f1d1-4fab-b05c-67383513235e req-46c3bbd9-d8f7-41ec-aad8-53e30a8e4028 service nova] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Received event network-vif-unplugged-55b3b4ff-b981-45c2-806a-d0043dee0233 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:27:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b04a09-41d8-461f-8d14-bb3b9c72ed76/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:27:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:27:47 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Instance destroyed successfully.
Nov 06 13:27:47 user nova-compute[74821]: DEBUG nova.objects.instance [None req-777fe5a7-5ca4-400b-8654-4857bca1fba9 tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Lazy-loading 'resources' on Instance uuid d42894d4-98df-46dc-a8e9-137035b948a4 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:27:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-777fe5a7-5ca4-400b-8654-4857bca1fba9 tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:25:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-751778563',display_name='tempest-VolumesActionsTest-instance-751778563',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-751778563',id=29,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:25:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f5c7747bc814d9cb56e1e52d59960ea',ramdisk_id='',reservation_id='r-jg3cx7pg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1917959047',owner_user_name='tempest-VolumesActionsTest-1917959047-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:25:46Z,user_data=None,user_id='64aebab87680452d85cf96a0d24ac6bc',uuid=d42894d4-98df-46dc-a8e9-137035b948a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55b3b4ff-b981-45c2-806a-d0043dee0233", "address": "fa:16:3e:d1:d7:c2", "network": {"id": "e090393a-3a2f-4fdb-80ab-d9fc72f6c11e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883757599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5c7747bc814d9cb56e1e52d59960ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55b3b4ff-b9", "ovs_interfaceid": "55b3b4ff-b981-45c2-806a-d0043dee0233", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:27:47 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-777fe5a7-5ca4-400b-8654-4857bca1fba9 tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Converting VIF {"id": "55b3b4ff-b981-45c2-806a-d0043dee0233", "address": "fa:16:3e:d1:d7:c2", "network": {"id": "e090393a-3a2f-4fdb-80ab-d9fc72f6c11e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1883757599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f5c7747bc814d9cb56e1e52d59960ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55b3b4ff-b9", "ovs_interfaceid": "55b3b4ff-b981-45c2-806a-d0043dee0233", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:27:47 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-777fe5a7-5ca4-400b-8654-4857bca1fba9 tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:d7:c2,bridge_name='br-int',has_traffic_filtering=True,id=55b3b4ff-b981-45c2-806a-d0043dee0233,network=Network(e090393a-3a2f-4fdb-80ab-d9fc72f6c11e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55b3b4ff-b9') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:27:47 user nova-compute[74821]: DEBUG os_vif [None req-777fe5a7-5ca4-400b-8654-4857bca1fba9 tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:d7:c2,bridge_name='br-int',has_traffic_filtering=True,id=55b3b4ff-b981-45c2-806a-d0043dee0233,network=Network(e090393a-3a2f-4fdb-80ab-d9fc72f6c11e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55b3b4ff-b9') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:27:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55b3b4ff-b9, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:27:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:27:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:27:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:27:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6f2f8559-999c-4ca3-889a-aa7e4fed31d0) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:27:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:47 user nova-compute[74821]: INFO os_vif [None req-777fe5a7-5ca4-400b-8654-4857bca1fba9 tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:d7:c2,bridge_name='br-int',has_traffic_filtering=True,id=55b3b4ff-b981-45c2-806a-d0043dee0233,network=Network(e090393a-3a2f-4fdb-80ab-d9fc72f6c11e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55b3b4ff-b9')
Nov 06 13:27:47 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-777fe5a7-5ca4-400b-8654-4857bca1fba9 tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Deleting instance files /opt/stack/data/nova/instances/d42894d4-98df-46dc-a8e9-137035b948a4_del
Nov 06 13:27:47 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-777fe5a7-5ca4-400b-8654-4857bca1fba9 tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Deletion of /opt/stack/data/nova/instances/d42894d4-98df-46dc-a8e9-137035b948a4_del complete
Nov 06 13:27:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:27:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:27:47 user nova-compute[74821]: INFO nova.compute.manager [None req-777fe5a7-5ca4-400b-8654-4857bca1fba9 tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 06 13:27:47 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-777fe5a7-5ca4-400b-8654-4857bca1fba9 tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:27:47 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:27:47 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:27:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:27:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:27:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:27:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:27:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:27:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:27:48 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:27:48 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Took 0.64 seconds to deallocate network for instance.
Nov 06 13:27:48 user nova-compute[74821]: DEBUG nova.compute.manager [req-eb18121a-8f58-49e0-be0f-3bc7ae354683 req-9d3c3d98-f43b-4226-862b-326f7d49b146 service nova] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Received event network-vif-deleted-55b3b4ff-b981-45c2-806a-d0043dee0233 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:27:48 user nova-compute[74821]: INFO nova.compute.manager [req-eb18121a-8f58-49e0-be0f-3bc7ae354683 req-9d3c3d98-f43b-4226-862b-326f7d49b146 service nova] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Neutron deleted interface 55b3b4ff-b981-45c2-806a-d0043dee0233; detaching it from the instance and deleting it from the info cache
Nov 06 13:27:48 user nova-compute[74821]: DEBUG nova.network.neutron [req-eb18121a-8f58-49e0-be0f-3bc7ae354683 req-9d3c3d98-f43b-4226-862b-326f7d49b146 service nova] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:27:48 user nova-compute[74821]: DEBUG nova.compute.manager [req-eb18121a-8f58-49e0-be0f-3bc7ae354683 req-9d3c3d98-f43b-4226-862b-326f7d49b146 service nova] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Detach interface failed, port_id=55b3b4ff-b981-45c2-806a-d0043dee0233, reason: Instance d42894d4-98df-46dc-a8e9-137035b948a4 could not be found. {{(pid=74821) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 13:27:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-777fe5a7-5ca4-400b-8654-4857bca1fba9 tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:27:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-777fe5a7-5ca4-400b-8654-4857bca1fba9 tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:27:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:27:48 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:27:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:27:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:27:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:27:48 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-777fe5a7-5ca4-400b-8654-4857bca1fba9 tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:27:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:27:48 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-777fe5a7-5ca4-400b-8654-4857bca1fba9 tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:27:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:27:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-777fe5a7-5ca4-400b-8654-4857bca1fba9 tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.471s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:27:48 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-777fe5a7-5ca4-400b-8654-4857bca1fba9 tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Deleted allocations for instance d42894d4-98df-46dc-a8e9-137035b948a4
Nov 06 13:27:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-777fe5a7-5ca4-400b-8654-4857bca1fba9 tempest-VolumesActionsTest-1917959047 tempest-VolumesActionsTest-1917959047-project-member] Lock "d42894d4-98df-46dc-a8e9-137035b948a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.339s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:27:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:27:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:27:49 user nova-compute[74821]: DEBUG nova.compute.manager [req-160020e3-d8dd-4690-b710-03c90552dc29 req-b3e781b6-e6d0-4cb9-9a22-be91e6093de5 service nova] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Received event network-vif-plugged-55b3b4ff-b981-45c2-806a-d0043dee0233 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:27:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-160020e3-d8dd-4690-b710-03c90552dc29 req-b3e781b6-e6d0-4cb9-9a22-be91e6093de5 service nova] Acquiring lock "d42894d4-98df-46dc-a8e9-137035b948a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:27:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-160020e3-d8dd-4690-b710-03c90552dc29 req-b3e781b6-e6d0-4cb9-9a22-be91e6093de5 service nova] Lock "d42894d4-98df-46dc-a8e9-137035b948a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:27:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-160020e3-d8dd-4690-b710-03c90552dc29 req-b3e781b6-e6d0-4cb9-9a22-be91e6093de5 service nova] Lock "d42894d4-98df-46dc-a8e9-137035b948a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:27:49 user nova-compute[74821]: DEBUG nova.compute.manager [req-160020e3-d8dd-4690-b710-03c90552dc29 req-b3e781b6-e6d0-4cb9-9a22-be91e6093de5 service nova] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] No waiting events found dispatching network-vif-plugged-55b3b4ff-b981-45c2-806a-d0043dee0233 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:27:49 user nova-compute[74821]: WARNING nova.compute.manager [req-160020e3-d8dd-4690-b710-03c90552dc29 req-b3e781b6-e6d0-4cb9-9a22-be91e6093de5 service nova] [instance: d42894d4-98df-46dc-a8e9-137035b948a4] Received unexpected event network-vif-plugged-55b3b4ff-b981-45c2-806a-d0043dee0233 for instance with vm_state deleted and task_state None.
Nov 06 13:27:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:27:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:27:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:27:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:27:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:27:49 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Error from libvirt while getting description of instance-0000001d: [Error Code 42] Domain not found: no domain with matching uuid 'd42894d4-98df-46dc-a8e9-137035b948a4' (instance-0000001d): libvirt.libvirtError: Domain not found: no domain with matching uuid 'd42894d4-98df-46dc-a8e9-137035b948a4' (instance-0000001d)
Nov 06 13:27:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:50 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:27:50 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:27:50 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=7516MB free_disk=25.087257385253906GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:27:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:27:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:27:50 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 3e21d005-f190-478a-a911-e483e1235057 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:27:50 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 2de346cb-9858-47b8-a86c-4fde720d6127 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:27:50 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 49c65aca-8392-46ba-8fa3-b47ff2416cb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:27:50 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 496f8213-4b32-4211-a354-e33a4a088848 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:27:50 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 1290bdb3-827f-4365-a4f1-4ae063de780d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:27:50 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 2d8da345-f66d-45c2-8ccd-d22fdf79a14d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:27:50 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 4bc6444e-b55d-4d81-88d1-f4d147255119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:27:50 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 89b04a09-41d8-461f-8d14-bb3b9c72ed76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:27:50 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance b8d249b8-752d-434a-be2c-b8c2b5233503 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:27:50 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:27:50 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:27:50 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:27:50 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:27:50 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:27:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.506s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:27:51 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:27:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:27:51 user nova-compute[74821]: DEBUG nova.compute.manager [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:27:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:27:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:27:52 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:27:52 user nova-compute[74821]: INFO nova.compute.claims [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Claim successful on node user
Nov 06 13:27:52 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:27:52 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:27:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.410s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:27:52 user nova-compute[74821]: DEBUG nova.compute.manager [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:27:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:52 user nova-compute[74821]: DEBUG nova.compute.manager [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:27:52 user nova-compute[74821]: DEBUG nova.network.neutron [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:27:52 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:27:52 user nova-compute[74821]: DEBUG nova.compute.manager [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:27:52 user nova-compute[74821]: DEBUG nova.policy [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0620d1928d8d434fbe0bc1cdb31a2a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77233758870b4fdfbb7ca76829f0f82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:27:52 user nova-compute[74821]: INFO nova.virt.block_device [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Booting with volume 546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 at /dev/vda
Nov 06 13:27:52 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:27:52 user nova-compute[74821]: DEBUG os_brick.utils [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:27:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:27:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:27:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36d990e-bfad-4bcd-b81c-22f3e8ae15dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:27:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:27:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:27:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d40634-03a9-49c1-9d06-929b15c6a90b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:27:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:27:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:27:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0764cd74-ebd8-446a-bc39-de3a5e4f46fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:27:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e017d3d2-4927-4d84-841e-867708e050aa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:27:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:27:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:27:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:27:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:27:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:27:52 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:27:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4198da35-a157-428a-bea6-183b1a3e628f]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:27:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:27:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:27:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:27:52 user nova-compute[74821]: DEBUG os_brick.utils [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:27:52 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Updating existing volume attachment record: 86374073-2a30-4b79-a490-bc596b9f5c8a {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:27:53 user nova-compute[74821]: DEBUG nova.network.neutron [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Successfully created port: 267248e7-6714-47b4-b1b2-1d94251305da {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:27:53 user nova-compute[74821]: DEBUG nova.network.neutron [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Successfully updated port: 267248e7-6714-47b4-b1b2-1d94251305da {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:27:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "refresh_cache-d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:27:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquired lock "refresh_cache-d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:27:53 user nova-compute[74821]: DEBUG nova.network.neutron [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:27:53 user nova-compute[74821]: DEBUG nova.compute.manager [req-ebcf00b0-9b4e-4868-b62c-1150f8d0bc39 req-3c34fe33-4947-4123-a1ab-104bcdea082e service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Received event network-changed-267248e7-6714-47b4-b1b2-1d94251305da {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:27:53 user nova-compute[74821]: DEBUG nova.compute.manager [req-ebcf00b0-9b4e-4868-b62c-1150f8d0bc39 req-3c34fe33-4947-4123-a1ab-104bcdea082e service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Refreshing instance network info cache due to event network-changed-267248e7-6714-47b4-b1b2-1d94251305da. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:27:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ebcf00b0-9b4e-4868-b62c-1150f8d0bc39 req-3c34fe33-4947-4123-a1ab-104bcdea082e service nova] Acquiring lock "refresh_cache-d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:27:53 user nova-compute[74821]: DEBUG nova.network.neutron [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:27:54 user nova-compute[74821]: DEBUG nova.network.neutron [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Updating instance_info_cache with network_info: [{"id": "267248e7-6714-47b4-b1b2-1d94251305da", "address": "fa:16:3e:4e:3f:6c", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267248e7-67", "ovs_interfaceid": "267248e7-6714-47b4-b1b2-1d94251305da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:27:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Releasing lock "refresh_cache-d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:27:54 user nova-compute[74821]: DEBUG nova.compute.manager [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Instance network_info: |[{"id": "267248e7-6714-47b4-b1b2-1d94251305da", "address": "fa:16:3e:4e:3f:6c", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267248e7-67", "ovs_interfaceid": "267248e7-6714-47b4-b1b2-1d94251305da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:27:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ebcf00b0-9b4e-4868-b62c-1150f8d0bc39 req-3c34fe33-4947-4123-a1ab-104bcdea082e service nova] Acquired lock "refresh_cache-d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:27:54 user nova-compute[74821]: DEBUG nova.network.neutron [req-ebcf00b0-9b4e-4868-b62c-1150f8d0bc39 req-3c34fe33-4947-4123-a1ab-104bcdea082e service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Refreshing network info cache for port 267248e7-6714-47b4-b1b2-1d94251305da {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:27:54 user nova-compute[74821]: DEBUG nova.network.neutron [req-ebcf00b0-9b4e-4868-b62c-1150f8d0bc39 req-3c34fe33-4947-4123-a1ab-104bcdea082e service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Updated VIF entry in instance network info cache for port 267248e7-6714-47b4-b1b2-1d94251305da. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:27:54 user nova-compute[74821]: DEBUG nova.network.neutron [req-ebcf00b0-9b4e-4868-b62c-1150f8d0bc39 req-3c34fe33-4947-4123-a1ab-104bcdea082e service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Updating instance_info_cache with network_info: [{"id": "267248e7-6714-47b4-b1b2-1d94251305da", "address": "fa:16:3e:4e:3f:6c", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267248e7-67", "ovs_interfaceid": "267248e7-6714-47b4-b1b2-1d94251305da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:27:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ebcf00b0-9b4e-4868-b62c-1150f8d0bc39 req-3c34fe33-4947-4123-a1ab-104bcdea082e service nova] Releasing lock "refresh_cache-d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:27:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:27:58 user nova-compute[74821]: DEBUG nova.compute.manager [req-b08fa4d5-7187-4fe0-b421-495c6ba5ac87 req-143dadde-9279-4a9b-afdf-0ba060028357 service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Received event network-changed-f768a2c5-10b0-4442-9c76-3b2365a15ea1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:27:58 user nova-compute[74821]: DEBUG nova.compute.manager [req-b08fa4d5-7187-4fe0-b421-495c6ba5ac87 req-143dadde-9279-4a9b-afdf-0ba060028357 service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Refreshing instance network info cache due to event network-changed-f768a2c5-10b0-4442-9c76-3b2365a15ea1. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:27:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b08fa4d5-7187-4fe0-b421-495c6ba5ac87 req-143dadde-9279-4a9b-afdf-0ba060028357 service nova] Acquiring lock "refresh_cache-2d8da345-f66d-45c2-8ccd-d22fdf79a14d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:27:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b08fa4d5-7187-4fe0-b421-495c6ba5ac87 req-143dadde-9279-4a9b-afdf-0ba060028357 service nova] Acquired lock "refresh_cache-2d8da345-f66d-45c2-8ccd-d22fdf79a14d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:27:58 user nova-compute[74821]: DEBUG nova.network.neutron [req-b08fa4d5-7187-4fe0-b421-495c6ba5ac87 req-143dadde-9279-4a9b-afdf-0ba060028357 service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Refreshing network info cache for port f768a2c5-10b0-4442-9c76-3b2365a15ea1 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:27:58 user nova-compute[74821]: DEBUG nova.network.neutron [req-b08fa4d5-7187-4fe0-b421-495c6ba5ac87 req-143dadde-9279-4a9b-afdf-0ba060028357 service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Updated VIF entry in instance network info cache for port f768a2c5-10b0-4442-9c76-3b2365a15ea1. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:27:58 user nova-compute[74821]: DEBUG nova.network.neutron [req-b08fa4d5-7187-4fe0-b421-495c6ba5ac87 req-143dadde-9279-4a9b-afdf-0ba060028357 service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Updating instance_info_cache with network_info: [{"id": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "address": "fa:16:3e:69:f1:92", "network": {"id": "fc4369de-77c4-4f2f-a73c-d556ca3ff47c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1805761900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56107e2c08004a26a96765ec143a6d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf768a2c5-10", "ovs_interfaceid": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:27:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b08fa4d5-7187-4fe0-b421-495c6ba5ac87 req-143dadde-9279-4a9b-afdf-0ba060028357 service nova] Releasing lock "refresh_cache-2d8da345-f66d-45c2-8ccd-d22fdf79a14d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:27:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Acquiring lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:28:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:28:00 user nova-compute[74821]: INFO nova.compute.manager [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Unshelving
Nov 06 13:28:01 user nova-compute[74821]: INFO nova.virt.block_device [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Booting with volume be4ce8c2-20da-4129-903f-4487642101af at /dev/vda
Nov 06 13:28:01 user nova-compute[74821]: DEBUG os_brick.utils [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:28:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:01 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8a020a-e2b0-4515-ab12-105754d99a2c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:01 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b4c860-019a-491a-90c3-c17067ccd9cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:01 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c33d983-fc2f-4817-86ad-fc748d8c3d8f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:01 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b897299f-b0cd-422b-a71d-bbf4269d9d37]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:28:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:28:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:28:01 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:28:01 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2177824a-abb0-4797-8b44-5b8ce19474d7]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:28:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:28:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:28:01 user nova-compute[74821]: DEBUG os_brick.utils [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:28:01 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Updating existing volume attachment record: d9792604-9589-4dc5-9968-df1cfa963b54 {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:28:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "64ae6f5e-38a1-4871-8015-c2097f64b33b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:28:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "64ae6f5e-38a1-4871-8015-c2097f64b33b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:28:13 user nova-compute[74821]: DEBUG nova.compute.manager [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:28:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:28:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:28:13 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:28:13 user nova-compute[74821]: INFO nova.compute.claims [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Claim successful on node user
Nov 06 13:28:13 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:28:13 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:28:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.447s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:28:13 user nova-compute[74821]: DEBUG nova.compute.manager [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:28:13 user nova-compute[74821]: DEBUG nova.compute.manager [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:28:13 user nova-compute[74821]: DEBUG nova.network.neutron [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:28:13 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:28:13 user nova-compute[74821]: DEBUG nova.compute.manager [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:28:13 user nova-compute[74821]: DEBUG nova.policy [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '133932d1063241078d84731624e89216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f745a322931e4150b12d139bfb17b94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:28:13 user nova-compute[74821]: INFO nova.virt.block_device [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Booting with volume-backed-image bbed6343-3ff2-4f28-897a-55ddcbbc8268 at /dev/vda
Nov 06 13:28:14 user nova-compute[74821]: DEBUG nova.compute.manager [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:28:14 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Creating image(s)
Nov 06 13:28:14 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Did not create local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Ensure instance console log exists: /opt/stack/data/nova/instances/d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Start _get_guest_xml network_info=[{"id": "267248e7-6714-47b4-b1b2-1d94251305da", "address": "fa:16:3e:4e:3f:6c", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267248e7-67", "ovs_interfaceid": "267248e7-6714-47b4-b1b2-1d94251305da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrHLNeiI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd508c34d-fd65-41b5-be8e-e7d5e3e0c1a8', 'attached_at': '', 'detached_at': '', 'volume_id': '546db5ab-eb3b-46e2-a7e2-bf7fb31d6604', 'serial': '546db5ab-eb3b-46e2-a7e2-bf7fb31d6604'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '86374073-2a30-4b79-a490-bc596b9f5c8a', 'volume_type': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:28:14 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:28:14 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:28:14 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrHLNeiI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:28:14 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:28:14 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:28:14 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:28:14 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:28:14 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:28:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd02f450-960f-4eca-bff0-63c7787ceb8c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:28:14 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e5ed48-f342-4f6f-a6ee-34b9f3f89fc3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604] added
Nov 06 13:28:14 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b22ff9-ba87-4159-acd3-d3c8698f940f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG nova.network.neutron [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Successfully created port: ded8f989-f920-42ed-a158-04455e6abbc1 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.157s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[65dcbd4e-4458-464a-aea3-b554b1e9307f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BrHLNeiI {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BrHLNeiI" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4013ee2f-f871-4cbc-9862-dc8cb7a923f7]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BrHLNeiI'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[720d19dd-e547-40e0-954e-0bfcb2e4e8d2]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1af558-fffa-4e14-a38f-a5b3c06b0d44]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:28:14 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:28:14 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[df51072b-bcd3-49f5-95bc-c3ae65b29d67]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604, portal: 172.16.0.220,3260]
Nov 06 13:28:14 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604, portal: 172.16.0.220,3260] successful.
Nov 06 13:28:14 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01edd3c-112a-4635-9f6b-a478b3f0bd6a]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9e2fde-eb81-4a19-ba7c-862b21999234]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:28:14 user nova-compute[74821]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:28:14 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:28:14 user nova-compute[74821]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:28:14 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.448s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26340f7-27f1-45e0-8a45-c637bf2a8764]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:14 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: None {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG nova.network.neutron [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Successfully updated port: ded8f989-f920-42ed-a158-04455e6abbc1 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "refresh_cache-64ae6f5e-38a1-4871-8015-c2097f64b33b" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquired lock "refresh_cache-64ae6f5e-38a1-4871-8015-c2097f64b33b" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG nova.network.neutron [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG nova.compute.manager [req-f4e17ed3-c7c6-4651-8698-c3e5e3d77eb0 req-a15471ea-bb0f-48b8-b776-6b57b668f461 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Received event network-changed-ded8f989-f920-42ed-a158-04455e6abbc1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG nova.compute.manager [req-f4e17ed3-c7c6-4651-8698-c3e5e3d77eb0 req-a15471ea-bb0f-48b8-b776-6b57b668f461 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Refreshing instance network info cache due to event network-changed-ded8f989-f920-42ed-a158-04455e6abbc1. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f4e17ed3-c7c6-4651-8698-c3e5e3d77eb0 req-a15471ea-bb0f-48b8-b776-6b57b668f461 service nova] Acquiring lock "refresh_cache-64ae6f5e-38a1-4871-8015-c2097f64b33b" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG nova.network.neutron [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG nova.network.neutron [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Updating instance_info_cache with network_info: [{"id": "ded8f989-f920-42ed-a158-04455e6abbc1", "address": "fa:16:3e:b2:3e:a6", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8f989-f9", "ovs_interfaceid": "ded8f989-f920-42ed-a158-04455e6abbc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Releasing lock "refresh_cache-64ae6f5e-38a1-4871-8015-c2097f64b33b" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG nova.compute.manager [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Instance network_info: |[{"id": "ded8f989-f920-42ed-a158-04455e6abbc1", "address": "fa:16:3e:b2:3e:a6", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8f989-f9", "ovs_interfaceid": "ded8f989-f920-42ed-a158-04455e6abbc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f4e17ed3-c7c6-4651-8698-c3e5e3d77eb0 req-a15471ea-bb0f-48b8-b776-6b57b668f461 service nova] Acquired lock "refresh_cache-64ae6f5e-38a1-4871-8015-c2097f64b33b" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG nova.network.neutron [req-f4e17ed3-c7c6-4651-8698-c3e5e3d77eb0 req-a15471ea-bb0f-48b8-b776-6b57b668f461 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Refreshing network info cache for port ded8f989-f920-42ed-a158-04455e6abbc1 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrHLNeiI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.479s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] <== connect_volume: return (1480ms) {'type': 'block', 'scsi_wwn': '23164343361356138', 'path': '/dev/sdb'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164343361356138', 'path': '/dev/sdb'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG nova.network.neutron [req-f4e17ed3-c7c6-4651-8698-c3e5e3d77eb0 req-a15471ea-bb0f-48b8-b776-6b57b668f461 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Updated VIF entry in instance network info cache for port ded8f989-f920-42ed-a158-04455e6abbc1. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG nova.network.neutron [req-f4e17ed3-c7c6-4651-8698-c3e5e3d77eb0 req-a15471ea-bb0f-48b8-b776-6b57b668f461 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Updating instance_info_cache with network_info: [{"id": "ded8f989-f920-42ed-a158-04455e6abbc1", "address": "fa:16:3e:b2:3e:a6", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8f989-f9", "ovs_interfaceid": "ded8f989-f920-42ed-a158-04455e6abbc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f4e17ed3-c7c6-4651-8698-c3e5e3d77eb0 req-a15471ea-bb0f-48b8-b776-6b57b668f461 service nova] Releasing lock "refresh_cache-64ae6f5e-38a1-4871-8015-c2097f64b33b" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:27:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-337626543',display_name='tempest-ServerActionsTestOtherA-server-337626543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-337626543',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4JiUWhVtBLaIMVWmdaDGfPw0zGPPsGUpSPMYouFUdE8U/JVhpnD9HPYPDsmw237Zq0kahTjlP/cerosJ2tVPbLsi+XC2cHQjqtX7zMb9rwN9mSYsloUtu1O3SiQuCuOw==',key_name='tempest-keypair-1142367632',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77233758870b4fdfbb7ca76829f0f82e',ramdisk_id='',reservation_id='r-ddppkv09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1986828412',owner_user_name='tempest-ServerActionsTestOtherA-1986828412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:27:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0620d1928d8d434fbe0bc1cdb31a2a89',uuid=d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "267248e7-6714-47b4-b1b2-1d94251305da", "address": "fa:16:3e:4e:3f:6c", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267248e7-67", "ovs_interfaceid": "267248e7-6714-47b4-b1b2-1d94251305da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Converting VIF {"id": "267248e7-6714-47b4-b1b2-1d94251305da", "address": "fa:16:3e:4e:3f:6c", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267248e7-67", "ovs_interfaceid": "267248e7-6714-47b4-b1b2-1d94251305da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:3f:6c,bridge_name='br-int',has_traffic_filtering=True,id=267248e7-6714-47b4-b1b2-1d94251305da,network=Network(a3838abe-b3bb-4878-9d5d-eb80a8cf60a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267248e7-67') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG nova.objects.instance [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lazy-loading 'pci_devices' on Instance uuid d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:28:15 user nova-compute[74821]:   <uuid>d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8</uuid>
Nov 06 13:28:15 user nova-compute[74821]:   <name>instance-00000022</name>
Nov 06 13:28:15 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:28:15 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:28:15 user nova-compute[74821]:   <metadata>
Nov 06 13:28:15 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:28:15 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:28:15 user nova-compute[74821]:       <nova:name>tempest-ServerActionsTestOtherA-server-337626543</nova:name>
Nov 06 13:28:15 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:28:14</nova:creationTime>
Nov 06 13:28:15 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:28:15 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:28:15 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:28:15 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:28:15 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:28:15 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:28:15 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:28:15 user nova-compute[74821]:       <nova:owner>
Nov 06 13:28:15 user nova-compute[74821]:         <nova:user uuid="0620d1928d8d434fbe0bc1cdb31a2a89">tempest-ServerActionsTestOtherA-1986828412-project-member</nova:user>
Nov 06 13:28:15 user nova-compute[74821]:         <nova:project uuid="77233758870b4fdfbb7ca76829f0f82e">tempest-ServerActionsTestOtherA-1986828412</nova:project>
Nov 06 13:28:15 user nova-compute[74821]:       </nova:owner>
Nov 06 13:28:15 user nova-compute[74821]:       <nova:ports>
Nov 06 13:28:15 user nova-compute[74821]:         <nova:port uuid="267248e7-6714-47b4-b1b2-1d94251305da">
Nov 06 13:28:15 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 13:28:15 user nova-compute[74821]:         </nova:port>
Nov 06 13:28:15 user nova-compute[74821]:       </nova:ports>
Nov 06 13:28:15 user nova-compute[74821]:     </nova:instance>
Nov 06 13:28:15 user nova-compute[74821]:   </metadata>
Nov 06 13:28:15 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:28:15 user nova-compute[74821]:     <system>
Nov 06 13:28:15 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:28:15 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:28:15 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:28:15 user nova-compute[74821]:       <entry name="serial">d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8</entry>
Nov 06 13:28:15 user nova-compute[74821]:       <entry name="uuid">d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8</entry>
Nov 06 13:28:15 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:28:15 user nova-compute[74821]:     </system>
Nov 06 13:28:15 user nova-compute[74821]:   </sysinfo>
Nov 06 13:28:15 user nova-compute[74821]:   <os>
Nov 06 13:28:15 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:28:15 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:28:15 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:28:15 user nova-compute[74821]:   </os>
Nov 06 13:28:15 user nova-compute[74821]:   <features>
Nov 06 13:28:15 user nova-compute[74821]:     <acpi/>
Nov 06 13:28:15 user nova-compute[74821]:     <apic/>
Nov 06 13:28:15 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:28:15 user nova-compute[74821]:   </features>
Nov 06 13:28:15 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:28:15 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:28:15 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:28:15 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:28:15 user nova-compute[74821]:   </clock>
Nov 06 13:28:15 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:28:15 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:28:15 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:28:15 user nova-compute[74821]:   </cpu>
Nov 06 13:28:15 user nova-compute[74821]:   <devices>
Nov 06 13:28:15 user nova-compute[74821]:     <disk type="block" device="disk">
Nov 06 13:28:15 user nova-compute[74821]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:28:15 user nova-compute[74821]:       <source dev="/dev/sdb"/>
Nov 06 13:28:15 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:28:15 user nova-compute[74821]:       <serial>546db5ab-eb3b-46e2-a7e2-bf7fb31d6604</serial>
Nov 06 13:28:15 user nova-compute[74821]:     </disk>
Nov 06 13:28:15 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:28:15 user nova-compute[74821]:       <mac address="fa:16:3e:4e:3f:6c"/>
Nov 06 13:28:15 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:28:15 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:28:15 user nova-compute[74821]:       <target dev="tap267248e7-67"/>
Nov 06 13:28:15 user nova-compute[74821]:     </interface>
Nov 06 13:28:15 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:28:15 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8/console.log" append="off"/>
Nov 06 13:28:15 user nova-compute[74821]:     </serial>
Nov 06 13:28:15 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:28:15 user nova-compute[74821]:     <video>
Nov 06 13:28:15 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:28:15 user nova-compute[74821]:     </video>
Nov 06 13:28:15 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:28:15 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:28:15 user nova-compute[74821]:     </rng>
Nov 06 13:28:15 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:28:15 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:28:15 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:28:15 user nova-compute[74821]:     </memballoon>
Nov 06 13:28:15 user nova-compute[74821]:   </devices>
Nov 06 13:28:15 user nova-compute[74821]: </domain>
Nov 06 13:28:15 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:27:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-337626543',display_name='tempest-ServerActionsTestOtherA-server-337626543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-337626543',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4JiUWhVtBLaIMVWmdaDGfPw0zGPPsGUpSPMYouFUdE8U/JVhpnD9HPYPDsmw237Zq0kahTjlP/cerosJ2tVPbLsi+XC2cHQjqtX7zMb9rwN9mSYsloUtu1O3SiQuCuOw==',key_name='tempest-keypair-1142367632',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77233758870b4fdfbb7ca76829f0f82e',ramdisk_id='',reservation_id='r-ddppkv09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1986828412',owner_user_name='tempest-ServerActionsTestOtherA-1986828412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:27:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0620d1928d8d434fbe0bc1cdb31a2a89',uuid=d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "267248e7-6714-47b4-b1b2-1d94251305da", "address": "fa:16:3e:4e:3f:6c", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267248e7-67", "ovs_interfaceid": "267248e7-6714-47b4-b1b2-1d94251305da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Converting VIF {"id": "267248e7-6714-47b4-b1b2-1d94251305da", "address": "fa:16:3e:4e:3f:6c", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267248e7-67", "ovs_interfaceid": "267248e7-6714-47b4-b1b2-1d94251305da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:3f:6c,bridge_name='br-int',has_traffic_filtering=True,id=267248e7-6714-47b4-b1b2-1d94251305da,network=Network(a3838abe-b3bb-4878-9d5d-eb80a8cf60a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267248e7-67') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG os_vif [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:3f:6c,bridge_name='br-int',has_traffic_filtering=True,id=267248e7-6714-47b4-b1b2-1d94251305da,network=Network(a3838abe-b3bb-4878-9d5d-eb80a8cf60a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267248e7-67') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6eca12e4-63e4-571d-9392-8a803400b771', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap267248e7-67, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap267248e7-67, col_values=(('qos', UUID('aef554e2-ecfa-4e0b-8c1f-80b63e4f246f')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap267248e7-67, col_values=(('external_ids', {'iface-id': '267248e7-6714-47b4-b1b2-1d94251305da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:3f:6c', 'vm-uuid': 'd508c34d-fd65-41b5-be8e-e7d5e3e0c1a8'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:15 user nova-compute[74821]: INFO os_vif [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:3f:6c,bridge_name='br-int',has_traffic_filtering=True,id=267248e7-6714-47b4-b1b2-1d94251305da,network=Network(a3838abe-b3bb-4878-9d5d-eb80a8cf60a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267248e7-67')
Nov 06 13:28:15 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:28:15 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] No VIF found with MAC fa:16:3e:4e:3f:6c, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2f8818c8-5bde-4e99-b3fb-3736a96a22fd tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "3e21d005-f190-478a-a911-e483e1235057" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2f8818c8-5bde-4e99-b3fb-3736a96a22fd tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "3e21d005-f190-478a-a911-e483e1235057" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2f8818c8-5bde-4e99-b3fb-3736a96a22fd tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "3e21d005-f190-478a-a911-e483e1235057-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2f8818c8-5bde-4e99-b3fb-3736a96a22fd tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "3e21d005-f190-478a-a911-e483e1235057-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2f8818c8-5bde-4e99-b3fb-3736a96a22fd tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "3e21d005-f190-478a-a911-e483e1235057-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:28:17 user nova-compute[74821]: INFO nova.compute.manager [None req-2f8818c8-5bde-4e99-b3fb-3736a96a22fd tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Terminating instance
Nov 06 13:28:17 user nova-compute[74821]: DEBUG nova.compute.manager [None req-2f8818c8-5bde-4e99-b3fb-3736a96a22fd tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG nova.compute.manager [req-fb900cfa-1597-42cf-9918-bb4ed970334c req-d02706f7-4620-49bf-8f45-c52b662d37d1 service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Received event network-vif-plugged-267248e7-6714-47b4-b1b2-1d94251305da {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fb900cfa-1597-42cf-9918-bb4ed970334c req-d02706f7-4620-49bf-8f45-c52b662d37d1 service nova] Acquiring lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fb900cfa-1597-42cf-9918-bb4ed970334c req-d02706f7-4620-49bf-8f45-c52b662d37d1 service nova] Lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fb900cfa-1597-42cf-9918-bb4ed970334c req-d02706f7-4620-49bf-8f45-c52b662d37d1 service nova] Lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG nova.compute.manager [req-fb900cfa-1597-42cf-9918-bb4ed970334c req-d02706f7-4620-49bf-8f45-c52b662d37d1 service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] No waiting events found dispatching network-vif-plugged-267248e7-6714-47b4-b1b2-1d94251305da {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:28:17 user nova-compute[74821]: WARNING nova.compute.manager [req-fb900cfa-1597-42cf-9918-bb4ed970334c req-d02706f7-4620-49bf-8f45-c52b662d37d1 service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Received unexpected event network-vif-plugged-267248e7-6714-47b4-b1b2-1d94251305da for instance with vm_state building and task_state spawning.
Nov 06 13:28:17 user nova-compute[74821]: DEBUG nova.compute.manager [req-284e843d-bc83-46b7-80d8-44fcdf5ebd68 req-84eeda62-6365-43c1-a9e5-2c11132e6c1b service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] Received event network-vif-unplugged-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-284e843d-bc83-46b7-80d8-44fcdf5ebd68 req-84eeda62-6365-43c1-a9e5-2c11132e6c1b service nova] Acquiring lock "3e21d005-f190-478a-a911-e483e1235057-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-284e843d-bc83-46b7-80d8-44fcdf5ebd68 req-84eeda62-6365-43c1-a9e5-2c11132e6c1b service nova] Lock "3e21d005-f190-478a-a911-e483e1235057-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-284e843d-bc83-46b7-80d8-44fcdf5ebd68 req-84eeda62-6365-43c1-a9e5-2c11132e6c1b service nova] Lock "3e21d005-f190-478a-a911-e483e1235057-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG nova.compute.manager [req-284e843d-bc83-46b7-80d8-44fcdf5ebd68 req-84eeda62-6365-43c1-a9e5-2c11132e6c1b service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] No waiting events found dispatching network-vif-unplugged-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG nova.compute.manager [req-284e843d-bc83-46b7-80d8-44fcdf5ebd68 req-84eeda62-6365-43c1-a9e5-2c11132e6c1b service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] Received event network-vif-unplugged-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:17 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 3e21d005-f190-478a-a911-e483e1235057] Instance destroyed successfully.
Nov 06 13:28:17 user nova-compute[74821]: DEBUG nova.objects.instance [None req-2f8818c8-5bde-4e99-b3fb-3736a96a22fd tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lazy-loading 'resources' on Instance uuid 3e21d005-f190-478a-a911-e483e1235057 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-2f8818c8-5bde-4e99-b3fb-3736a96a22fd tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1653169687',display_name='tempest-ServerRescueNegativeTestJSON-server-1653169687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1653169687',id=1,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:15:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e246e1fd12054401988f9d49f6ad9373',ramdisk_id='',reservation_id='r-zs0g66cj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1107947568',owner_user_name='tempest-ServerRescueNegativeTestJSON-1107947568-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:17:13Z,user_data=None,user_id='4a0f35998b664c32990f079ca1cd5e6d',uuid=3e21d005-f190-478a-a911-e483e1235057,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "address": "fa:16:3e:e0:fc:40", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6fb684-24", "ovs_interfaceid": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-2f8818c8-5bde-4e99-b3fb-3736a96a22fd tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Converting VIF {"id": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "address": "fa:16:3e:e0:fc:40", "network": {"id": "45ec1f7e-dbfa-4746-8d35-e32f7c938a0b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2138577475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e246e1fd12054401988f9d49f6ad9373", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6fb684-24", "ovs_interfaceid": "1f6fb684-24b2-4edc-a5c7-e5097ef2fb16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-2f8818c8-5bde-4e99-b3fb-3736a96a22fd tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:fc:40,bridge_name='br-int',has_traffic_filtering=True,id=1f6fb684-24b2-4edc-a5c7-e5097ef2fb16,network=Network(45ec1f7e-dbfa-4746-8d35-e32f7c938a0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6fb684-24') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG os_vif [None req-2f8818c8-5bde-4e99-b3fb-3736a96a22fd tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:fc:40,bridge_name='br-int',has_traffic_filtering=True,id=1f6fb684-24b2-4edc-a5c7-e5097ef2fb16,network=Network(45ec1f7e-dbfa-4746-8d35-e32f7c938a0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6fb684-24') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f6fb684-24, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=12f1dd44-fab7-4955-a6d5-e076145f9f17) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:18 user nova-compute[74821]: INFO os_vif [None req-2f8818c8-5bde-4e99-b3fb-3736a96a22fd tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:fc:40,bridge_name='br-int',has_traffic_filtering=True,id=1f6fb684-24b2-4edc-a5c7-e5097ef2fb16,network=Network(45ec1f7e-dbfa-4746-8d35-e32f7c938a0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6fb684-24')
Nov 06 13:28:18 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-2f8818c8-5bde-4e99-b3fb-3736a96a22fd tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Deleting instance files /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057_del
Nov 06 13:28:18 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-2f8818c8-5bde-4e99-b3fb-3736a96a22fd tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Deletion of /opt/stack/data/nova/instances/3e21d005-f190-478a-a911-e483e1235057_del complete
Nov 06 13:28:18 user nova-compute[74821]: INFO nova.compute.manager [None req-2f8818c8-5bde-4e99-b3fb-3736a96a22fd tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] [instance: 3e21d005-f190-478a-a911-e483e1235057] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 06 13:28:18 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-2f8818c8-5bde-4e99-b3fb-3736a96a22fd tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:28:18 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: 3e21d005-f190-478a-a911-e483e1235057] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:28:18 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 3e21d005-f190-478a-a911-e483e1235057] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:28:18 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 3e21d005-f190-478a-a911-e483e1235057] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:28:18 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: 3e21d005-f190-478a-a911-e483e1235057] Took 0.41 seconds to deallocate network for instance.
Nov 06 13:28:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2f8818c8-5bde-4e99-b3fb-3736a96a22fd tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:28:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2f8818c8-5bde-4e99-b3fb-3736a96a22fd tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:28:18 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-2f8818c8-5bde-4e99-b3fb-3736a96a22fd tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:28:18 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-2f8818c8-5bde-4e99-b3fb-3736a96a22fd tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:28:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2f8818c8-5bde-4e99-b3fb-3736a96a22fd tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:28:19 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-2f8818c8-5bde-4e99-b3fb-3736a96a22fd tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Deleted allocations for instance 3e21d005-f190-478a-a911-e483e1235057
Nov 06 13:28:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2f8818c8-5bde-4e99-b3fb-3736a96a22fd tempest-ServerRescueNegativeTestJSON-1107947568 tempest-ServerRescueNegativeTestJSON-1107947568-project-member] Lock "3e21d005-f190-478a-a911-e483e1235057" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.021s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:28:19 user nova-compute[74821]: DEBUG nova.compute.manager [req-660f76c2-d818-4fa7-8505-8d89c90e9ab7 req-f44d2321-6c5d-4d84-8998-923de524f755 service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Received event network-vif-plugged-267248e7-6714-47b4-b1b2-1d94251305da {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:28:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-660f76c2-d818-4fa7-8505-8d89c90e9ab7 req-f44d2321-6c5d-4d84-8998-923de524f755 service nova] Acquiring lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:28:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-660f76c2-d818-4fa7-8505-8d89c90e9ab7 req-f44d2321-6c5d-4d84-8998-923de524f755 service nova] Lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:28:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-660f76c2-d818-4fa7-8505-8d89c90e9ab7 req-f44d2321-6c5d-4d84-8998-923de524f755 service nova] Lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:28:19 user nova-compute[74821]: DEBUG nova.compute.manager [req-660f76c2-d818-4fa7-8505-8d89c90e9ab7 req-f44d2321-6c5d-4d84-8998-923de524f755 service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] No waiting events found dispatching network-vif-plugged-267248e7-6714-47b4-b1b2-1d94251305da {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:28:19 user nova-compute[74821]: WARNING nova.compute.manager [req-660f76c2-d818-4fa7-8505-8d89c90e9ab7 req-f44d2321-6c5d-4d84-8998-923de524f755 service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Received unexpected event network-vif-plugged-267248e7-6714-47b4-b1b2-1d94251305da for instance with vm_state building and task_state spawning.
Nov 06 13:28:19 user nova-compute[74821]: DEBUG nova.compute.manager [req-1aa9035c-8f49-492a-b41b-647bbbb64c1d req-e2d8508c-60f7-4474-b624-9cc0ff2d4de6 service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] Received event network-vif-plugged-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:28:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1aa9035c-8f49-492a-b41b-647bbbb64c1d req-e2d8508c-60f7-4474-b624-9cc0ff2d4de6 service nova] Acquiring lock "3e21d005-f190-478a-a911-e483e1235057-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:28:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1aa9035c-8f49-492a-b41b-647bbbb64c1d req-e2d8508c-60f7-4474-b624-9cc0ff2d4de6 service nova] Lock "3e21d005-f190-478a-a911-e483e1235057-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:28:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1aa9035c-8f49-492a-b41b-647bbbb64c1d req-e2d8508c-60f7-4474-b624-9cc0ff2d4de6 service nova] Lock "3e21d005-f190-478a-a911-e483e1235057-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:28:19 user nova-compute[74821]: DEBUG nova.compute.manager [req-1aa9035c-8f49-492a-b41b-647bbbb64c1d req-e2d8508c-60f7-4474-b624-9cc0ff2d4de6 service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] No waiting events found dispatching network-vif-plugged-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:28:19 user nova-compute[74821]: WARNING nova.compute.manager [req-1aa9035c-8f49-492a-b41b-647bbbb64c1d req-e2d8508c-60f7-4474-b624-9cc0ff2d4de6 service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] Received unexpected event network-vif-plugged-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 for instance with vm_state deleted and task_state None.
Nov 06 13:28:19 user nova-compute[74821]: DEBUG nova.compute.manager [req-1aa9035c-8f49-492a-b41b-647bbbb64c1d req-e2d8508c-60f7-4474-b624-9cc0ff2d4de6 service nova] [instance: 3e21d005-f190-478a-a911-e483e1235057] Received event network-vif-deleted-1f6fb684-24b2-4edc-a5c7-e5097ef2fb16 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:28:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:19 user nova-compute[74821]: DEBUG nova.compute.manager [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:28:19 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:28:19 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Instance spawned successfully.
Nov 06 13:28:19 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:28:19 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:28:19 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:28:19 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:28:19 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:28:19 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:28:19 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:28:19 user nova-compute[74821]: INFO nova.compute.manager [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Took 5.60 seconds to spawn the instance on the hypervisor.
Nov 06 13:28:19 user nova-compute[74821]: DEBUG nova.compute.manager [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:28:19 user nova-compute[74821]: INFO nova.compute.manager [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Took 27.92 seconds to build instance.
Nov 06 13:28:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-480cb6d7-c8c7-4d52-b8f5-1c4d969c8dde tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.014s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:28:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:27 user nova-compute[74821]: DEBUG nova.compute.manager [req-6d28582a-fc5b-4d17-98cc-fa7291a61422 req-a75fa531-4e5b-4554-86c6-62383555fca0 service nova] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Received event network-changed-b317cb51-20ab-4f25-b3de-4c2981a97993 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:28:27 user nova-compute[74821]: DEBUG nova.compute.manager [req-6d28582a-fc5b-4d17-98cc-fa7291a61422 req-a75fa531-4e5b-4554-86c6-62383555fca0 service nova] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Refreshing instance network info cache due to event network-changed-b317cb51-20ab-4f25-b3de-4c2981a97993. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:28:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6d28582a-fc5b-4d17-98cc-fa7291a61422 req-a75fa531-4e5b-4554-86c6-62383555fca0 service nova] Acquiring lock "refresh_cache-4bc6444e-b55d-4d81-88d1-f4d147255119" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:28:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6d28582a-fc5b-4d17-98cc-fa7291a61422 req-a75fa531-4e5b-4554-86c6-62383555fca0 service nova] Acquired lock "refresh_cache-4bc6444e-b55d-4d81-88d1-f4d147255119" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:28:27 user nova-compute[74821]: DEBUG nova.network.neutron [req-6d28582a-fc5b-4d17-98cc-fa7291a61422 req-a75fa531-4e5b-4554-86c6-62383555fca0 service nova] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Refreshing network info cache for port b317cb51-20ab-4f25-b3de-4c2981a97993 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:28:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:28:28 user nova-compute[74821]: DEBUG nova.network.neutron [req-6d28582a-fc5b-4d17-98cc-fa7291a61422 req-a75fa531-4e5b-4554-86c6-62383555fca0 service nova] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Updated VIF entry in instance network info cache for port b317cb51-20ab-4f25-b3de-4c2981a97993. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:28:28 user nova-compute[74821]: DEBUG nova.network.neutron [req-6d28582a-fc5b-4d17-98cc-fa7291a61422 req-a75fa531-4e5b-4554-86c6-62383555fca0 service nova] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Updating instance_info_cache with network_info: [{"id": "b317cb51-20ab-4f25-b3de-4c2981a97993", "address": "fa:16:3e:28:c0:6e", "network": {"id": "5e673907-9763-4136-845d-b3154200d004", "bridge": "br-int", "label": "tempest-TestStampPattern-539864653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608cf017c43942a4a94982b1d5d4d2b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb317cb51-20", "ovs_interfaceid": "b317cb51-20ab-4f25-b3de-4c2981a97993", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:28:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6d28582a-fc5b-4d17-98cc-fa7291a61422 req-a75fa531-4e5b-4554-86c6-62383555fca0 service nova] Releasing lock "refresh_cache-4bc6444e-b55d-4d81-88d1-f4d147255119" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:28:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Acquiring lock "4bc6444e-b55d-4d81-88d1-f4d147255119" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:28:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "4bc6444e-b55d-4d81-88d1-f4d147255119" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:28:28 user nova-compute[74821]: DEBUG nova.objects.instance [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lazy-loading 'flavor' on Instance uuid 4bc6444e-b55d-4d81-88d1-f4d147255119 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:28:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "4bc6444e-b55d-4d81-88d1-f4d147255119" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:28:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Acquiring lock "4bc6444e-b55d-4d81-88d1-f4d147255119" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:28:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "4bc6444e-b55d-4d81-88d1-f4d147255119" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:28:28 user nova-compute[74821]: INFO nova.compute.manager [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Attaching volume 2f555835-8d89-4d1a-a9af-47acaecbf02f to /dev/vdb
Nov 06 13:28:28 user nova-compute[74821]: DEBUG os_brick.utils [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:28:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:28 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c2e6cb-ab93-4bf4-96ec-1c462f19970f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:28 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecd6f49-8fd2-4f62-957c-964ff5bf7f31]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:28 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cbe498-f336-4864-a25a-eb72b6eac0f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:28 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[764b1f22-fc7c-4e82-8959-7b5ab289cd02]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:28:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:28:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:28:28 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:28:28 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10ca4b0-43ec-4246-bbf7-29639d2ceaef]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:28:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:28:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:28:28 user nova-compute[74821]: DEBUG os_brick.utils [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:28:28 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Updating existing volume attachment record: 840699d1-3971-4c23-a2c9-aa6032cd438c {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:28:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:29 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:28:30 user nova-compute[74821]: DEBUG nova.compute.manager [req-1913b1ad-d933-4699-90f5-70ef38f93661 req-de060053-8a1c-4f08-899d-4e25e3ac527a service nova] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Received event network-changed-aa074cf5-9a21-409b-8200-453a48485332 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:28:30 user nova-compute[74821]: DEBUG nova.compute.manager [req-1913b1ad-d933-4699-90f5-70ef38f93661 req-de060053-8a1c-4f08-899d-4e25e3ac527a service nova] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Refreshing instance network info cache due to event network-changed-aa074cf5-9a21-409b-8200-453a48485332. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:28:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1913b1ad-d933-4699-90f5-70ef38f93661 req-de060053-8a1c-4f08-899d-4e25e3ac527a service nova] Acquiring lock "refresh_cache-89b04a09-41d8-461f-8d14-bb3b9c72ed76" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:28:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1913b1ad-d933-4699-90f5-70ef38f93661 req-de060053-8a1c-4f08-899d-4e25e3ac527a service nova] Acquired lock "refresh_cache-89b04a09-41d8-461f-8d14-bb3b9c72ed76" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:28:30 user nova-compute[74821]: DEBUG nova.network.neutron [req-1913b1ad-d933-4699-90f5-70ef38f93661 req-de060053-8a1c-4f08-899d-4e25e3ac527a service nova] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Refreshing network info cache for port aa074cf5-9a21-409b-8200-453a48485332 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:28:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Acquiring lock "89b04a09-41d8-461f-8d14-bb3b9c72ed76" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:28:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "89b04a09-41d8-461f-8d14-bb3b9c72ed76" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:28:30 user nova-compute[74821]: DEBUG nova.objects.instance [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lazy-loading 'flavor' on Instance uuid 89b04a09-41d8-461f-8d14-bb3b9c72ed76 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:28:30 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Ignoring supplied device name: /dev/vdb
Nov 06 13:28:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "89b04a09-41d8-461f-8d14-bb3b9c72ed76" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:28:31 user nova-compute[74821]: DEBUG nova.network.neutron [req-1913b1ad-d933-4699-90f5-70ef38f93661 req-de060053-8a1c-4f08-899d-4e25e3ac527a service nova] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Updated VIF entry in instance network info cache for port aa074cf5-9a21-409b-8200-453a48485332. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:28:31 user nova-compute[74821]: DEBUG nova.network.neutron [req-1913b1ad-d933-4699-90f5-70ef38f93661 req-de060053-8a1c-4f08-899d-4e25e3ac527a service nova] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Updating instance_info_cache with network_info: [{"id": "aa074cf5-9a21-409b-8200-453a48485332", "address": "fa:16:3e:af:cb:31", "network": {"id": "9fe30aa2-5c5b-448b-8bd5-cdeda2721e6b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2097801930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f25eb95045d145c99d728e5d007ec1b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa074cf5-9a", "ovs_interfaceid": "aa074cf5-9a21-409b-8200-453a48485332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:28:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1913b1ad-d933-4699-90f5-70ef38f93661 req-de060053-8a1c-4f08-899d-4e25e3ac527a service nova] Releasing lock "refresh_cache-89b04a09-41d8-461f-8d14-bb3b9c72ed76" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:28:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Acquiring lock "89b04a09-41d8-461f-8d14-bb3b9c72ed76" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:28:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "89b04a09-41d8-461f-8d14-bb3b9c72ed76" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:28:31 user nova-compute[74821]: INFO nova.compute.manager [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Attaching volume 52357f8d-a952-448e-9c2a-8714beae1815 to /dev/vdb
Nov 06 13:28:31 user nova-compute[74821]: DEBUG os_brick.utils [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:28:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa71da7-b6c2-4b79-8f43-696de0330abf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d73921-e766-4418-8392-4ed82153873d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c826a6-a81d-4349-8ab7-1b9dc67c1a43]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f168a7f-3be0-464d-ac87-7990a0806263]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:28:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:28:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:28:31 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:28:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc9fc76-4610-44ed-91b5-58bdbda08028]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:28:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:28:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:28:31 user nova-compute[74821]: DEBUG os_brick.utils [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:28:31 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Updating existing volume attachment record: 7d6e7940-d4aa-455e-a556-98f5358b736f {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:28:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:33 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:28:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:38 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:28:38 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:28:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-2de346cb-9858-47b8-a86c-4fde720d6127" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:28:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-2de346cb-9858-47b8-a86c-4fde720d6127" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:28:39 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:28:39 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Updating instance_info_cache with network_info: [{"id": "364b4308-8730-4b11-90a1-48ea6ab3de60", "address": "fa:16:3e:48:8d:c6", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b4308-87", "ovs_interfaceid": "364b4308-8730-4b11-90a1-48ea6ab3de60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:28:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-2de346cb-9858-47b8-a86c-4fde720d6127" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:28:39 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:28:39 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:28:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:40 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:28:41 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:28:41 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:28:41 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:28:43 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:43 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:28:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:45 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:28:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:28:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:28:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:28:45 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:28:46 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:28:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8d249b8-752d-434a-be2c-b8c2b5233503/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8d249b8-752d-434a-be2c-b8c2b5233503/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8d249b8-752d-434a-be2c-b8c2b5233503/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8d249b8-752d-434a-be2c-b8c2b5233503/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b04a09-41d8-461f-8d14-bb3b9c72ed76/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b04a09-41d8-461f-8d14-bb3b9c72ed76/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b04a09-41d8-461f-8d14-bb3b9c72ed76/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b04a09-41d8-461f-8d14-bb3b9c72ed76/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:28:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:48 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:49 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:28:49 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:28:49 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=7650MB free_disk=25.121490478515625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:28:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:28:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:28:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:49 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 2de346cb-9858-47b8-a86c-4fde720d6127 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:28:49 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 49c65aca-8392-46ba-8fa3-b47ff2416cb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:28:49 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 496f8213-4b32-4211-a354-e33a4a088848 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:28:49 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 1290bdb3-827f-4365-a4f1-4ae063de780d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:28:49 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 2d8da345-f66d-45c2-8ccd-d22fdf79a14d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:28:49 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 4bc6444e-b55d-4d81-88d1-f4d147255119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:28:49 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 89b04a09-41d8-461f-8d14-bb3b9c72ed76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:28:49 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance b8d249b8-752d-434a-be2c-b8c2b5233503 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:28:49 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:28:49 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 06 13:28:49 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 64ae6f5e-38a1-4871-8015-c2097f64b33b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:28:49 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:28:49 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:28:50 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:28:50 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:28:50 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:28:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.724s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:28:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:28:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:28:51 user nova-compute[74821]: DEBUG nova.objects.instance [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lazy-loading 'pci_requests' on Instance uuid 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:28:51 user nova-compute[74821]: DEBUG nova.objects.instance [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lazy-loading 'numa_topology' on Instance uuid 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:28:51 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:28:51 user nova-compute[74821]: INFO nova.compute.claims [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Claim successful on node user
Nov 06 13:28:51 user nova-compute[74821]: DEBUG os_brick.utils [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:28:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cd91aa-517b-4ec8-8fa6-0901298f6654]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c61b50-a58b-4f74-a71a-996e6e33f97c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd2a74e-aa7b-4d68-8f5d-2e440ef6af8a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a83101c-6f35-4842-9167-6870b1e7ec79]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:28:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:28:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:28:51 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:28:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56bdfdf-eafd-40c7-97f3-f97480d85c3d]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:28:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:28:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:28:51 user nova-compute[74821]: DEBUG os_brick.utils [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:28:51 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Updating existing volume attachment record: 59550c62-1fed-45df-bebf-5f7f1360dd0c {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.559s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SPEycThI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:28:52 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:28:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:28:52 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:28:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:28:52 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:28:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:52 user nova-compute[74821]: INFO nova.network.neutron [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Updating port f35b642a-825f-4e17-9b97-3c8eba32a08e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c94967b-246a-4149-918b-7356cc6a7b22]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:28:52 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7490140-bd3a-415d-a66d-888719bb1172]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f] added
Nov 06 13:28:52 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3a073f-ca69-4504-8414-cfa1a89393d1]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7665c2e-ff14-42fa-802d-372744ef2e4c]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SPEycThI {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SPEycThI" returned: 0 in 0.029s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d53ecf2-10fb-433d-802d-99484b5bac5f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SPEycThI'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62db3b4-4735-443d-b359-7b3d3dad84ee]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebadee98-cded-4aad-8eaa-3db7e4c69eba]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf062a0-644d-4e2e-9c15-58c4642d0a51 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:28:52 user nova-compute[74821]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:28:52 user nova-compute[74821]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf062a0-644d-4e2e-9c15-58c4642d0a51 (non-flash)
Nov 06 13:28:52 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:28:52 user nova-compute[74821]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:28:52 user nova-compute[74821]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf062a0-644d-4e2e-9c15-58c4642d0a51 (non-flash)
Nov 06 13:28:52 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bec497-b10d-43d1-80db-ef9c4b35e0c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f, portal: 172.16.0.220,3260]
Nov 06 13:28:52 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f, portal: 172.16.0.220,3260] successful.
Nov 06 13:28:52 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe866b5-eadc-46af-b123-4816cb25fcb4]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8695ae6d-60ed-4ab5-b7c9-9804d01d5efb]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf062a0-644d-4e2e-9c15-58c4642d0a51 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:28:52 user nova-compute[74821]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:28:52 user nova-compute[74821]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf062a0-644d-4e2e-9c15-58c4642d0a51 (non-flash)
Nov 06 13:28:52 user nova-compute[74821]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f (non-flash)
Nov 06 13:28:52 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:28:52 user nova-compute[74821]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:28:52 user nova-compute[74821]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf062a0-644d-4e2e-9c15-58c4642d0a51 (non-flash)
Nov 06 13:28:52 user nova-compute[74821]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f (non-flash)
Nov 06 13:28:52 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf15e29-b08f-4b43-b454-b7fec5b95cdc]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:28:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SPEycThI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Acquiring lock "refresh_cache-9cf1a0c3-4719-4637-a88d-e5864b2f1c3c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Acquired lock "refresh_cache-9cf1a0c3-4719-4637-a88d-e5864b2f1c3c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG nova.network.neutron [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG nova.compute.manager [req-0773c689-cddb-4d40-8aac-f9d85afe9294 req-df46531b-761d-47ae-ae15-cc440050e1f9 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Received event network-changed-f35b642a-825f-4e17-9b97-3c8eba32a08e {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG nova.compute.manager [req-0773c689-cddb-4d40-8aac-f9d85afe9294 req-df46531b-761d-47ae-ae15-cc440050e1f9 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Refreshing instance network info cache due to event network-changed-f35b642a-825f-4e17-9b97-3c8eba32a08e. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0773c689-cddb-4d40-8aac-f9d85afe9294 req-df46531b-761d-47ae-ae15-cc440050e1f9 service nova] Acquiring lock "refresh_cache-9cf1a0c3-4719-4637-a88d-e5864b2f1c3c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '26335326634643039', 'path': '/dev/sde'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335326634643039', 'path': '/dev/sde'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG nova.objects.instance [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lazy-loading 'flavor' on Instance uuid 4bc6444e-b55d-4d81-88d1-f4d147255119 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 13:28:53 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:28:53 user nova-compute[74821]:   <source dev="/dev/sde"/>
Nov 06 13:28:53 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:28:53 user nova-compute[74821]:   <serial>2f555835-8d89-4d1a-a9af-47acaecbf02f</serial>
Nov 06 13:28:53 user nova-compute[74821]: </disk>
Nov 06 13:28:53 user nova-compute[74821]:  {{(pid=74821) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG nova.network.neutron [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Updating instance_info_cache with network_info: [{"id": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "address": "fa:16:3e:3f:5e:be", "network": {"id": "20103956-1e64-4c7a-bed2-24edd5ae7724", "bridge": "br-int", "label": "tempest-TestShelveInstance-307843308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d32bd8dc1c9419b90607e20dfa5d50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35b642a-82", "ovs_interfaceid": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Releasing lock "refresh_cache-9cf1a0c3-4719-4637-a88d-e5864b2f1c3c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:28:53 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Creating image(s)
Nov 06 13:28:53 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Did not create local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Ensure instance console log exists: /opt/stack/data/nova/instances/9cf1a0c3-4719-4637-a88d-e5864b2f1c3c/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Start _get_guest_xml network_info=[{"id": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "address": "fa:16:3e:3f:5e:be", "network": {"id": "20103956-1e64-4c7a-bed2-24edd5ae7724", "bridge": "br-int", "label": "tempest-TestShelveInstance-307843308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d32bd8dc1c9419b90607e20dfa5d50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35b642a-82", "ovs_interfaceid": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VqnwLbMR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9cf1a0c3-4719-4637-a88d-e5864b2f1c3c', 'attached_at': '', 'detached_at': '', 'volume_id': 'be4ce8c2-20da-4129-903f-4487642101af', 'serial': 'be4ce8c2-20da-4129-903f-4487642101af'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': 'd9792604-9589-4dc5-9968-df1cfa963b54', 'volume_type': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0773c689-cddb-4d40-8aac-f9d85afe9294 req-df46531b-761d-47ae-ae15-cc440050e1f9 service nova] Acquired lock "refresh_cache-9cf1a0c3-4719-4637-a88d-e5864b2f1c3c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG nova.network.neutron [req-0773c689-cddb-4d40-8aac-f9d85afe9294 req-df46531b-761d-47ae-ae15-cc440050e1f9 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Refreshing network info cache for port f35b642a-825f-4e17-9b97-3c8eba32a08e {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:28:53 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:28:53 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:28:53 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG nova.objects.instance [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG nova.objects.base [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Object Instance<9cf1a0c3-4719-4637-a88d-e5864b2f1c3c> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VqnwLbMR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:28:53 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:28:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:28:53 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:28:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:28:53 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:28:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1232df-2f74-45af-8f0c-dcf1900930e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:28:53 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec42402-120c-4a84-ab29-d43db6438c1f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af] added
Nov 06 13:28:53 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b03fe1d-066a-436c-ba34-8646fbceea29]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7869ba-d6ef-4f2f-862a-b737ba30c841]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VqnwLbMR {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VqnwLbMR" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[336ccac6-cf78-447d-868d-0ff1a4820296]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VqnwLbMR'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ed4859-3300-41fd-aeb7-8218d421e26e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff5e873-dc47-45a6-b3a7-9677727e8ec1]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf062a0-644d-4e2e-9c15-58c4642d0a51 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:28:54 user nova-compute[74821]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:28:54 user nova-compute[74821]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf062a0-644d-4e2e-9c15-58c4642d0a51 (non-flash)
Nov 06 13:28:54 user nova-compute[74821]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f (non-flash)
Nov 06 13:28:54 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:28:54 user nova-compute[74821]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:28:54 user nova-compute[74821]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf062a0-644d-4e2e-9c15-58c4642d0a51 (non-flash)
Nov 06 13:28:54 user nova-compute[74821]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f (non-flash)
Nov 06 13:28:54 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] No VIF found with MAC fa:16:3e:28:c0:6e, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[330f38b5-f9bf-40b8-8bfd-002cdf90beed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af, portal: 172.16.0.220,3260]
Nov 06 13:28:54 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af, portal: 172.16.0.220,3260] successful.
Nov 06 13:28:54 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f38c402-66b0-4e3d-b550-6038d7d092fe]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b7c55f-04b3-4da6-b41c-9b3d16f54a09]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf062a0-644d-4e2e-9c15-58c4642d0a51 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:28:54 user nova-compute[74821]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:28:54 user nova-compute[74821]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf062a0-644d-4e2e-9c15-58c4642d0a51 (non-flash)
Nov 06 13:28:54 user nova-compute[74821]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f (non-flash)
Nov 06 13:28:54 user nova-compute[74821]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:28:54 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:28:54 user nova-compute[74821]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:28:54 user nova-compute[74821]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf062a0-644d-4e2e-9c15-58c4642d0a51 (non-flash)
Nov 06 13:28:54 user nova-compute[74821]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f (non-flash)
Nov 06 13:28:54 user nova-compute[74821]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:28:54 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] HCTL ('37', '-', '-', 0) found on session 28 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f87946-964d-4baa-9779-55d5b45af0cb]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Searching for a device in session 28 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VqnwLbMR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG nova.network.neutron [req-0773c689-cddb-4d40-8aac-f9d85afe9294 req-df46531b-761d-47ae-ae15-cc440050e1f9 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Updated VIF entry in instance network info cache for port f35b642a-825f-4e17-9b97-3c8eba32a08e. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG nova.network.neutron [req-0773c689-cddb-4d40-8aac-f9d85afe9294 req-df46531b-761d-47ae-ae15-cc440050e1f9 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Updating instance_info_cache with network_info: [{"id": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "address": "fa:16:3e:3f:5e:be", "network": {"id": "20103956-1e64-4c7a-bed2-24edd5ae7724", "bridge": "br-int", "label": "tempest-TestShelveInstance-307843308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d32bd8dc1c9419b90607e20dfa5d50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35b642a-82", "ovs_interfaceid": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8421f609-d791-499a-8730-70011fd6c9d7 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "4bc6444e-b55d-4d81-88d1-f4d147255119" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.733s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0773c689-cddb-4d40-8aac-f9d85afe9294 req-df46531b-761d-47ae-ae15-cc440050e1f9 service nova] Releasing lock "refresh_cache-9cf1a0c3-4719-4637-a88d-e5864b2f1c3c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:28:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'piPIlZHh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:28:55 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:28:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] <== connect_volume: return (1399ms) {'type': 'block', 'scsi_wwn': '23335313566373062', 'path': '/dev/sdf'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335313566373062', 'path': '/dev/sdf'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.008s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:28:55 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:28:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:28:55 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:28:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T13:24:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2121328163',display_name='tempest-TestShelveInstance-server-2121328163',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2121328163',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1104151437',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:25:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6d32bd8dc1c9419b90607e20dfa5d50b',ramdisk_id='',reservation_id='r-14h61fxg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-570916377',owner_user_name='tempest-TestShelveInstance-570916377-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:28:01Z,user_data=None,user_id='59d98c278c9349f3a010b526679a67b3',uuid=9cf1a0c3-4719-4637-a88d-e5864b2f1c3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "address": "fa:16:3e:3f:5e:be", "network": {"id": "20103956-1e64-4c7a-bed2-24edd5ae7724", "bridge": "br-int", "label": "tempest-TestShelveInstance-307843308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d32bd8dc1c9419b90607e20dfa5d50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35b642a-82", "ovs_interfaceid": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Converting VIF {"id": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "address": "fa:16:3e:3f:5e:be", "network": {"id": "20103956-1e64-4c7a-bed2-24edd5ae7724", "bridge": "br-int", "label": "tempest-TestShelveInstance-307843308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d32bd8dc1c9419b90607e20dfa5d50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35b642a-82", "ovs_interfaceid": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:5e:be,bridge_name='br-int',has_traffic_filtering=True,id=f35b642a-825f-4e17-9b97-3c8eba32a08e,network=Network(20103956-1e64-4c7a-bed2-24edd5ae7724),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf35b642a-82') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG nova.objects.instance [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lazy-loading 'pci_devices' on Instance uuid 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[82802dfd-6852-418c-a8f8-b72994be2daa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:28:55 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG nova.objects.base [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Object Instance<9cf1a0c3-4719-4637-a88d-e5864b2f1c3c> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:28:55 user nova-compute[74821]:   <uuid>9cf1a0c3-4719-4637-a88d-e5864b2f1c3c</uuid>
Nov 06 13:28:55 user nova-compute[74821]:   <name>instance-0000001b</name>
Nov 06 13:28:55 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:28:55 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:28:55 user nova-compute[74821]:   <metadata>
Nov 06 13:28:55 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:28:55 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:28:55 user nova-compute[74821]:       <nova:name>tempest-TestShelveInstance-server-2121328163</nova:name>
Nov 06 13:28:55 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:28:53</nova:creationTime>
Nov 06 13:28:55 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:28:55 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:28:55 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:28:55 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:28:55 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:28:55 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:28:55 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:28:55 user nova-compute[74821]:       <nova:owner>
Nov 06 13:28:55 user nova-compute[74821]:         <nova:user uuid="59d98c278c9349f3a010b526679a67b3">tempest-TestShelveInstance-570916377-project-member</nova:user>
Nov 06 13:28:55 user nova-compute[74821]:         <nova:project uuid="6d32bd8dc1c9419b90607e20dfa5d50b">tempest-TestShelveInstance-570916377</nova:project>
Nov 06 13:28:55 user nova-compute[74821]:       </nova:owner>
Nov 06 13:28:55 user nova-compute[74821]:       <nova:ports>
Nov 06 13:28:55 user nova-compute[74821]:         <nova:port uuid="f35b642a-825f-4e17-9b97-3c8eba32a08e">
Nov 06 13:28:55 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 06 13:28:55 user nova-compute[74821]:         </nova:port>
Nov 06 13:28:55 user nova-compute[74821]:       </nova:ports>
Nov 06 13:28:55 user nova-compute[74821]:     </nova:instance>
Nov 06 13:28:55 user nova-compute[74821]:   </metadata>
Nov 06 13:28:55 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:28:55 user nova-compute[74821]:     <system>
Nov 06 13:28:55 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:28:55 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:28:55 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:28:55 user nova-compute[74821]:       <entry name="serial">9cf1a0c3-4719-4637-a88d-e5864b2f1c3c</entry>
Nov 06 13:28:55 user nova-compute[74821]:       <entry name="uuid">9cf1a0c3-4719-4637-a88d-e5864b2f1c3c</entry>
Nov 06 13:28:55 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:28:55 user nova-compute[74821]:     </system>
Nov 06 13:28:55 user nova-compute[74821]:   </sysinfo>
Nov 06 13:28:55 user nova-compute[74821]:   <os>
Nov 06 13:28:55 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:28:55 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:28:55 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:28:55 user nova-compute[74821]:   </os>
Nov 06 13:28:55 user nova-compute[74821]:   <features>
Nov 06 13:28:55 user nova-compute[74821]:     <acpi/>
Nov 06 13:28:55 user nova-compute[74821]:     <apic/>
Nov 06 13:28:55 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:28:55 user nova-compute[74821]:   </features>
Nov 06 13:28:55 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:28:55 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:28:55 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:28:55 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:28:55 user nova-compute[74821]:   </clock>
Nov 06 13:28:55 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:28:55 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:28:55 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:28:55 user nova-compute[74821]:   </cpu>
Nov 06 13:28:55 user nova-compute[74821]:   <devices>
Nov 06 13:28:55 user nova-compute[74821]:     <disk type="block" device="disk">
Nov 06 13:28:55 user nova-compute[74821]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:28:55 user nova-compute[74821]:       <source dev="/dev/sdf"/>
Nov 06 13:28:55 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:28:55 user nova-compute[74821]:       <serial>be4ce8c2-20da-4129-903f-4487642101af</serial>
Nov 06 13:28:55 user nova-compute[74821]:     </disk>
Nov 06 13:28:55 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:28:55 user nova-compute[74821]:       <mac address="fa:16:3e:3f:5e:be"/>
Nov 06 13:28:55 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:28:55 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:28:55 user nova-compute[74821]:       <target dev="tapf35b642a-82"/>
Nov 06 13:28:55 user nova-compute[74821]:     </interface>
Nov 06 13:28:55 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:28:55 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/9cf1a0c3-4719-4637-a88d-e5864b2f1c3c/console.log" append="off"/>
Nov 06 13:28:55 user nova-compute[74821]:     </serial>
Nov 06 13:28:55 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:28:55 user nova-compute[74821]:     <video>
Nov 06 13:28:55 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:28:55 user nova-compute[74821]:     </video>
Nov 06 13:28:55 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:28:55 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:28:55 user nova-compute[74821]:     </rng>
Nov 06 13:28:55 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:28:55 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:28:55 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:28:55 user nova-compute[74821]:     </memballoon>
Nov 06 13:28:55 user nova-compute[74821]:   </devices>
Nov 06 13:28:55 user nova-compute[74821]: </domain>
Nov 06 13:28:55 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T13:24:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2121328163',display_name='tempest-TestShelveInstance-server-2121328163',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2121328163',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1104151437',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:25:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6d32bd8dc1c9419b90607e20dfa5d50b',ramdisk_id='',reservation_id='r-14h61fxg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-570916377',owner_user_name='tempest-TestShelveInstance-570916377-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:28:01Z,user_data=None,user_id='59d98c278c9349f3a010b526679a67b3',uuid=9cf1a0c3-4719-4637-a88d-e5864b2f1c3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "address": "fa:16:3e:3f:5e:be", "network": {"id": "20103956-1e64-4c7a-bed2-24edd5ae7724", "bridge": "br-int", "label": "tempest-TestShelveInstance-307843308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d32bd8dc1c9419b90607e20dfa5d50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35b642a-82", "ovs_interfaceid": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Converting VIF {"id": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "address": "fa:16:3e:3f:5e:be", "network": {"id": "20103956-1e64-4c7a-bed2-24edd5ae7724", "bridge": "br-int", "label": "tempest-TestShelveInstance-307843308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d32bd8dc1c9419b90607e20dfa5d50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35b642a-82", "ovs_interfaceid": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:5e:be,bridge_name='br-int',has_traffic_filtering=True,id=f35b642a-825f-4e17-9b97-3c8eba32a08e,network=Network(20103956-1e64-4c7a-bed2-24edd5ae7724),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf35b642a-82') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG os_vif [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:5e:be,bridge_name='br-int',has_traffic_filtering=True,id=f35b642a-825f-4e17-9b97-3c8eba32a08e,network=Network(20103956-1e64-4c7a-bed2-24edd5ae7724),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf35b642a-82') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '711314a3-95ac-568c-a3ae-4e06a7ebd977', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3de7175-62f5-4a63-bd2c-db733d16c90f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815] added
Nov 06 13:28:55 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf35b642a-82, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf35b642a-82, col_values=(('qos', UUID('05e6b6da-d740-4cda-a2ee-f01e30471aef')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf35b642a-82, col_values=(('external_ids', {'iface-id': 'f35b642a-825f-4e17-9b97-3c8eba32a08e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:5e:be', 'vm-uuid': '9cf1a0c3-4719-4637-a88d-e5864b2f1c3c'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:55 user nova-compute[74821]: INFO os_vif [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:5e:be,bridge_name='br-int',has_traffic_filtering=True,id=f35b642a-825f-4e17-9b97-3c8eba32a08e,network=Network(20103956-1e64-4c7a-bed2-24edd5ae7724),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf35b642a-82')
Nov 06 13:28:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7b27e2-dd23-4df8-a5e1-7394e388f2b1]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f97308-c6e9-43d5-9bb7-7b6b36a9fc2c]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v piPIlZHh {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] No VIF found with MAC fa:16:3e:3f:5e:be, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v piPIlZHh" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1461434-b0f7-44d7-9128-5a6903b36536]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'piPIlZHh'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64f245e-d235-4956-87ca-8aee9236fd91]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fa92da-43aa-4122-8286-94b581bfece5]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf062a0-644d-4e2e-9c15-58c4642d0a51 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:28:55 user nova-compute[74821]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:28:55 user nova-compute[74821]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf062a0-644d-4e2e-9c15-58c4642d0a51 (non-flash)
Nov 06 13:28:55 user nova-compute[74821]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f (non-flash)
Nov 06 13:28:55 user nova-compute[74821]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:28:55 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:28:55 user nova-compute[74821]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:28:55 user nova-compute[74821]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf062a0-644d-4e2e-9c15-58c4642d0a51 (non-flash)
Nov 06 13:28:55 user nova-compute[74821]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f (non-flash)
Nov 06 13:28:55 user nova-compute[74821]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:28:55 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6106d3a1-d772-434c-a560-482b98e7c3dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815, portal: 172.16.0.220,3260]
Nov 06 13:28:55 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815, portal: 172.16.0.220,3260] successful.
Nov 06 13:28:55 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[af42db29-0707-40fe-8f4c-6cfefbc9c818]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ee4167-ecfd-4539-9996-248ddad94bb4]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf062a0-644d-4e2e-9c15-58c4642d0a51 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:28:55 user nova-compute[74821]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:28:55 user nova-compute[74821]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf062a0-644d-4e2e-9c15-58c4642d0a51 (non-flash)
Nov 06 13:28:55 user nova-compute[74821]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f (non-flash)
Nov 06 13:28:55 user nova-compute[74821]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:28:55 user nova-compute[74821]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 (non-flash)
Nov 06 13:28:55 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:28:55 user nova-compute[74821]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:28:55 user nova-compute[74821]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf062a0-644d-4e2e-9c15-58c4642d0a51 (non-flash)
Nov 06 13:28:55 user nova-compute[74821]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f (non-flash)
Nov 06 13:28:55 user nova-compute[74821]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:28:55 user nova-compute[74821]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 (non-flash)
Nov 06 13:28:55 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] HCTL ('38', '-', '-', 0) found on session 29 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6162327d-5011-40ad-957d-06fb84015ede]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Searching for a device in session 29 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:28:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'piPIlZHh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:28:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Acquiring lock "4bc6444e-b55d-4d81-88d1-f4d147255119" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:28:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "4bc6444e-b55d-4d81-88d1-f4d147255119" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:28:56 user nova-compute[74821]: INFO nova.compute.manager [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Detaching volume 2f555835-8d89-4d1a-a9af-47acaecbf02f
Nov 06 13:28:56 user nova-compute[74821]: INFO nova.virt.block_device [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Attempting to driver detach volume 2f555835-8d89-4d1a-a9af-47acaecbf02f from mountpoint /dev/vdb
Nov 06 13:28:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Attempting to detach device vdb from instance 4bc6444e-b55d-4d81-88d1-f4d147255119 from the persistent domain config. {{(pid=74821) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 13:28:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:28:56 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:28:56 user nova-compute[74821]:   <source dev="/dev/sde"/>
Nov 06 13:28:56 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:28:56 user nova-compute[74821]:   <serial>2f555835-8d89-4d1a-a9af-47acaecbf02f</serial>
Nov 06 13:28:56 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:28:56 user nova-compute[74821]: </disk>
Nov 06 13:28:56 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:28:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:28:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '23434343465623833', 'path': '/dev/sdg'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:28:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434343465623833', 'path': '/dev/sdg'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:28:56 user nova-compute[74821]: DEBUG nova.objects.instance [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lazy-loading 'flavor' on Instance uuid 89b04a09-41d8-461f-8d14-bb3b9c72ed76 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:28:56 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Successfully detached device vdb from instance 4bc6444e-b55d-4d81-88d1-f4d147255119 from the persistent domain config.
Nov 06 13:28:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4bc6444e-b55d-4d81-88d1-f4d147255119 from the live domain config. {{(pid=74821) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 13:28:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:28:56 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:28:56 user nova-compute[74821]:   <source dev="/dev/sde"/>
Nov 06 13:28:56 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:28:56 user nova-compute[74821]:   <serial>2f555835-8d89-4d1a-a9af-47acaecbf02f</serial>
Nov 06 13:28:56 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:28:56 user nova-compute[74821]: </disk>
Nov 06 13:28:56 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:28:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 13:28:56 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:28:56 user nova-compute[74821]:   <source dev="/dev/sdg"/>
Nov 06 13:28:56 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:28:56 user nova-compute[74821]:   <serial>52357f8d-a952-448e-9c2a-8714beae1815</serial>
Nov 06 13:28:56 user nova-compute[74821]: </disk>
Nov 06 13:28:56 user nova-compute[74821]:  {{(pid=74821) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 13:28:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:56 user nova-compute[74821]: DEBUG nova.compute.manager [req-f3e52c78-9f47-4eda-96cc-7875cca6b5b1 req-1f7528c1-7038-4e35-b29a-006b11992574 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Received event network-vif-plugged-f35b642a-825f-4e17-9b97-3c8eba32a08e {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:28:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f3e52c78-9f47-4eda-96cc-7875cca6b5b1 req-1f7528c1-7038-4e35-b29a-006b11992574 service nova] Acquiring lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:28:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f3e52c78-9f47-4eda-96cc-7875cca6b5b1 req-1f7528c1-7038-4e35-b29a-006b11992574 service nova] Lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:28:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f3e52c78-9f47-4eda-96cc-7875cca6b5b1 req-1f7528c1-7038-4e35-b29a-006b11992574 service nova] Lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:28:56 user nova-compute[74821]: DEBUG nova.compute.manager [req-f3e52c78-9f47-4eda-96cc-7875cca6b5b1 req-1f7528c1-7038-4e35-b29a-006b11992574 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] No waiting events found dispatching network-vif-plugged-f35b642a-825f-4e17-9b97-3c8eba32a08e {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:28:56 user nova-compute[74821]: WARNING nova.compute.manager [req-f3e52c78-9f47-4eda-96cc-7875cca6b5b1 req-1f7528c1-7038-4e35-b29a-006b11992574 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Received unexpected event network-vif-plugged-f35b642a-825f-4e17-9b97-3c8eba32a08e for instance with vm_state shelved_offloaded and task_state spawning.
Nov 06 13:28:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4bc6444e-b55d-4d81-88d1-f4d147255119 {{(pid=74821) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 13:28:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:28:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:28:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:28:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] No VIF found with MAC fa:16:3e:af:cb:31, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:28:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ef526c0e-3570-4356-a6c3-c50e3604349b tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "89b04a09-41d8-461f-8d14-bb3b9c72ed76" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.765s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:28:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-cf3a6ea0-bb6b-4634-a63e-c2551d6a2a85 req-258b4eb2-07bc-4ba6-b500-9b54fea22f0b service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Received event network-vif-plugged-f35b642a-825f-4e17-9b97-3c8eba32a08e {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:28:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-cf3a6ea0-bb6b-4634-a63e-c2551d6a2a85 req-258b4eb2-07bc-4ba6-b500-9b54fea22f0b service nova] Acquiring lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:28:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-cf3a6ea0-bb6b-4634-a63e-c2551d6a2a85 req-258b4eb2-07bc-4ba6-b500-9b54fea22f0b service nova] Lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:28:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-cf3a6ea0-bb6b-4634-a63e-c2551d6a2a85 req-258b4eb2-07bc-4ba6-b500-9b54fea22f0b service nova] Lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:28:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-cf3a6ea0-bb6b-4634-a63e-c2551d6a2a85 req-258b4eb2-07bc-4ba6-b500-9b54fea22f0b service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] No waiting events found dispatching network-vif-plugged-f35b642a-825f-4e17-9b97-3c8eba32a08e {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:28:59 user nova-compute[74821]: WARNING nova.compute.manager [req-cf3a6ea0-bb6b-4634-a63e-c2551d6a2a85 req-258b4eb2-07bc-4ba6-b500-9b54fea22f0b service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Received unexpected event network-vif-plugged-f35b642a-825f-4e17-9b97-3c8eba32a08e for instance with vm_state shelved_offloaded and task_state spawning.
Nov 06 13:28:59 user nova-compute[74821]: DEBUG nova.compute.manager [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:28:59 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:28:59 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Instance spawned successfully.
Nov 06 13:28:59 user nova-compute[74821]: DEBUG nova.compute.manager [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:28:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8247e847-ebcd-414f-869a-ac10f6a0c4e3 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 58.736s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:28:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:00 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:11 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-514c78a9-0466-4601-ad2c-d5443bf22298 tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Acquiring lock "b8d249b8-752d-434a-be2c-b8c2b5233503" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:29:11 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-514c78a9-0466-4601-ad2c-d5443bf22298 tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Lock "b8d249b8-752d-434a-be2c-b8c2b5233503" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:29:11 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-514c78a9-0466-4601-ad2c-d5443bf22298 tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Acquiring lock "b8d249b8-752d-434a-be2c-b8c2b5233503-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:29:11 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-514c78a9-0466-4601-ad2c-d5443bf22298 tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Lock "b8d249b8-752d-434a-be2c-b8c2b5233503-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:29:11 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-514c78a9-0466-4601-ad2c-d5443bf22298 tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Lock "b8d249b8-752d-434a-be2c-b8c2b5233503-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:29:11 user nova-compute[74821]: INFO nova.compute.manager [None req-514c78a9-0466-4601-ad2c-d5443bf22298 tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Terminating instance
Nov 06 13:29:11 user nova-compute[74821]: DEBUG nova.compute.manager [None req-514c78a9-0466-4601-ad2c-d5443bf22298 tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:29:11 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:11 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:11 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:11 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:11 user nova-compute[74821]: DEBUG nova.compute.manager [req-27038382-262c-4543-b69a-a2151523fae2 req-7d2a2cb3-2d1a-461c-9596-cdd309728329 service nova] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Received event network-vif-unplugged-f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:29:11 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-27038382-262c-4543-b69a-a2151523fae2 req-7d2a2cb3-2d1a-461c-9596-cdd309728329 service nova] Acquiring lock "b8d249b8-752d-434a-be2c-b8c2b5233503-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:29:11 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-27038382-262c-4543-b69a-a2151523fae2 req-7d2a2cb3-2d1a-461c-9596-cdd309728329 service nova] Lock "b8d249b8-752d-434a-be2c-b8c2b5233503-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:29:11 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-27038382-262c-4543-b69a-a2151523fae2 req-7d2a2cb3-2d1a-461c-9596-cdd309728329 service nova] Lock "b8d249b8-752d-434a-be2c-b8c2b5233503-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:29:11 user nova-compute[74821]: DEBUG nova.compute.manager [req-27038382-262c-4543-b69a-a2151523fae2 req-7d2a2cb3-2d1a-461c-9596-cdd309728329 service nova] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] No waiting events found dispatching network-vif-unplugged-f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:29:11 user nova-compute[74821]: DEBUG nova.compute.manager [req-27038382-262c-4543-b69a-a2151523fae2 req-7d2a2cb3-2d1a-461c-9596-cdd309728329 service nova] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Received event network-vif-unplugged-f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:29:12 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Instance destroyed successfully.
Nov 06 13:29:12 user nova-compute[74821]: DEBUG nova.objects.instance [None req-514c78a9-0466-4601-ad2c-d5443bf22298 tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Lazy-loading 'resources' on Instance uuid b8d249b8-752d-434a-be2c-b8c2b5233503 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:29:12 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-514c78a9-0466-4601-ad2c-d5443bf22298 tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:27:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-847530245',display_name='tempest-VolumesNegativeTest-instance-847530245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-847530245',id=33,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:27:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='613db6de324d47929d4f270bc503368b',ramdisk_id='',reservation_id='r-cr5x4e94',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1935745041',owner_user_name='tempest-VolumesNegativeTest-1935745041-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:27:27Z,user_data=None,user_id='a85a40deac9e46bbbf9d54f2565c57eb',uuid=b8d249b8-752d-434a-be2c-b8c2b5233503,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6", "address": "fa:16:3e:0f:da:57", "network": {"id": "0aea8982-fb58-4067-ad58-99deecae4887", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "46171fd82e804115aa775e4d69ffe44c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf316d8ce-9f", "ovs_interfaceid": "f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:29:12 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-514c78a9-0466-4601-ad2c-d5443bf22298 tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Converting VIF {"id": "f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6", "address": "fa:16:3e:0f:da:57", "network": {"id": "0aea8982-fb58-4067-ad58-99deecae4887", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "46171fd82e804115aa775e4d69ffe44c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf316d8ce-9f", "ovs_interfaceid": "f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:29:12 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-514c78a9-0466-4601-ad2c-d5443bf22298 tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:da:57,bridge_name='br-int',has_traffic_filtering=True,id=f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6,network=Network(0aea8982-fb58-4067-ad58-99deecae4887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf316d8ce-9f') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:29:12 user nova-compute[74821]: DEBUG os_vif [None req-514c78a9-0466-4601-ad2c-d5443bf22298 tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:da:57,bridge_name='br-int',has_traffic_filtering=True,id=f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6,network=Network(0aea8982-fb58-4067-ad58-99deecae4887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf316d8ce-9f') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:29:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf316d8ce-9f, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:29:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6042926a-059e-4b32-852b-7da35e956584) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:29:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:29:12 user nova-compute[74821]: INFO os_vif [None req-514c78a9-0466-4601-ad2c-d5443bf22298 tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:da:57,bridge_name='br-int',has_traffic_filtering=True,id=f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6,network=Network(0aea8982-fb58-4067-ad58-99deecae4887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf316d8ce-9f')
Nov 06 13:29:12 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-514c78a9-0466-4601-ad2c-d5443bf22298 tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Deleting instance files /opt/stack/data/nova/instances/b8d249b8-752d-434a-be2c-b8c2b5233503_del
Nov 06 13:29:12 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-514c78a9-0466-4601-ad2c-d5443bf22298 tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Deletion of /opt/stack/data/nova/instances/b8d249b8-752d-434a-be2c-b8c2b5233503_del complete
Nov 06 13:29:12 user nova-compute[74821]: INFO nova.compute.manager [None req-514c78a9-0466-4601-ad2c-d5443bf22298 tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 06 13:29:12 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-514c78a9-0466-4601-ad2c-d5443bf22298 tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:29:12 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:29:12 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:29:12 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:29:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-07b1bea2-7e33-4e8a-befd-ede72d4d4a17 req-a993755f-14e4-48b5-b150-09d89ceb08b6 service nova] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Received event network-vif-deleted-f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:29:12 user nova-compute[74821]: INFO nova.compute.manager [req-07b1bea2-7e33-4e8a-befd-ede72d4d4a17 req-a993755f-14e4-48b5-b150-09d89ceb08b6 service nova] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Neutron deleted interface f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6; detaching it from the instance and deleting it from the info cache
Nov 06 13:29:12 user nova-compute[74821]: DEBUG nova.network.neutron [req-07b1bea2-7e33-4e8a-befd-ede72d4d4a17 req-a993755f-14e4-48b5-b150-09d89ceb08b6 service nova] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:29:12 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Took 0.55 seconds to deallocate network for instance.
Nov 06 13:29:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-07b1bea2-7e33-4e8a-befd-ede72d4d4a17 req-a993755f-14e4-48b5-b150-09d89ceb08b6 service nova] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Detach interface failed, port_id=f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6, reason: Instance b8d249b8-752d-434a-be2c-b8c2b5233503 could not be found. {{(pid=74821) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 13:29:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-514c78a9-0466-4601-ad2c-d5443bf22298 tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:29:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-514c78a9-0466-4601-ad2c-d5443bf22298 tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:29:13 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-514c78a9-0466-4601-ad2c-d5443bf22298 tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:29:13 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-514c78a9-0466-4601-ad2c-d5443bf22298 tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:29:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-514c78a9-0466-4601-ad2c-d5443bf22298 tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.470s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:29:13 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-514c78a9-0466-4601-ad2c-d5443bf22298 tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Deleted allocations for instance b8d249b8-752d-434a-be2c-b8c2b5233503
Nov 06 13:29:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-514c78a9-0466-4601-ad2c-d5443bf22298 tempest-VolumesNegativeTest-1935745041 tempest-VolumesNegativeTest-1935745041-project-member] Lock "b8d249b8-752d-434a-be2c-b8c2b5233503" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.181s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:29:13 user nova-compute[74821]: DEBUG nova.compute.manager [req-6b612aed-b341-49e4-b181-1964269997d3 req-5269cfe0-2d9f-4874-9f2a-01e0202b6a55 service nova] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Received event network-vif-plugged-f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:29:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6b612aed-b341-49e4-b181-1964269997d3 req-5269cfe0-2d9f-4874-9f2a-01e0202b6a55 service nova] Acquiring lock "b8d249b8-752d-434a-be2c-b8c2b5233503-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:29:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6b612aed-b341-49e4-b181-1964269997d3 req-5269cfe0-2d9f-4874-9f2a-01e0202b6a55 service nova] Lock "b8d249b8-752d-434a-be2c-b8c2b5233503-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:29:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6b612aed-b341-49e4-b181-1964269997d3 req-5269cfe0-2d9f-4874-9f2a-01e0202b6a55 service nova] Lock "b8d249b8-752d-434a-be2c-b8c2b5233503-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:29:13 user nova-compute[74821]: DEBUG nova.compute.manager [req-6b612aed-b341-49e4-b181-1964269997d3 req-5269cfe0-2d9f-4874-9f2a-01e0202b6a55 service nova] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] No waiting events found dispatching network-vif-plugged-f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:29:13 user nova-compute[74821]: WARNING nova.compute.manager [req-6b612aed-b341-49e4-b181-1964269997d3 req-5269cfe0-2d9f-4874-9f2a-01e0202b6a55 service nova] [instance: b8d249b8-752d-434a-be2c-b8c2b5233503] Received unexpected event network-vif-plugged-f316d8ce-9f03-4cc7-aa86-8b6d2edbbbb6 for instance with vm_state deleted and task_state None.
Nov 06 13:29:14 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:17 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4bc6444e-b55d-4d81-88d1-f4d147255119 is timed out.
Nov 06 13:29:17 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Successfully detached device vdb from instance 4bc6444e-b55d-4d81-88d1-f4d147255119 from the live domain config.
Nov 06 13:29:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SPEycThI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:29:17 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:29:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e48ce7b-7f6b-4343-bc4a-fac199f6a27f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:29:17 user nova-compute[74821]: No targets found.
Nov 06 13:29:17 user nova-compute[74821]: iSNS:
Nov 06 13:29:17 user nova-compute[74821]: No targets found.
Nov 06 13:29:17 user nova-compute[74821]: STATIC:
Nov 06 13:29:17 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af
Nov 06 13:29:17 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:29:17 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:29:17 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604
Nov 06 13:29:17 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:29:17 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:29:17 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979
Nov 06 13:29:17 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:29:17 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:29:17 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815
Nov 06 13:29:17 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:29:17 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:29:17 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f
Nov 06 13:29:17 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:29:17 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:29:17 user nova-compute[74821]: FIRMWARE:
Nov 06 13:29:17 user nova-compute[74821]: No targets found.
Nov 06 13:29:17 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:29:17 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:29:17 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7c99ba-0943-4039-9982-051bccd84c64]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a982ade-4926-4623-8b09-9eaccd67987f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:29:17 user nova-compute[74821]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:29:17 user nova-compute[74821]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f (non-flash)
Nov 06 13:29:17 user nova-compute[74821]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:29:17 user nova-compute[74821]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 (non-flash)
Nov 06 13:29:17 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:29:17 user nova-compute[74821]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:29:17 user nova-compute[74821]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f (non-flash)
Nov 06 13:29:17 user nova-compute[74821]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:29:17 user nova-compute[74821]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 (non-flash)
Nov 06 13:29:17 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e40587f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f'): ({'sde'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Removing single pathed devices sde {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[883c97ef-1968-4e17-b200-95bf166965ca]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9c37be-d9ee-4840-8d49-b10cac9e87cd]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Flushing IO for device /dev/sde {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[98888df4-290e-4276-889f-4e1426242305]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[09789cf0-d27d-488a-8b14-e7e131752202]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] SCSI volumes sde have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded21acd-7909-44d9-90bf-0b71a1f88902]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2788368-f3c7-4718-ac95-720a0d333b5e]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f, portal: 172.16.0.220,3260]
Nov 06 13:29:17 user nova-compute[74821]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f, portal: 172.16.0.220,3260] successful.
Nov 06 13:29:17 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f555835-8d89-4d1a-a9af-47acaecbf02f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb1bce4-a718-4d60-a551-c0a5f3734a48]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] <== disconnect_volume: return (327ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:29:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:29:18 user nova-compute[74821]: DEBUG nova.objects.instance [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lazy-loading 'flavor' on Instance uuid 4bc6444e-b55d-4d81-88d1-f4d147255119 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:29:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-42ad65d0-81b5-495b-bdf7-0a3c92fc88f5 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "4bc6444e-b55d-4d81-88d1-f4d147255119" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.273s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:29:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "6121ff1a-d276-485f-85f8-ba451f5b0d37" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:29:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "6121ff1a-d276-485f-85f8-ba451f5b0d37" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:29:22 user nova-compute[74821]: DEBUG nova.compute.manager [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:29:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:29:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:29:22 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:29:22 user nova-compute[74821]: INFO nova.compute.claims [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Claim successful on node user
Nov 06 13:29:23 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:29:23 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:29:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:29:23 user nova-compute[74821]: DEBUG nova.compute.manager [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:29:23 user nova-compute[74821]: DEBUG nova.compute.manager [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:29:23 user nova-compute[74821]: DEBUG nova.network.neutron [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:29:23 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:29:23 user nova-compute[74821]: DEBUG nova.compute.manager [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:29:23 user nova-compute[74821]: DEBUG nova.policy [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5ffddfc972374f6aa7d81288d34690cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6d2ded0b1d4af09f1e05582bcbd3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:29:23 user nova-compute[74821]: DEBUG nova.compute.manager [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:29:23 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:29:23 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Creating image(s)
Nov 06 13:29:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "/opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:29:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "/opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:29:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "/opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:29:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.175s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:29:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:29:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.166s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37/disk 1073741824" returned: 0 in 0.045s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:29:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:23 user nova-compute[74821]: DEBUG nova.network.neutron [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Successfully created port: 1e1f285c-2014-4b04-a4c3-83ccc1d695fd {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:29:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.186s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:23 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:29:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:24 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Cannot resize image /opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:29:24 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:29:24 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Ensure instance console log exists: /opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:29:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:29:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:29:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:29:24 user nova-compute[74821]: DEBUG nova.network.neutron [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Successfully updated port: 1e1f285c-2014-4b04-a4c3-83ccc1d695fd {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:29:24 user nova-compute[74821]: DEBUG nova.compute.manager [req-d8b57350-c9d1-4680-938e-b93fc2b27f1c req-afd62a9c-e0be-42d2-bd72-7f14581c711c service nova] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Received event network-changed-1e1f285c-2014-4b04-a4c3-83ccc1d695fd {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:29:24 user nova-compute[74821]: DEBUG nova.compute.manager [req-d8b57350-c9d1-4680-938e-b93fc2b27f1c req-afd62a9c-e0be-42d2-bd72-7f14581c711c service nova] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Refreshing instance network info cache due to event network-changed-1e1f285c-2014-4b04-a4c3-83ccc1d695fd. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:29:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d8b57350-c9d1-4680-938e-b93fc2b27f1c req-afd62a9c-e0be-42d2-bd72-7f14581c711c service nova] Acquiring lock "refresh_cache-6121ff1a-d276-485f-85f8-ba451f5b0d37" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:29:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d8b57350-c9d1-4680-938e-b93fc2b27f1c req-afd62a9c-e0be-42d2-bd72-7f14581c711c service nova] Acquired lock "refresh_cache-6121ff1a-d276-485f-85f8-ba451f5b0d37" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:29:24 user nova-compute[74821]: DEBUG nova.network.neutron [req-d8b57350-c9d1-4680-938e-b93fc2b27f1c req-afd62a9c-e0be-42d2-bd72-7f14581c711c service nova] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Refreshing network info cache for port 1e1f285c-2014-4b04-a4c3-83ccc1d695fd {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:29:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "refresh_cache-6121ff1a-d276-485f-85f8-ba451f5b0d37" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:29:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:24 user nova-compute[74821]: DEBUG nova.network.neutron [req-d8b57350-c9d1-4680-938e-b93fc2b27f1c req-afd62a9c-e0be-42d2-bd72-7f14581c711c service nova] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:29:24 user nova-compute[74821]: DEBUG nova.network.neutron [req-d8b57350-c9d1-4680-938e-b93fc2b27f1c req-afd62a9c-e0be-42d2-bd72-7f14581c711c service nova] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:29:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d8b57350-c9d1-4680-938e-b93fc2b27f1c req-afd62a9c-e0be-42d2-bd72-7f14581c711c service nova] Releasing lock "refresh_cache-6121ff1a-d276-485f-85f8-ba451f5b0d37" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:29:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquired lock "refresh_cache-6121ff1a-d276-485f-85f8-ba451f5b0d37" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:29:24 user nova-compute[74821]: DEBUG nova.network.neutron [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:29:24 user nova-compute[74821]: DEBUG nova.network.neutron [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG nova.network.neutron [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Updating instance_info_cache with network_info: [{"id": "1e1f285c-2014-4b04-a4c3-83ccc1d695fd", "address": "fa:16:3e:9c:4f:f3", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e1f285c-20", "ovs_interfaceid": "1e1f285c-2014-4b04-a4c3-83ccc1d695fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Releasing lock "refresh_cache-6121ff1a-d276-485f-85f8-ba451f5b0d37" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG nova.compute.manager [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Instance network_info: |[{"id": "1e1f285c-2014-4b04-a4c3-83ccc1d695fd", "address": "fa:16:3e:9c:4f:f3", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e1f285c-20", "ovs_interfaceid": "1e1f285c-2014-4b04-a4c3-83ccc1d695fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Start _get_guest_xml network_info=[{"id": "1e1f285c-2014-4b04-a4c3-83ccc1d695fd", "address": "fa:16:3e:9c:4f:f3", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e1f285c-20", "ovs_interfaceid": "1e1f285c-2014-4b04-a4c3-83ccc1d695fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:29:25 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:29:25 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:29:25 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:29:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2087931296',display_name='tempest-AttachVolumeNegativeTest-server-2087931296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2087931296',id=36,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmsSR8TIyHUzEK03UhVYLH5ozOK0p2Bhy8aEAmRYbwaWJ1pAdh/bw2U0J6nBvLB/M32+u9uklEhQXh52xGgKD+vMOYmQxu+w0wzIVLazbWeIniQQBoEPHs8hoPMiZoBbA==',key_name='tempest-keypair-469241646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c6d2ded0b1d4af09f1e05582bcbd3ae',ramdisk_id='',reservation_id='r-3vnkd5x2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1164383705',owner_user_name='tempest-AttachVolumeNegativeTest-1164383705-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:29:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ffddfc972374f6aa7d81288d34690cf',uuid=6121ff1a-d276-485f-85f8-ba451f5b0d37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e1f285c-2014-4b04-a4c3-83ccc1d695fd", "address": "fa:16:3e:9c:4f:f3", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e1f285c-20", "ovs_interfaceid": "1e1f285c-2014-4b04-a4c3-83ccc1d695fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Converting VIF {"id": "1e1f285c-2014-4b04-a4c3-83ccc1d695fd", "address": "fa:16:3e:9c:4f:f3", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e1f285c-20", "ovs_interfaceid": "1e1f285c-2014-4b04-a4c3-83ccc1d695fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:4f:f3,bridge_name='br-int',has_traffic_filtering=True,id=1e1f285c-2014-4b04-a4c3-83ccc1d695fd,network=Network(3e1f6a20-5316-4c49-93a5-deabb70d8608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e1f285c-20') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG nova.objects.instance [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lazy-loading 'pci_devices' on Instance uuid 6121ff1a-d276-485f-85f8-ba451f5b0d37 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:29:25 user nova-compute[74821]:   <uuid>6121ff1a-d276-485f-85f8-ba451f5b0d37</uuid>
Nov 06 13:29:25 user nova-compute[74821]:   <name>instance-00000024</name>
Nov 06 13:29:25 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:29:25 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:29:25 user nova-compute[74821]:   <metadata>
Nov 06 13:29:25 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:29:25 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:29:25 user nova-compute[74821]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2087931296</nova:name>
Nov 06 13:29:25 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:29:25</nova:creationTime>
Nov 06 13:29:25 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:29:25 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:29:25 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:29:25 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:29:25 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:29:25 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:29:25 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:29:25 user nova-compute[74821]:       <nova:owner>
Nov 06 13:29:25 user nova-compute[74821]:         <nova:user uuid="5ffddfc972374f6aa7d81288d34690cf">tempest-AttachVolumeNegativeTest-1164383705-project-member</nova:user>
Nov 06 13:29:25 user nova-compute[74821]:         <nova:project uuid="4c6d2ded0b1d4af09f1e05582bcbd3ae">tempest-AttachVolumeNegativeTest-1164383705</nova:project>
Nov 06 13:29:25 user nova-compute[74821]:       </nova:owner>
Nov 06 13:29:25 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:29:25 user nova-compute[74821]:       <nova:ports>
Nov 06 13:29:25 user nova-compute[74821]:         <nova:port uuid="1e1f285c-2014-4b04-a4c3-83ccc1d695fd">
Nov 06 13:29:25 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 06 13:29:25 user nova-compute[74821]:         </nova:port>
Nov 06 13:29:25 user nova-compute[74821]:       </nova:ports>
Nov 06 13:29:25 user nova-compute[74821]:     </nova:instance>
Nov 06 13:29:25 user nova-compute[74821]:   </metadata>
Nov 06 13:29:25 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:29:25 user nova-compute[74821]:     <system>
Nov 06 13:29:25 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:29:25 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:29:25 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:29:25 user nova-compute[74821]:       <entry name="serial">6121ff1a-d276-485f-85f8-ba451f5b0d37</entry>
Nov 06 13:29:25 user nova-compute[74821]:       <entry name="uuid">6121ff1a-d276-485f-85f8-ba451f5b0d37</entry>
Nov 06 13:29:25 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:29:25 user nova-compute[74821]:     </system>
Nov 06 13:29:25 user nova-compute[74821]:   </sysinfo>
Nov 06 13:29:25 user nova-compute[74821]:   <os>
Nov 06 13:29:25 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:29:25 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:29:25 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:29:25 user nova-compute[74821]:   </os>
Nov 06 13:29:25 user nova-compute[74821]:   <features>
Nov 06 13:29:25 user nova-compute[74821]:     <acpi/>
Nov 06 13:29:25 user nova-compute[74821]:     <apic/>
Nov 06 13:29:25 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:29:25 user nova-compute[74821]:   </features>
Nov 06 13:29:25 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:29:25 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:29:25 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:29:25 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:29:25 user nova-compute[74821]:   </clock>
Nov 06 13:29:25 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:29:25 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:29:25 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:29:25 user nova-compute[74821]:   </cpu>
Nov 06 13:29:25 user nova-compute[74821]:   <devices>
Nov 06 13:29:25 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:29:25 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:29:25 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37/disk"/>
Nov 06 13:29:25 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:29:25 user nova-compute[74821]:     </disk>
Nov 06 13:29:25 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:29:25 user nova-compute[74821]:       <mac address="fa:16:3e:9c:4f:f3"/>
Nov 06 13:29:25 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:29:25 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:29:25 user nova-compute[74821]:       <target dev="tap1e1f285c-20"/>
Nov 06 13:29:25 user nova-compute[74821]:     </interface>
Nov 06 13:29:25 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:29:25 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37/console.log" append="off"/>
Nov 06 13:29:25 user nova-compute[74821]:     </serial>
Nov 06 13:29:25 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:29:25 user nova-compute[74821]:     <video>
Nov 06 13:29:25 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:29:25 user nova-compute[74821]:     </video>
Nov 06 13:29:25 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:29:25 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:29:25 user nova-compute[74821]:     </rng>
Nov 06 13:29:25 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:29:25 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:29:25 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:29:25 user nova-compute[74821]:     </memballoon>
Nov 06 13:29:25 user nova-compute[74821]:   </devices>
Nov 06 13:29:25 user nova-compute[74821]: </domain>
Nov 06 13:29:25 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:29:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2087931296',display_name='tempest-AttachVolumeNegativeTest-server-2087931296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2087931296',id=36,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmsSR8TIyHUzEK03UhVYLH5ozOK0p2Bhy8aEAmRYbwaWJ1pAdh/bw2U0J6nBvLB/M32+u9uklEhQXh52xGgKD+vMOYmQxu+w0wzIVLazbWeIniQQBoEPHs8hoPMiZoBbA==',key_name='tempest-keypair-469241646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c6d2ded0b1d4af09f1e05582bcbd3ae',ramdisk_id='',reservation_id='r-3vnkd5x2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1164383705',owner_user_name='tempest-AttachVolumeNegativeTest-1164383705-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:29:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ffddfc972374f6aa7d81288d34690cf',uuid=6121ff1a-d276-485f-85f8-ba451f5b0d37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e1f285c-2014-4b04-a4c3-83ccc1d695fd", "address": "fa:16:3e:9c:4f:f3", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e1f285c-20", "ovs_interfaceid": "1e1f285c-2014-4b04-a4c3-83ccc1d695fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Converting VIF {"id": "1e1f285c-2014-4b04-a4c3-83ccc1d695fd", "address": "fa:16:3e:9c:4f:f3", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e1f285c-20", "ovs_interfaceid": "1e1f285c-2014-4b04-a4c3-83ccc1d695fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:4f:f3,bridge_name='br-int',has_traffic_filtering=True,id=1e1f285c-2014-4b04-a4c3-83ccc1d695fd,network=Network(3e1f6a20-5316-4c49-93a5-deabb70d8608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e1f285c-20') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG os_vif [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:4f:f3,bridge_name='br-int',has_traffic_filtering=True,id=1e1f285c-2014-4b04-a4c3-83ccc1d695fd,network=Network(3e1f6a20-5316-4c49-93a5-deabb70d8608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e1f285c-20') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '525df269-152a-5476-87bd-7f9e5f6dd23e', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e1f285c-20, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1e1f285c-20, col_values=(('qos', UUID('067900f3-d238-4592-bade-72c67ebc7073')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1e1f285c-20, col_values=(('external_ids', {'iface-id': '1e1f285c-2014-4b04-a4c3-83ccc1d695fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:4f:f3', 'vm-uuid': '6121ff1a-d276-485f-85f8-ba451f5b0d37'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:25 user nova-compute[74821]: INFO os_vif [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:4f:f3,bridge_name='br-int',has_traffic_filtering=True,id=1e1f285c-2014-4b04-a4c3-83ccc1d695fd,network=Network(3e1f6a20-5316-4c49-93a5-deabb70d8608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e1f285c-20')
Nov 06 13:29:25 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:29:25 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] No VIF found with MAC fa:16:3e:9c:4f:f3, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:29:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:26 user nova-compute[74821]: DEBUG nova.compute.manager [req-2076b9e0-b559-4e28-8af7-731e891a3ba7 req-f48bddbb-ef04-47b9-9425-749a1e881ead service nova] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Received event network-vif-plugged-1e1f285c-2014-4b04-a4c3-83ccc1d695fd {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:29:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2076b9e0-b559-4e28-8af7-731e891a3ba7 req-f48bddbb-ef04-47b9-9425-749a1e881ead service nova] Acquiring lock "6121ff1a-d276-485f-85f8-ba451f5b0d37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:29:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2076b9e0-b559-4e28-8af7-731e891a3ba7 req-f48bddbb-ef04-47b9-9425-749a1e881ead service nova] Lock "6121ff1a-d276-485f-85f8-ba451f5b0d37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:29:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2076b9e0-b559-4e28-8af7-731e891a3ba7 req-f48bddbb-ef04-47b9-9425-749a1e881ead service nova] Lock "6121ff1a-d276-485f-85f8-ba451f5b0d37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:29:26 user nova-compute[74821]: DEBUG nova.compute.manager [req-2076b9e0-b559-4e28-8af7-731e891a3ba7 req-f48bddbb-ef04-47b9-9425-749a1e881ead service nova] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] No waiting events found dispatching network-vif-plugged-1e1f285c-2014-4b04-a4c3-83ccc1d695fd {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:29:26 user nova-compute[74821]: WARNING nova.compute.manager [req-2076b9e0-b559-4e28-8af7-731e891a3ba7 req-f48bddbb-ef04-47b9-9425-749a1e881ead service nova] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Received unexpected event network-vif-plugged-1e1f285c-2014-4b04-a4c3-83ccc1d695fd for instance with vm_state building and task_state spawning.
Nov 06 13:29:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:29 user nova-compute[74821]: DEBUG nova.compute.manager [req-83a1fb61-1dff-498c-8d0b-9724706682ae req-90b35a03-b43b-4558-8480-41c79ea3ea29 service nova] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Received event network-vif-plugged-1e1f285c-2014-4b04-a4c3-83ccc1d695fd {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:29:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-83a1fb61-1dff-498c-8d0b-9724706682ae req-90b35a03-b43b-4558-8480-41c79ea3ea29 service nova] Acquiring lock "6121ff1a-d276-485f-85f8-ba451f5b0d37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:29:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-83a1fb61-1dff-498c-8d0b-9724706682ae req-90b35a03-b43b-4558-8480-41c79ea3ea29 service nova] Lock "6121ff1a-d276-485f-85f8-ba451f5b0d37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:29:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-83a1fb61-1dff-498c-8d0b-9724706682ae req-90b35a03-b43b-4558-8480-41c79ea3ea29 service nova] Lock "6121ff1a-d276-485f-85f8-ba451f5b0d37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:29:29 user nova-compute[74821]: DEBUG nova.compute.manager [req-83a1fb61-1dff-498c-8d0b-9724706682ae req-90b35a03-b43b-4558-8480-41c79ea3ea29 service nova] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] No waiting events found dispatching network-vif-plugged-1e1f285c-2014-4b04-a4c3-83ccc1d695fd {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:29:29 user nova-compute[74821]: WARNING nova.compute.manager [req-83a1fb61-1dff-498c-8d0b-9724706682ae req-90b35a03-b43b-4558-8480-41c79ea3ea29 service nova] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Received unexpected event network-vif-plugged-1e1f285c-2014-4b04-a4c3-83ccc1d695fd for instance with vm_state building and task_state spawning.
Nov 06 13:29:29 user nova-compute[74821]: DEBUG nova.compute.manager [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:29:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:29:29 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Instance spawned successfully.
Nov 06 13:29:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:29:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:29:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:29:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:29:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:29:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:29:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:29:29 user nova-compute[74821]: INFO nova.compute.manager [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Took 5.86 seconds to spawn the instance on the hypervisor.
Nov 06 13:29:29 user nova-compute[74821]: DEBUG nova.compute.manager [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:29:29 user nova-compute[74821]: INFO nova.compute.manager [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Took 6.71 seconds to build instance.
Nov 06 13:29:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b697dbd2-30be-4191-84c1-06be85a4ed2f tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "6121ff1a-d276-485f-85f8-ba451f5b0d37" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.843s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:29:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:30 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:29:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:35 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:29:38 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:29:38 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:29:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-49c65aca-8392-46ba-8fa3-b47ff2416cb9" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:29:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-49c65aca-8392-46ba-8fa3-b47ff2416cb9" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:29:39 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:29:39 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Updating instance_info_cache with network_info: [{"id": "2000e5c8-e30c-44d9-b79c-fac8a9039c49", "address": "fa:16:3e:06:9f:52", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2000e5c8-e3", "ovs_interfaceid": "2000e5c8-e30c-44d9-b79c-fac8a9039c49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:29:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-49c65aca-8392-46ba-8fa3-b47ff2416cb9" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:29:39 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:29:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:29:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:29:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:29:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:29:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:40 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:29:41 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:29:41 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:29:41 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:29:41 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:29:44 user nova-compute[74821]: DEBUG nova.compute.manager [req-027b548e-55c0-4214-8e1c-4ff28d8f0fff req-708b7fc4-781a-4488-bc1a-b4af2a292dd9 service nova] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Received event network-changed-364b4308-8730-4b11-90a1-48ea6ab3de60 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:29:44 user nova-compute[74821]: DEBUG nova.compute.manager [req-027b548e-55c0-4214-8e1c-4ff28d8f0fff req-708b7fc4-781a-4488-bc1a-b4af2a292dd9 service nova] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Refreshing instance network info cache due to event network-changed-364b4308-8730-4b11-90a1-48ea6ab3de60. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:29:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-027b548e-55c0-4214-8e1c-4ff28d8f0fff req-708b7fc4-781a-4488-bc1a-b4af2a292dd9 service nova] Acquiring lock "refresh_cache-2de346cb-9858-47b8-a86c-4fde720d6127" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:29:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-027b548e-55c0-4214-8e1c-4ff28d8f0fff req-708b7fc4-781a-4488-bc1a-b4af2a292dd9 service nova] Acquired lock "refresh_cache-2de346cb-9858-47b8-a86c-4fde720d6127" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:29:44 user nova-compute[74821]: DEBUG nova.network.neutron [req-027b548e-55c0-4214-8e1c-4ff28d8f0fff req-708b7fc4-781a-4488-bc1a-b4af2a292dd9 service nova] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Refreshing network info cache for port 364b4308-8730-4b11-90a1-48ea6ab3de60 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:29:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:45 user nova-compute[74821]: DEBUG nova.network.neutron [req-027b548e-55c0-4214-8e1c-4ff28d8f0fff req-708b7fc4-781a-4488-bc1a-b4af2a292dd9 service nova] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Updated VIF entry in instance network info cache for port 364b4308-8730-4b11-90a1-48ea6ab3de60. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:29:45 user nova-compute[74821]: DEBUG nova.network.neutron [req-027b548e-55c0-4214-8e1c-4ff28d8f0fff req-708b7fc4-781a-4488-bc1a-b4af2a292dd9 service nova] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Updating instance_info_cache with network_info: [{"id": "364b4308-8730-4b11-90a1-48ea6ab3de60", "address": "fa:16:3e:48:8d:c6", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b4308-87", "ovs_interfaceid": "364b4308-8730-4b11-90a1-48ea6ab3de60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:29:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-027b548e-55c0-4214-8e1c-4ff28d8f0fff req-708b7fc4-781a-4488-bc1a-b4af2a292dd9 service nova] Releasing lock "refresh_cache-2de346cb-9858-47b8-a86c-4fde720d6127" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:29:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:45 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:29:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:29:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:29:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:29:45 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:29:46 user nova-compute[74821]: DEBUG nova.compute.manager [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Stashing vm_state: active {{(pid=74821) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 06 13:29:46 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:29:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b04a09-41d8-461f-8d14-bb3b9c72ed76/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:29:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:29:46 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:29:46 user nova-compute[74821]: INFO nova.compute.claims [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Claim successful on node user
Nov 06 13:29:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b04a09-41d8-461f-8d14-bb3b9c72ed76/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b04a09-41d8-461f-8d14-bb3b9c72ed76/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:46 user nova-compute[74821]: INFO nova.compute.resource_tracker [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Updating resource usage from migration adaac260-5214-4b8e-952e-65a22f39b3da
Nov 06 13:29:46 user nova-compute[74821]: DEBUG nova.compute.manager [req-bebab5a4-aecf-4ef8-afa1-a1fd07ce97f4 req-93cdfa97-771e-407b-9ad5-acd503e5fed0 service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Received event network-changed-267248e7-6714-47b4-b1b2-1d94251305da {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:29:46 user nova-compute[74821]: DEBUG nova.compute.manager [req-bebab5a4-aecf-4ef8-afa1-a1fd07ce97f4 req-93cdfa97-771e-407b-9ad5-acd503e5fed0 service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Refreshing instance network info cache due to event network-changed-267248e7-6714-47b4-b1b2-1d94251305da. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:29:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-bebab5a4-aecf-4ef8-afa1-a1fd07ce97f4 req-93cdfa97-771e-407b-9ad5-acd503e5fed0 service nova] Acquiring lock "refresh_cache-d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:29:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-bebab5a4-aecf-4ef8-afa1-a1fd07ce97f4 req-93cdfa97-771e-407b-9ad5-acd503e5fed0 service nova] Acquired lock "refresh_cache-d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:29:46 user nova-compute[74821]: DEBUG nova.network.neutron [req-bebab5a4-aecf-4ef8-afa1-a1fd07ce97f4 req-93cdfa97-771e-407b-9ad5-acd503e5fed0 service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Refreshing network info cache for port 267248e7-6714-47b4-b1b2-1d94251305da {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:29:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b04a09-41d8-461f-8d14-bb3b9c72ed76/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:46 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:29:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:46 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:29:46 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:29:47 user nova-compute[74821]: DEBUG nova.network.neutron [req-bebab5a4-aecf-4ef8-afa1-a1fd07ce97f4 req-93cdfa97-771e-407b-9ad5-acd503e5fed0 service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Updated VIF entry in instance network info cache for port 267248e7-6714-47b4-b1b2-1d94251305da. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:29:47 user nova-compute[74821]: DEBUG nova.network.neutron [req-bebab5a4-aecf-4ef8-afa1-a1fd07ce97f4 req-93cdfa97-771e-407b-9ad5-acd503e5fed0 service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Updating instance_info_cache with network_info: [{"id": "267248e7-6714-47b4-b1b2-1d94251305da", "address": "fa:16:3e:4e:3f:6c", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267248e7-67", "ovs_interfaceid": "267248e7-6714-47b4-b1b2-1d94251305da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:29:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-bebab5a4-aecf-4ef8-afa1-a1fd07ce97f4 req-93cdfa97-771e-407b-9ad5-acd503e5fed0 service nova] Releasing lock "refresh_cache-d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:29:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.694s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:29:47 user nova-compute[74821]: INFO nova.compute.manager [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Migrating
Nov 06 13:29:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:29:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:29:47 user nova-compute[74821]: INFO nova.compute.rpcapi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 06 13:29:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:29:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "refresh_cache-d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:29:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquired lock "refresh_cache-d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:29:47 user nova-compute[74821]: DEBUG nova.network.neutron [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:29:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:47 user nova-compute[74821]: DEBUG nova.network.neutron [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Updating instance_info_cache with network_info: [{"id": "267248e7-6714-47b4-b1b2-1d94251305da", "address": "fa:16:3e:4e:3f:6c", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267248e7-67", "ovs_interfaceid": "267248e7-6714-47b4-b1b2-1d94251305da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:29:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Releasing lock "refresh_cache-d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:29:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:29:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Starting migrate_disk_and_power_off {{(pid=74821) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG nova.compute.manager [req-b96f42a8-e1b2-4fe4-a360-41b293b98a09 req-1bb27f5a-759f-4b99-964f-2bcba4885243 service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Received event network-vif-unplugged-267248e7-6714-47b4-b1b2-1d94251305da {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b96f42a8-e1b2-4fe4-a360-41b293b98a09 req-1bb27f5a-759f-4b99-964f-2bcba4885243 service nova] Acquiring lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b96f42a8-e1b2-4fe4-a360-41b293b98a09 req-1bb27f5a-759f-4b99-964f-2bcba4885243 service nova] Lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b96f42a8-e1b2-4fe4-a360-41b293b98a09 req-1bb27f5a-759f-4b99-964f-2bcba4885243 service nova] Lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG nova.compute.manager [req-b96f42a8-e1b2-4fe4-a360-41b293b98a09 req-1bb27f5a-759f-4b99-964f-2bcba4885243 service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] No waiting events found dispatching network-vif-unplugged-267248e7-6714-47b4-b1b2-1d94251305da {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:29:48 user nova-compute[74821]: WARNING nova.compute.manager [req-b96f42a8-e1b2-4fe4-a360-41b293b98a09 req-1bb27f5a-759f-4b99-964f-2bcba4885243 service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Received unexpected event network-vif-unplugged-267248e7-6714-47b4-b1b2-1d94251305da for instance with vm_state active and task_state resize_migrating.
Nov 06 13:29:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:48 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Instance destroyed successfully.
Nov 06 13:29:48 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:27:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-337626543',display_name='tempest-ServerActionsTestOtherA-server-337626543',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-337626543',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4JiUWhVtBLaIMVWmdaDGfPw0zGPPsGUpSPMYouFUdE8U/JVhpnD9HPYPDsmw237Zq0kahTjlP/cerosJ2tVPbLsi+XC2cHQjqtX7zMb9rwN9mSYsloUtu1O3SiQuCuOw==',key_name='tempest-keypair-1142367632',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:28:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='77233758870b4fdfbb7ca76829f0f82e',ramdisk_id='',reservation_id='r-ddppkv09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1986828412',owner_user_name='tempest-ServerActionsTestOtherA-1986828412-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:29:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0620d1928d8d434fbe0bc1cdb31a2a89',uuid=d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "267248e7-6714-47b4-b1b2-1d94251305da", "address": "fa:16:3e:4e:3f:6c", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-161494849-network", "vif_mac": "fa:16:3e:4e:3f:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267248e7-67", "ovs_interfaceid": "267248e7-6714-47b4-b1b2-1d94251305da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Converting VIF {"id": "267248e7-6714-47b4-b1b2-1d94251305da", "address": "fa:16:3e:4e:3f:6c", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-161494849-network", "vif_mac": "fa:16:3e:4e:3f:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267248e7-67", "ovs_interfaceid": "267248e7-6714-47b4-b1b2-1d94251305da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:3f:6c,bridge_name='br-int',has_traffic_filtering=True,id=267248e7-6714-47b4-b1b2-1d94251305da,network=Network(a3838abe-b3bb-4878-9d5d-eb80a8cf60a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267248e7-67') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG os_vif [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:3f:6c,bridge_name='br-int',has_traffic_filtering=True,id=267248e7-6714-47b4-b1b2-1d94251305da,network=Network(a3838abe-b3bb-4878-9d5d-eb80a8cf60a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267248e7-67') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap267248e7-67, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aef554e2-ecfa-4e0b-8c1f-80b63e4f246f) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:29:48 user nova-compute[74821]: INFO os_vif [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:3f:6c,bridge_name='br-int',has_traffic_filtering=True,id=267248e7-6714-47b4-b1b2-1d94251305da,network=Network(a3838abe-b3bb-4878-9d5d-eb80a8cf60a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267248e7-67')
Nov 06 13:29:48 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrHLNeiI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:29:48 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:29:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff42e253-1a07-4013-9a75-aa8e6d6f9d0e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:29:48 user nova-compute[74821]: No targets found.
Nov 06 13:29:48 user nova-compute[74821]: iSNS:
Nov 06 13:29:48 user nova-compute[74821]: No targets found.
Nov 06 13:29:48 user nova-compute[74821]: STATIC:
Nov 06 13:29:48 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af
Nov 06 13:29:48 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:29:48 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:29:48 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604
Nov 06 13:29:48 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:29:48 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:29:48 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979
Nov 06 13:29:48 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:29:48 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:29:48 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815
Nov 06 13:29:48 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:29:48 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:29:48 user nova-compute[74821]: FIRMWARE:
Nov 06 13:29:48 user nova-compute[74821]: No targets found.
Nov 06 13:29:48 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:29:48 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:29:48 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[993b18d3-af54-45e5-8717-ec9087c69224]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e78dc8-46fb-48f0-bbad-617e3059b829]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:29:48 user nova-compute[74821]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:29:48 user nova-compute[74821]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:29:48 user nova-compute[74821]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 (non-flash)
Nov 06 13:29:48 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:29:48 user nova-compute[74821]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:29:48 user nova-compute[74821]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:29:48 user nova-compute[74821]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 (non-flash)
Nov 06 13:29:48 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e4021d900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604'): ({'sdb'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Removing single pathed devices sdb {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:29:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7476eadd-6d81-4102-ad99-ebdc4c066ccf]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de4a608-cd3e-4b00-b475-d5e707c97cdc]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Flushing IO for device /dev/sdb {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.029s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6d3785-615a-4f1c-963a-086a71e1a9f7]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c796aa5c-c07e-4202-819b-0b9245edb9f6]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] SCSI volumes sdb have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[53dce78f-1c9c-4ff9-a051-6563abe2cf3f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1301816-60ef-458d-8d6e-aa68b82bf610]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604, portal: 172.16.0.220,3260]
Nov 06 13:29:49 user nova-compute[74821]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604, portal: 172.16.0.220,3260] successful.
Nov 06 13:29:49 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2b31e4-0a0f-4b4e-8976-b4fc8b292b71]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] <== disconnect_volume: return (402ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:49 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:29:49 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:29:49 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=7630MB free_disk=25.109893798828125GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:29:49 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Applying migration context for instance d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8 as it has an incoming, in-progress migration adaac260-5214-4b8e-952e-65a22f39b3da. Migration status is migrating {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 06 13:29:49 user nova-compute[74821]: INFO nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Updating resource usage from migration adaac260-5214-4b8e-952e-65a22f39b3da
Nov 06 13:29:50 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 2de346cb-9858-47b8-a86c-4fde720d6127 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:29:50 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 49c65aca-8392-46ba-8fa3-b47ff2416cb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:29:50 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 496f8213-4b32-4211-a354-e33a4a088848 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:29:50 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 1290bdb3-827f-4365-a4f1-4ae063de780d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:29:50 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 2d8da345-f66d-45c2-8ccd-d22fdf79a14d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:29:50 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 4bc6444e-b55d-4d81-88d1-f4d147255119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:29:50 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 89b04a09-41d8-461f-8d14-bb3b9c72ed76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:29:50 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:29:50 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 64ae6f5e-38a1-4871-8015-c2097f64b33b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:29:50 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 6121ff1a-d276-485f-85f8-ba451f5b0d37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:29:50 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Migration adaac260-5214-4b8e-952e-65a22f39b3da is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 06 13:29:50 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:29:50 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:29:50 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:29:50 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:29:50 user nova-compute[74821]: DEBUG nova.compute.manager [req-f3010cd1-2ab9-4814-bd49-4462cd80f832 req-2d4988c9-0cc4-4dd6-a33e-3fcb50087197 service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Received event network-vif-plugged-267248e7-6714-47b4-b1b2-1d94251305da {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:29:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f3010cd1-2ab9-4814-bd49-4462cd80f832 req-2d4988c9-0cc4-4dd6-a33e-3fcb50087197 service nova] Acquiring lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:29:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f3010cd1-2ab9-4814-bd49-4462cd80f832 req-2d4988c9-0cc4-4dd6-a33e-3fcb50087197 service nova] Lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:29:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f3010cd1-2ab9-4814-bd49-4462cd80f832 req-2d4988c9-0cc4-4dd6-a33e-3fcb50087197 service nova] Lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:29:50 user nova-compute[74821]: DEBUG nova.compute.manager [req-f3010cd1-2ab9-4814-bd49-4462cd80f832 req-2d4988c9-0cc4-4dd6-a33e-3fcb50087197 service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] No waiting events found dispatching network-vif-plugged-267248e7-6714-47b4-b1b2-1d94251305da {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:29:50 user nova-compute[74821]: WARNING nova.compute.manager [req-f3010cd1-2ab9-4814-bd49-4462cd80f832 req-2d4988c9-0cc4-4dd6-a33e-3fcb50087197 service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Received unexpected event network-vif-plugged-267248e7-6714-47b4-b1b2-1d94251305da for instance with vm_state active and task_state resize_migrating.
Nov 06 13:29:50 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:29:50 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:29:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.621s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:29:53 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:55 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:29:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Acquiring lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:29:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:29:55 user nova-compute[74821]: DEBUG nova.objects.instance [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lazy-loading 'flavor' on Instance uuid 2d8da345-f66d-45c2-8ccd-d22fdf79a14d {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:29:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:29:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Acquiring lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:29:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:29:55 user nova-compute[74821]: INFO nova.compute.manager [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Attaching volume 8fd6df57-5012-419e-86c9-eb8fca3325f6 to /dev/vdb
Nov 06 13:29:55 user nova-compute[74821]: DEBUG os_brick.utils [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:29:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:55 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7ab98d-f8dd-4bcb-95bb-c2395db55ec2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:29:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:55 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[76142cf4-78a3-49f5-beef-b3444262bc62]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:29:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:29:55 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb44dd90-f493-4085-a416-f0d901a0a435]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:29:55 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a52f3b4-8a55-42ff-a808-08e21840eb62]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:29:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:29:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:29:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:29:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:29:56 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:29:56 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[37eb504a-823a-495e-a8e8-b2c0e84bdaa4]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:29:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:29:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:29:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:29:56 user nova-compute[74821]: DEBUG os_brick.utils [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:29:56 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Updating existing volume attachment record: acc70261-d1c6-47b0-9b35-3cf2609dfa75 {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:29:58 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:59 user nova-compute[74821]: DEBUG nova.network.neutron [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Port 267248e7-6714-47b4-b1b2-1d94251305da binding to destination host user is already ACTIVE {{(pid=74821) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 06 13:29:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:29:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:29:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:29:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "refresh_cache-d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:29:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquired lock "refresh_cache-d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:29:59 user nova-compute[74821]: DEBUG nova.network.neutron [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:29:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:29:59 user nova-compute[74821]: DEBUG nova.network.neutron [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Updating instance_info_cache with network_info: [{"id": "267248e7-6714-47b4-b1b2-1d94251305da", "address": "fa:16:3e:4e:3f:6c", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267248e7-67", "ovs_interfaceid": "267248e7-6714-47b4-b1b2-1d94251305da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:29:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Releasing lock "refresh_cache-d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:30:00 user nova-compute[74821]: DEBUG os_brick.utils [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:30:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:00 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1d04d5-fc1e-41d2-a34e-68d7ce15d068]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:00 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[19371e80-e61e-47c5-a78c-e48bb4f0c2b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:00 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc58139-4e2a-431b-aa04-834c41dd62bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:00 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e33c9a1-d21e-4590-9a23-eb5502420ed6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:30:00 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:30:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:30:00 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:30:00 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de7f6b8-87ed-4688-8d48-3857f580cb82]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:00 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:30:00 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:30:00 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:30:00 user nova-compute[74821]: DEBUG os_brick.utils [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:30:00 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5d3b5f66-2c2f-4789-b61c-0df4341e8596 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:30:00 user nova-compute[74821]: INFO nova.compute.manager [None req-5d3b5f66-2c2f-4789-b61c-0df4341e8596 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] instance snapshotting
Nov 06 13:30:00 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-5d3b5f66-2c2f-4789-b61c-0df4341e8596 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Beginning live snapshot process
Nov 06 13:30:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5d3b5f66-2c2f-4789-b61c-0df4341e8596 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json -f qcow2 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5d3b5f66-2c2f-4789-b61c-0df4341e8596 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5d3b5f66-2c2f-4789-b61c-0df4341e8596 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json -f qcow2 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5d3b5f66-2c2f-4789-b61c-0df4341e8596 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5d3b5f66-2c2f-4789-b61c-0df4341e8596 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5d3b5f66-2c2f-4789-b61c-0df4341e8596 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.173s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5d3b5f66-2c2f-4789-b61c-0df4341e8596 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcj7x2f0_/26e806393d5043bcbcb0372afc39019f.delta 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5d3b5f66-2c2f-4789-b61c-0df4341e8596 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcj7x2f0_/26e806393d5043bcbcb0372afc39019f.delta 1073741824" returned: 0 in 0.048s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:01 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-5d3b5f66-2c2f-4789-b61c-0df4341e8596 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 06 13:30:02 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-5d3b5f66-2c2f-4789-b61c-0df4341e8596 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74821) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 13:30:02 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-5d3b5f66-2c2f-4789-b61c-0df4341e8596 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] COPY block job progress, current cursor: 21299200 final cursor: 75563008 {{(pid=74821) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 13:30:03 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-5d3b5f66-2c2f-4789-b61c-0df4341e8596 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74821) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 06 13:30:03 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-5d3b5f66-2c2f-4789-b61c-0df4341e8596 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 06 13:30:03 user nova-compute[74821]: DEBUG nova.privsep.utils [None req-5d3b5f66-2c2f-4789-b61c-0df4341e8596 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74821) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 13:30:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5d3b5f66-2c2f-4789-b61c-0df4341e8596 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcj7x2f0_/26e806393d5043bcbcb0372afc39019f.delta /opt/stack/data/nova/instances/snapshots/tmpcj7x2f0_/26e806393d5043bcbcb0372afc39019f {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5d3b5f66-2c2f-4789-b61c-0df4341e8596 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcj7x2f0_/26e806393d5043bcbcb0372afc39019f.delta /opt/stack/data/nova/instances/snapshots/tmpcj7x2f0_/26e806393d5043bcbcb0372afc39019f" returned: 0 in 0.699s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:04 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-5d3b5f66-2c2f-4789-b61c-0df4341e8596 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Snapshot extracted, beginning image upload
Nov 06 13:30:06 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-5d3b5f66-2c2f-4789-b61c-0df4341e8596 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Snapshot image upload complete
Nov 06 13:30:06 user nova-compute[74821]: INFO nova.compute.manager [None req-5d3b5f66-2c2f-4789-b61c-0df4341e8596 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Took 6.40 seconds to snapshot the instance on the hypervisor.
Nov 06 13:30:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG nova.compute.manager [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:30:11 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Creating image(s)
Nov 06 13:30:11 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Did not create local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Ensure instance console log exists: /opt/stack/data/nova/instances/64ae6f5e-38a1-4871-8015-c2097f64b33b/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Start _get_guest_xml network_info=[{"id": "ded8f989-f920-42ed-a158-04455e6abbc1", "address": "fa:16:3e:b2:3e:a6", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8f989-f9", "ovs_interfaceid": "ded8f989-f920-42ed-a158-04455e6abbc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IBghSkKa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '64ae6f5e-38a1-4871-8015-c2097f64b33b', 'attached_at': '', 'detached_at': '', 'volume_id': '0b57743d-26b7-4805-a133-483e5e3cd42f', 'serial': '0b57743d-26b7-4805-a133-483e5e3cd42f'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '59550c62-1fed-45df-bebf-5f7f1360dd0c', 'volume_type': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:30:11 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:30:11 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:30:11 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IBghSkKa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:30:11 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:30:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:30:11 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:30:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:30:11 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:30:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d1ce7d-0a66-47a9-a1f8-dff827639da2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:30:11 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9887d9-0b29-48b9-80cb-8279c2a89420]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f] added
Nov 06 13:30:11 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.113s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3c8cb9-bf34-4f7c-8af1-b3e725a7c0ad]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6936dd3-f90b-4bb9-8625-92df3fc72bff]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IBghSkKa {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IBghSkKa" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[baafef0d-37a2-4724-abce-b2c49beacbe3]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IBghSkKa'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe011d3-60ba-496f-af6a-7922dc4e469e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f90a52-f0fb-4256-811e-307c47ce173c]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:30:11 user nova-compute[74821]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:30:11 user nova-compute[74821]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 (non-flash)
Nov 06 13:30:11 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:30:11 user nova-compute[74821]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:30:11 user nova-compute[74821]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 (non-flash)
Nov 06 13:30:11 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55d4d00-7053-4654-baca-a97b93ad0f8c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f, portal: 172.16.0.220,3260]
Nov 06 13:30:11 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f, portal: 172.16.0.220,3260] successful.
Nov 06 13:30:11 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b0053f-ec23-4aab-af1e-599bc2c8fb79]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b17814-bb8c-4e5a-8b86-19a27b353012]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:30:11 user nova-compute[74821]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:30:11 user nova-compute[74821]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 (non-flash)
Nov 06 13:30:11 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:30:11 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:30:11 user nova-compute[74821]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:30:11 user nova-compute[74821]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 (non-flash)
Nov 06 13:30:11 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:30:11 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.485s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4762890e-8f88-4d79-8978-3d934a81d5d4]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:11 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: None {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:30:12 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:30:12 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IBghSkKa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:30:12 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.523s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:30:12 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] <== connect_volume: return (1524ms) {'type': 'block', 'scsi_wwn': '23230376336373462', 'path': '/dev/sdb'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:30:12 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230376336373462', 'path': '/dev/sdb'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:30:12 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:28:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1606742164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1606742164',id=35,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f745a322931e4150b12d139bfb17b94c',ramdisk_id='',reservation_id='r-lvxyahl7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1064633830',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:28:14Z,user_data=None,user_id='133932d1063241078d84731624e89216',uuid=64ae6f5e-38a1-4871-8015-c2097f64b33b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ded8f989-f920-42ed-a158-04455e6abbc1", "address": "fa:16:3e:b2:3e:a6", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8f989-f9", "ovs_interfaceid": "ded8f989-f920-42ed-a158-04455e6abbc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:30:12 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Converting VIF {"id": "ded8f989-f920-42ed-a158-04455e6abbc1", "address": "fa:16:3e:b2:3e:a6", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8f989-f9", "ovs_interfaceid": "ded8f989-f920-42ed-a158-04455e6abbc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:30:12 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3e:a6,bridge_name='br-int',has_traffic_filtering=True,id=ded8f989-f920-42ed-a158-04455e6abbc1,network=Network(354bf335-0cac-46d9-acb8-5095411f5db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapded8f989-f9') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:30:12 user nova-compute[74821]: DEBUG nova.objects.instance [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lazy-loading 'pci_devices' on Instance uuid 64ae6f5e-38a1-4871-8015-c2097f64b33b {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:30:12 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:30:12 user nova-compute[74821]:   <uuid>64ae6f5e-38a1-4871-8015-c2097f64b33b</uuid>
Nov 06 13:30:12 user nova-compute[74821]:   <name>instance-00000023</name>
Nov 06 13:30:12 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:30:12 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:30:12 user nova-compute[74821]:   <metadata>
Nov 06 13:30:12 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:30:12 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:30:12 user nova-compute[74821]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1606742164</nova:name>
Nov 06 13:30:12 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:30:11</nova:creationTime>
Nov 06 13:30:12 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:30:12 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:30:12 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:30:12 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:30:12 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:30:12 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:30:12 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:30:12 user nova-compute[74821]:       <nova:owner>
Nov 06 13:30:12 user nova-compute[74821]:         <nova:user uuid="133932d1063241078d84731624e89216">tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member</nova:user>
Nov 06 13:30:12 user nova-compute[74821]:         <nova:project uuid="f745a322931e4150b12d139bfb17b94c">tempest-ServerBootFromVolumeStableRescueTest-1064633830</nova:project>
Nov 06 13:30:12 user nova-compute[74821]:       </nova:owner>
Nov 06 13:30:12 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:30:12 user nova-compute[74821]:       <nova:ports>
Nov 06 13:30:12 user nova-compute[74821]:         <nova:port uuid="ded8f989-f920-42ed-a158-04455e6abbc1">
Nov 06 13:30:12 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 06 13:30:12 user nova-compute[74821]:         </nova:port>
Nov 06 13:30:12 user nova-compute[74821]:       </nova:ports>
Nov 06 13:30:12 user nova-compute[74821]:     </nova:instance>
Nov 06 13:30:12 user nova-compute[74821]:   </metadata>
Nov 06 13:30:12 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:30:12 user nova-compute[74821]:     <system>
Nov 06 13:30:12 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:30:12 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:30:12 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:30:12 user nova-compute[74821]:       <entry name="serial">64ae6f5e-38a1-4871-8015-c2097f64b33b</entry>
Nov 06 13:30:12 user nova-compute[74821]:       <entry name="uuid">64ae6f5e-38a1-4871-8015-c2097f64b33b</entry>
Nov 06 13:30:12 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:30:12 user nova-compute[74821]:     </system>
Nov 06 13:30:12 user nova-compute[74821]:   </sysinfo>
Nov 06 13:30:12 user nova-compute[74821]:   <os>
Nov 06 13:30:12 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:30:12 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:30:12 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:30:12 user nova-compute[74821]:   </os>
Nov 06 13:30:12 user nova-compute[74821]:   <features>
Nov 06 13:30:12 user nova-compute[74821]:     <acpi/>
Nov 06 13:30:12 user nova-compute[74821]:     <apic/>
Nov 06 13:30:12 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:30:12 user nova-compute[74821]:   </features>
Nov 06 13:30:12 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:30:12 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:30:12 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:30:12 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:30:12 user nova-compute[74821]:   </clock>
Nov 06 13:30:12 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:30:12 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:30:12 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:30:12 user nova-compute[74821]:   </cpu>
Nov 06 13:30:12 user nova-compute[74821]:   <devices>
Nov 06 13:30:12 user nova-compute[74821]:     <disk type="block" device="disk">
Nov 06 13:30:12 user nova-compute[74821]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:30:12 user nova-compute[74821]:       <source dev="/dev/sdb"/>
Nov 06 13:30:12 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:30:12 user nova-compute[74821]:       <serial>0b57743d-26b7-4805-a133-483e5e3cd42f</serial>
Nov 06 13:30:12 user nova-compute[74821]:     </disk>
Nov 06 13:30:12 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:30:12 user nova-compute[74821]:       <mac address="fa:16:3e:b2:3e:a6"/>
Nov 06 13:30:12 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:30:12 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:30:12 user nova-compute[74821]:       <target dev="tapded8f989-f9"/>
Nov 06 13:30:12 user nova-compute[74821]:     </interface>
Nov 06 13:30:12 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:30:12 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/64ae6f5e-38a1-4871-8015-c2097f64b33b/console.log" append="off"/>
Nov 06 13:30:12 user nova-compute[74821]:     </serial>
Nov 06 13:30:12 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:30:12 user nova-compute[74821]:     <video>
Nov 06 13:30:12 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:30:12 user nova-compute[74821]:     </video>
Nov 06 13:30:12 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:30:12 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:30:12 user nova-compute[74821]:     </rng>
Nov 06 13:30:12 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:30:12 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:30:12 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:30:12 user nova-compute[74821]:     </memballoon>
Nov 06 13:30:12 user nova-compute[74821]:   </devices>
Nov 06 13:30:12 user nova-compute[74821]: </domain>
Nov 06 13:30:12 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:30:12 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:28:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1606742164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1606742164',id=35,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f745a322931e4150b12d139bfb17b94c',ramdisk_id='',reservation_id='r-lvxyahl7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1064633830',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:28:14Z,user_data=None,user_id='133932d1063241078d84731624e89216',uuid=64ae6f5e-38a1-4871-8015-c2097f64b33b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ded8f989-f920-42ed-a158-04455e6abbc1", "address": "fa:16:3e:b2:3e:a6", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8f989-f9", "ovs_interfaceid": "ded8f989-f920-42ed-a158-04455e6abbc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:30:12 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Converting VIF {"id": "ded8f989-f920-42ed-a158-04455e6abbc1", "address": "fa:16:3e:b2:3e:a6", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8f989-f9", "ovs_interfaceid": "ded8f989-f920-42ed-a158-04455e6abbc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:30:12 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3e:a6,bridge_name='br-int',has_traffic_filtering=True,id=ded8f989-f920-42ed-a158-04455e6abbc1,network=Network(354bf335-0cac-46d9-acb8-5095411f5db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapded8f989-f9') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:30:12 user nova-compute[74821]: DEBUG os_vif [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3e:a6,bridge_name='br-int',has_traffic_filtering=True,id=ded8f989-f920-42ed-a158-04455e6abbc1,network=Network(354bf335-0cac-46d9-acb8-5095411f5db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapded8f989-f9') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:30:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:30:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:30:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7cf5c10d-487d-5146-9d7d-37422542a881', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:30:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Acquiring lock "e80a3f77-8f29-4f18-9707-c9793a124cc6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:30:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "e80a3f77-8f29-4f18-9707-c9793a124cc6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:30:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:30:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapded8f989-f9, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:30:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapded8f989-f9, col_values=(('qos', UUID('c3174155-cc5a-47f5-ac17-361b9df87e49')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:30:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapded8f989-f9, col_values=(('external_ids', {'iface-id': 'ded8f989-f920-42ed-a158-04455e6abbc1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:3e:a6', 'vm-uuid': '64ae6f5e-38a1-4871-8015-c2097f64b33b'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:30:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:30:12 user nova-compute[74821]: DEBUG nova.compute.manager [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:30:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:12 user nova-compute[74821]: INFO os_vif [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3e:a6,bridge_name='br-int',has_traffic_filtering=True,id=ded8f989-f920-42ed-a158-04455e6abbc1,network=Network(354bf335-0cac-46d9-acb8-5095411f5db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapded8f989-f9')
Nov 06 13:30:13 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:30:13 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] No VIF found with MAC fa:16:3e:b2:3e:a6, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:30:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:30:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:30:13 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:30:13 user nova-compute[74821]: INFO nova.compute.claims [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Claim successful on node user
Nov 06 13:30:13 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:30:13 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:30:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.683s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:30:13 user nova-compute[74821]: DEBUG nova.compute.manager [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:30:13 user nova-compute[74821]: DEBUG nova.compute.manager [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:30:13 user nova-compute[74821]: DEBUG nova.network.neutron [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:30:13 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:30:13 user nova-compute[74821]: DEBUG nova.compute.manager [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:30:13 user nova-compute[74821]: DEBUG nova.policy [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '188b10f8df7848288e07c92dd9a33597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608cf017c43942a4a94982b1d5d4d2b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:30:14 user nova-compute[74821]: DEBUG nova.compute.manager [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:30:14 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:30:14 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Creating image(s)
Nov 06 13:30:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Acquiring lock "/opt/stack/data/nova/instances/e80a3f77-8f29-4f18-9707-c9793a124cc6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:30:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "/opt/stack/data/nova/instances/e80a3f77-8f29-4f18-9707-c9793a124cc6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:30:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "/opt/stack/data/nova/instances/e80a3f77-8f29-4f18-9707-c9793a124cc6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:30:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Acquiring lock "652dab4a580ab731c387769b29b92e68e87830cc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:30:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "652dab4a580ab731c387769b29b92e68e87830cc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:30:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/652dab4a580ab731c387769b29b92e68e87830cc.part --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:15 user nova-compute[74821]: DEBUG nova.network.neutron [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Successfully created port: 6d137b0d-23f0-478c-a6a9-b4fc955ce4c2 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:30:15 user nova-compute[74821]: DEBUG nova.compute.manager [req-3ee3ed66-bdc9-4c7d-a9c5-c6ea9f83fba2 req-2517a02a-cbca-47f7-954d-11a78f2dec27 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Received event network-vif-plugged-ded8f989-f920-42ed-a158-04455e6abbc1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:30:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3ee3ed66-bdc9-4c7d-a9c5-c6ea9f83fba2 req-2517a02a-cbca-47f7-954d-11a78f2dec27 service nova] Acquiring lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:30:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3ee3ed66-bdc9-4c7d-a9c5-c6ea9f83fba2 req-2517a02a-cbca-47f7-954d-11a78f2dec27 service nova] Lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:30:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3ee3ed66-bdc9-4c7d-a9c5-c6ea9f83fba2 req-2517a02a-cbca-47f7-954d-11a78f2dec27 service nova] Lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:30:15 user nova-compute[74821]: DEBUG nova.compute.manager [req-3ee3ed66-bdc9-4c7d-a9c5-c6ea9f83fba2 req-2517a02a-cbca-47f7-954d-11a78f2dec27 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] No waiting events found dispatching network-vif-plugged-ded8f989-f920-42ed-a158-04455e6abbc1 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:30:15 user nova-compute[74821]: WARNING nova.compute.manager [req-3ee3ed66-bdc9-4c7d-a9c5-c6ea9f83fba2 req-2517a02a-cbca-47f7-954d-11a78f2dec27 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Received unexpected event network-vif-plugged-ded8f989-f920-42ed-a158-04455e6abbc1 for instance with vm_state building and task_state spawning.
Nov 06 13:30:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/652dab4a580ab731c387769b29b92e68e87830cc.part --force-share --output=json" returned: 0 in 0.208s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:15 user nova-compute[74821]: DEBUG nova.virt.images [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] a6699e17-6b7d-4c7b-a531-ceee845dbcfd was qcow2, converting to raw {{(pid=74821) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 13:30:15 user nova-compute[74821]: DEBUG nova.privsep.utils [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74821) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 13:30:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/652dab4a580ab731c387769b29b92e68e87830cc.part /opt/stack/data/nova/instances/_base/652dab4a580ab731c387769b29b92e68e87830cc.converted {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/652dab4a580ab731c387769b29b92e68e87830cc.part /opt/stack/data/nova/instances/_base/652dab4a580ab731c387769b29b92e68e87830cc.converted" returned: 0 in 0.505s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/652dab4a580ab731c387769b29b92e68e87830cc.converted --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/652dab4a580ab731c387769b29b92e68e87830cc.converted --force-share --output=json" returned: 0 in 0.245s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:16 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "652dab4a580ab731c387769b29b92e68e87830cc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.304s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:30:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/652dab4a580ab731c387769b29b92e68e87830cc --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:16 user nova-compute[74821]: DEBUG nova.network.neutron [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Successfully updated port: 6d137b0d-23f0-478c-a6a9-b4fc955ce4c2 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:30:16 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Acquiring lock "refresh_cache-e80a3f77-8f29-4f18-9707-c9793a124cc6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:30:16 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Acquired lock "refresh_cache-e80a3f77-8f29-4f18-9707-c9793a124cc6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:30:16 user nova-compute[74821]: DEBUG nova.network.neutron [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:30:16 user nova-compute[74821]: DEBUG nova.network.neutron [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:30:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/652dab4a580ab731c387769b29b92e68e87830cc --force-share --output=json" returned: 0 in 0.195s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:16 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Acquiring lock "652dab4a580ab731c387769b29b92e68e87830cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:30:16 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "652dab4a580ab731c387769b29b92e68e87830cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:30:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/652dab4a580ab731c387769b29b92e68e87830cc --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/652dab4a580ab731c387769b29b92e68e87830cc --force-share --output=json" returned: 0 in 0.175s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/652dab4a580ab731c387769b29b92e68e87830cc,backing_fmt=raw /opt/stack/data/nova/instances/e80a3f77-8f29-4f18-9707-c9793a124cc6/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/652dab4a580ab731c387769b29b92e68e87830cc,backing_fmt=raw /opt/stack/data/nova/instances/e80a3f77-8f29-4f18-9707-c9793a124cc6/disk 1073741824" returned: 0 in 0.062s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:16 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "652dab4a580ab731c387769b29b92e68e87830cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:30:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/652dab4a580ab731c387769b29b92e68e87830cc --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:16 user nova-compute[74821]: DEBUG nova.network.neutron [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Updating instance_info_cache with network_info: [{"id": "6d137b0d-23f0-478c-a6a9-b4fc955ce4c2", "address": "fa:16:3e:57:6c:0b", "network": {"id": "5e673907-9763-4136-845d-b3154200d004", "bridge": "br-int", "label": "tempest-TestStampPattern-539864653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608cf017c43942a4a94982b1d5d4d2b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d137b0d-23", "ovs_interfaceid": "6d137b0d-23f0-478c-a6a9-b4fc955ce4c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:30:16 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Releasing lock "refresh_cache-e80a3f77-8f29-4f18-9707-c9793a124cc6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:30:16 user nova-compute[74821]: DEBUG nova.compute.manager [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Instance network_info: |[{"id": "6d137b0d-23f0-478c-a6a9-b4fc955ce4c2", "address": "fa:16:3e:57:6c:0b", "network": {"id": "5e673907-9763-4136-845d-b3154200d004", "bridge": "br-int", "label": "tempest-TestStampPattern-539864653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608cf017c43942a4a94982b1d5d4d2b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d137b0d-23", "ovs_interfaceid": "6d137b0d-23f0-478c-a6a9-b4fc955ce4c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:30:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/652dab4a580ab731c387769b29b92e68e87830cc --force-share --output=json" returned: 0 in 0.202s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:16 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:30:16 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Ensure instance console log exists: /opt/stack/data/nova/instances/e80a3f77-8f29-4f18-9707-c9793a124cc6/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:30:16 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:30:16 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:30:16 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Start _get_guest_xml network_info=[{"id": "6d137b0d-23f0-478c-a6a9-b4fc955ce4c2", "address": "fa:16:3e:57:6c:0b", "network": {"id": "5e673907-9763-4136-845d-b3154200d004", "bridge": "br-int", "label": "tempest-TestStampPattern-539864653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608cf017c43942a4a94982b1d5d4d2b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d137b0d-23", "ovs_interfaceid": "6d137b0d-23f0-478c-a6a9-b4fc955ce4c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='abdc32be23bf757b6d2317bea46929b9',container_format='bare',created_at=2023-11-06T13:30:00Z,direct_url=<?>,disk_format='qcow2',id=a6699e17-6b7d-4c7b-a531-ceee845dbcfd,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-23404065',owner='608cf017c43942a4a94982b1d5d4d2b9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-06T13:30:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a6699e17-6b7d-4c7b-a531-ceee845dbcfd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:30:17 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:30:17 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='abdc32be23bf757b6d2317bea46929b9',container_format='bare',created_at=2023-11-06T13:30:00Z,direct_url=<?>,disk_format='qcow2',id=a6699e17-6b7d-4c7b-a531-ceee845dbcfd,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-23404065',owner='608cf017c43942a4a94982b1d5d4d2b9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-06T13:30:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:30:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-524185899',display_name='tempest-TestStampPattern-server-524185899',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-524185899',id=37,image_ref='a6699e17-6b7d-4c7b-a531-ceee845dbcfd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHT6BbspfsGKU4w7+rfCb2XbPvdRdiCIBLtNBrG2m7ivVKQnsl1fkuukzo4FgDo5nmrAQDc2oBOGBF9X5srYArFAUxnzu0ECbQ5DvrtDTtn/zmxbYwAAp1N2mi6fR8VQRQ==',key_name='tempest-TestStampPattern-1150007784',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='608cf017c43942a4a94982b1d5d4d2b9',ramdisk_id='',reservation_id='r-x5q7mzm8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='4bc6444e-b55d-4d81-88d1-f4d147255119',image_min_disk='1',image_min_ram='0',image_owner_id='608cf017c43942a4a94982b1d5d4d2b9',image_owner_project_name='tempest-TestStampPattern-1706680780',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1706680780-project-member',image_user_id='188b10f8df7848288e07c92dd9a33597',network_allocated='True',owner_project_name='tempest-TestStampPattern-1706680780',owner_user_name='tempest-TestStampPattern-1706680780-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:30:14Z,user_data=None,user_id='188b10f8df7848288e07c92dd9a33597',uuid=e80a3f77-8f29-4f18-9707-c9793a124cc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d137b0d-23f0-478c-a6a9-b4fc955ce4c2", "address": "fa:16:3e:57:6c:0b", "network": {"id": "5e673907-9763-4136-845d-b3154200d004", "bridge": "br-int", "label": "tempest-TestStampPattern-539864653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608cf017c43942a4a94982b1d5d4d2b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d137b0d-23", "ovs_interfaceid": "6d137b0d-23f0-478c-a6a9-b4fc955ce4c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Converting VIF {"id": "6d137b0d-23f0-478c-a6a9-b4fc955ce4c2", "address": "fa:16:3e:57:6c:0b", "network": {"id": "5e673907-9763-4136-845d-b3154200d004", "bridge": "br-int", "label": "tempest-TestStampPattern-539864653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608cf017c43942a4a94982b1d5d4d2b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d137b0d-23", "ovs_interfaceid": "6d137b0d-23f0-478c-a6a9-b4fc955ce4c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:6c:0b,bridge_name='br-int',has_traffic_filtering=True,id=6d137b0d-23f0-478c-a6a9-b4fc955ce4c2,network=Network(5e673907-9763-4136-845d-b3154200d004),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d137b0d-23') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.objects.instance [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lazy-loading 'pci_devices' on Instance uuid e80a3f77-8f29-4f18-9707-c9793a124cc6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:30:17 user nova-compute[74821]:   <uuid>e80a3f77-8f29-4f18-9707-c9793a124cc6</uuid>
Nov 06 13:30:17 user nova-compute[74821]:   <name>instance-00000025</name>
Nov 06 13:30:17 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:30:17 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:30:17 user nova-compute[74821]:   <metadata>
Nov 06 13:30:17 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:30:17 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:30:17 user nova-compute[74821]:       <nova:name>tempest-TestStampPattern-server-524185899</nova:name>
Nov 06 13:30:17 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:30:17</nova:creationTime>
Nov 06 13:30:17 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:30:17 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:30:17 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:30:17 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:30:17 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:30:17 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:30:17 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:30:17 user nova-compute[74821]:       <nova:owner>
Nov 06 13:30:17 user nova-compute[74821]:         <nova:user uuid="188b10f8df7848288e07c92dd9a33597">tempest-TestStampPattern-1706680780-project-member</nova:user>
Nov 06 13:30:17 user nova-compute[74821]:         <nova:project uuid="608cf017c43942a4a94982b1d5d4d2b9">tempest-TestStampPattern-1706680780</nova:project>
Nov 06 13:30:17 user nova-compute[74821]:       </nova:owner>
Nov 06 13:30:17 user nova-compute[74821]:       <nova:root type="image" uuid="a6699e17-6b7d-4c7b-a531-ceee845dbcfd"/>
Nov 06 13:30:17 user nova-compute[74821]:       <nova:ports>
Nov 06 13:30:17 user nova-compute[74821]:         <nova:port uuid="6d137b0d-23f0-478c-a6a9-b4fc955ce4c2">
Nov 06 13:30:17 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 06 13:30:17 user nova-compute[74821]:         </nova:port>
Nov 06 13:30:17 user nova-compute[74821]:       </nova:ports>
Nov 06 13:30:17 user nova-compute[74821]:     </nova:instance>
Nov 06 13:30:17 user nova-compute[74821]:   </metadata>
Nov 06 13:30:17 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:30:17 user nova-compute[74821]:     <system>
Nov 06 13:30:17 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:30:17 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:30:17 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:30:17 user nova-compute[74821]:       <entry name="serial">e80a3f77-8f29-4f18-9707-c9793a124cc6</entry>
Nov 06 13:30:17 user nova-compute[74821]:       <entry name="uuid">e80a3f77-8f29-4f18-9707-c9793a124cc6</entry>
Nov 06 13:30:17 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:30:17 user nova-compute[74821]:     </system>
Nov 06 13:30:17 user nova-compute[74821]:   </sysinfo>
Nov 06 13:30:17 user nova-compute[74821]:   <os>
Nov 06 13:30:17 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:30:17 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:30:17 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:30:17 user nova-compute[74821]:   </os>
Nov 06 13:30:17 user nova-compute[74821]:   <features>
Nov 06 13:30:17 user nova-compute[74821]:     <acpi/>
Nov 06 13:30:17 user nova-compute[74821]:     <apic/>
Nov 06 13:30:17 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:30:17 user nova-compute[74821]:   </features>
Nov 06 13:30:17 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:30:17 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:30:17 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:30:17 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:30:17 user nova-compute[74821]:   </clock>
Nov 06 13:30:17 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:30:17 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:30:17 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:30:17 user nova-compute[74821]:   </cpu>
Nov 06 13:30:17 user nova-compute[74821]:   <devices>
Nov 06 13:30:17 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:30:17 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:30:17 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/e80a3f77-8f29-4f18-9707-c9793a124cc6/disk"/>
Nov 06 13:30:17 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:30:17 user nova-compute[74821]:     </disk>
Nov 06 13:30:17 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:30:17 user nova-compute[74821]:       <mac address="fa:16:3e:57:6c:0b"/>
Nov 06 13:30:17 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:30:17 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:30:17 user nova-compute[74821]:       <target dev="tap6d137b0d-23"/>
Nov 06 13:30:17 user nova-compute[74821]:     </interface>
Nov 06 13:30:17 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:30:17 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/e80a3f77-8f29-4f18-9707-c9793a124cc6/console.log" append="off"/>
Nov 06 13:30:17 user nova-compute[74821]:     </serial>
Nov 06 13:30:17 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:30:17 user nova-compute[74821]:     <video>
Nov 06 13:30:17 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:30:17 user nova-compute[74821]:     </video>
Nov 06 13:30:17 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:30:17 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:30:17 user nova-compute[74821]:     </rng>
Nov 06 13:30:17 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:30:17 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:30:17 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:30:17 user nova-compute[74821]:     </memballoon>
Nov 06 13:30:17 user nova-compute[74821]:   </devices>
Nov 06 13:30:17 user nova-compute[74821]: </domain>
Nov 06 13:30:17 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:30:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-524185899',display_name='tempest-TestStampPattern-server-524185899',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-524185899',id=37,image_ref='a6699e17-6b7d-4c7b-a531-ceee845dbcfd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHT6BbspfsGKU4w7+rfCb2XbPvdRdiCIBLtNBrG2m7ivVKQnsl1fkuukzo4FgDo5nmrAQDc2oBOGBF9X5srYArFAUxnzu0ECbQ5DvrtDTtn/zmxbYwAAp1N2mi6fR8VQRQ==',key_name='tempest-TestStampPattern-1150007784',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='608cf017c43942a4a94982b1d5d4d2b9',ramdisk_id='',reservation_id='r-x5q7mzm8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='4bc6444e-b55d-4d81-88d1-f4d147255119',image_min_disk='1',image_min_ram='0',image_owner_id='608cf017c43942a4a94982b1d5d4d2b9',image_owner_project_name='tempest-TestStampPattern-1706680780',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1706680780-project-member',image_user_id='188b10f8df7848288e07c92dd9a33597',network_allocated='True',owner_project_name='tempest-TestStampPattern-1706680780',owner_user_name='tempest-TestStampPattern-1706680780-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:30:14Z,user_data=None,user_id='188b10f8df7848288e07c92dd9a33597',uuid=e80a3f77-8f29-4f18-9707-c9793a124cc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d137b0d-23f0-478c-a6a9-b4fc955ce4c2", "address": "fa:16:3e:57:6c:0b", "network": {"id": "5e673907-9763-4136-845d-b3154200d004", "bridge": "br-int", "label": "tempest-TestStampPattern-539864653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608cf017c43942a4a94982b1d5d4d2b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d137b0d-23", "ovs_interfaceid": "6d137b0d-23f0-478c-a6a9-b4fc955ce4c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Converting VIF {"id": "6d137b0d-23f0-478c-a6a9-b4fc955ce4c2", "address": "fa:16:3e:57:6c:0b", "network": {"id": "5e673907-9763-4136-845d-b3154200d004", "bridge": "br-int", "label": "tempest-TestStampPattern-539864653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608cf017c43942a4a94982b1d5d4d2b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d137b0d-23", "ovs_interfaceid": "6d137b0d-23f0-478c-a6a9-b4fc955ce4c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:6c:0b,bridge_name='br-int',has_traffic_filtering=True,id=6d137b0d-23f0-478c-a6a9-b4fc955ce4c2,network=Network(5e673907-9763-4136-845d-b3154200d004),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d137b0d-23') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG os_vif [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:6c:0b,bridge_name='br-int',has_traffic_filtering=True,id=6d137b0d-23f0-478c-a6a9-b4fc955ce4c2,network=Network(5e673907-9763-4136-845d-b3154200d004),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d137b0d-23') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b50c95a-80ed-541c-b050-622b9ed9f952', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d137b0d-23, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6d137b0d-23, col_values=(('qos', UUID('3e8aa431-a8fc-42f6-8d7d-33cbed947fc6')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6d137b0d-23, col_values=(('external_ids', {'iface-id': '6d137b0d-23f0-478c-a6a9-b4fc955ce4c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:6c:0b', 'vm-uuid': 'e80a3f77-8f29-4f18-9707-c9793a124cc6'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:17 user nova-compute[74821]: INFO os_vif [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:6c:0b,bridge_name='br-int',has_traffic_filtering=True,id=6d137b0d-23f0-478c-a6a9-b4fc955ce4c2,network=Network(5e673907-9763-4136-845d-b3154200d004),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d137b0d-23')
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.compute.manager [req-b04566f5-6808-40c0-90b0-d9b12abd9fae req-80b17249-156b-4c64-9272-08a2161db0d9 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Received event network-vif-plugged-ded8f989-f920-42ed-a158-04455e6abbc1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b04566f5-6808-40c0-90b0-d9b12abd9fae req-80b17249-156b-4c64-9272-08a2161db0d9 service nova] Acquiring lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b04566f5-6808-40c0-90b0-d9b12abd9fae req-80b17249-156b-4c64-9272-08a2161db0d9 service nova] Lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b04566f5-6808-40c0-90b0-d9b12abd9fae req-80b17249-156b-4c64-9272-08a2161db0d9 service nova] Lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.compute.manager [req-b04566f5-6808-40c0-90b0-d9b12abd9fae req-80b17249-156b-4c64-9272-08a2161db0d9 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] No waiting events found dispatching network-vif-plugged-ded8f989-f920-42ed-a158-04455e6abbc1 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:30:17 user nova-compute[74821]: WARNING nova.compute.manager [req-b04566f5-6808-40c0-90b0-d9b12abd9fae req-80b17249-156b-4c64-9272-08a2161db0d9 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Received unexpected event network-vif-plugged-ded8f989-f920-42ed-a158-04455e6abbc1 for instance with vm_state building and task_state spawning.
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.compute.manager [req-b04566f5-6808-40c0-90b0-d9b12abd9fae req-80b17249-156b-4c64-9272-08a2161db0d9 service nova] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Received event network-changed-6d137b0d-23f0-478c-a6a9-b4fc955ce4c2 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.compute.manager [req-b04566f5-6808-40c0-90b0-d9b12abd9fae req-80b17249-156b-4c64-9272-08a2161db0d9 service nova] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Refreshing instance network info cache due to event network-changed-6d137b0d-23f0-478c-a6a9-b4fc955ce4c2. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b04566f5-6808-40c0-90b0-d9b12abd9fae req-80b17249-156b-4c64-9272-08a2161db0d9 service nova] Acquiring lock "refresh_cache-e80a3f77-8f29-4f18-9707-c9793a124cc6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b04566f5-6808-40c0-90b0-d9b12abd9fae req-80b17249-156b-4c64-9272-08a2161db0d9 service nova] Acquired lock "refresh_cache-e80a3f77-8f29-4f18-9707-c9793a124cc6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.network.neutron [req-b04566f5-6808-40c0-90b0-d9b12abd9fae req-80b17249-156b-4c64-9272-08a2161db0d9 service nova] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Refreshing network info cache for port 6d137b0d-23f0-478c-a6a9-b4fc955ce4c2 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] No VIF found with MAC fa:16:3e:57:6c:0b, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.compute.manager [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:30:17 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Instance spawned successfully.
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.network.neutron [req-b04566f5-6808-40c0-90b0-d9b12abd9fae req-80b17249-156b-4c64-9272-08a2161db0d9 service nova] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Updated VIF entry in instance network info cache for port 6d137b0d-23f0-478c-a6a9-b4fc955ce4c2. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.network.neutron [req-b04566f5-6808-40c0-90b0-d9b12abd9fae req-80b17249-156b-4c64-9272-08a2161db0d9 service nova] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Updating instance_info_cache with network_info: [{"id": "6d137b0d-23f0-478c-a6a9-b4fc955ce4c2", "address": "fa:16:3e:57:6c:0b", "network": {"id": "5e673907-9763-4136-845d-b3154200d004", "bridge": "br-int", "label": "tempest-TestStampPattern-539864653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608cf017c43942a4a94982b1d5d4d2b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d137b0d-23", "ovs_interfaceid": "6d137b0d-23f0-478c-a6a9-b4fc955ce4c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:30:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b04566f5-6808-40c0-90b0-d9b12abd9fae req-80b17249-156b-4c64-9272-08a2161db0d9 service nova] Releasing lock "refresh_cache-e80a3f77-8f29-4f18-9707-c9793a124cc6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:30:17 user nova-compute[74821]: INFO nova.compute.manager [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Took 6.51 seconds to spawn the instance on the hypervisor.
Nov 06 13:30:17 user nova-compute[74821]: DEBUG nova.compute.manager [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:30:17 user nova-compute[74821]: INFO nova.compute.manager [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Took 124.76 seconds to build instance.
Nov 06 13:30:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-afa4c18a-50b2-49ad-b8a8-95845fd9a9d1 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "64ae6f5e-38a1-4871-8015-c2097f64b33b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 124.871s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:30:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:19 user nova-compute[74821]: DEBUG nova.compute.manager [req-6e50f448-1e2f-49e4-ad95-6a4545c6034c req-aba601d7-e61f-4aed-bde1-1021b7cf009d service nova] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Received event network-vif-plugged-6d137b0d-23f0-478c-a6a9-b4fc955ce4c2 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:30:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6e50f448-1e2f-49e4-ad95-6a4545c6034c req-aba601d7-e61f-4aed-bde1-1021b7cf009d service nova] Acquiring lock "e80a3f77-8f29-4f18-9707-c9793a124cc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:30:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6e50f448-1e2f-49e4-ad95-6a4545c6034c req-aba601d7-e61f-4aed-bde1-1021b7cf009d service nova] Lock "e80a3f77-8f29-4f18-9707-c9793a124cc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:30:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6e50f448-1e2f-49e4-ad95-6a4545c6034c req-aba601d7-e61f-4aed-bde1-1021b7cf009d service nova] Lock "e80a3f77-8f29-4f18-9707-c9793a124cc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:30:19 user nova-compute[74821]: DEBUG nova.compute.manager [req-6e50f448-1e2f-49e4-ad95-6a4545c6034c req-aba601d7-e61f-4aed-bde1-1021b7cf009d service nova] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] No waiting events found dispatching network-vif-plugged-6d137b0d-23f0-478c-a6a9-b4fc955ce4c2 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:30:19 user nova-compute[74821]: WARNING nova.compute.manager [req-6e50f448-1e2f-49e4-ad95-6a4545c6034c req-aba601d7-e61f-4aed-bde1-1021b7cf009d service nova] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Received unexpected event network-vif-plugged-6d137b0d-23f0-478c-a6a9-b4fc955ce4c2 for instance with vm_state building and task_state spawning.
Nov 06 13:30:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG nova.compute.manager [req-1668b0e9-062d-4984-ae67-9b81d68dfcce req-c7cb2e95-1ef7-41a2-92fe-48e6aac1ff74 service nova] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Received event network-vif-plugged-6d137b0d-23f0-478c-a6a9-b4fc955ce4c2 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1668b0e9-062d-4984-ae67-9b81d68dfcce req-c7cb2e95-1ef7-41a2-92fe-48e6aac1ff74 service nova] Acquiring lock "e80a3f77-8f29-4f18-9707-c9793a124cc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1668b0e9-062d-4984-ae67-9b81d68dfcce req-c7cb2e95-1ef7-41a2-92fe-48e6aac1ff74 service nova] Lock "e80a3f77-8f29-4f18-9707-c9793a124cc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1668b0e9-062d-4984-ae67-9b81d68dfcce req-c7cb2e95-1ef7-41a2-92fe-48e6aac1ff74 service nova] Lock "e80a3f77-8f29-4f18-9707-c9793a124cc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG nova.compute.manager [req-1668b0e9-062d-4984-ae67-9b81d68dfcce req-c7cb2e95-1ef7-41a2-92fe-48e6aac1ff74 service nova] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] No waiting events found dispatching network-vif-plugged-6d137b0d-23f0-478c-a6a9-b4fc955ce4c2 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:30:21 user nova-compute[74821]: WARNING nova.compute.manager [req-1668b0e9-062d-4984-ae67-9b81d68dfcce req-c7cb2e95-1ef7-41a2-92fe-48e6aac1ff74 service nova] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Received unexpected event network-vif-plugged-6d137b0d-23f0-478c-a6a9-b4fc955ce4c2 for instance with vm_state building and task_state spawning.
Nov 06 13:30:21 user nova-compute[74821]: DEBUG nova.compute.manager [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:30:21 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Instance spawned successfully.
Nov 06 13:30:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NqtJyMeh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:30:21 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:30:21 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:30:21 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:30:21 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:30:21 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:30:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1480a84-be16-4395-a7bc-09d24d91d969]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:30:21 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:21 user nova-compute[74821]: INFO nova.compute.manager [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Took 7.70 seconds to spawn the instance on the hypervisor.
Nov 06 13:30:21 user nova-compute[74821]: DEBUG nova.compute.manager [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c02c90a-cacb-4474-a528-ab21b0f51e15]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6] added
Nov 06 13:30:21 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db22a9f-9c48-40c1-a48f-e5931074bdfc]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4ab59d-1539-4f1e-89b4-d22a14622136]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NqtJyMeh {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:21 user nova-compute[74821]: INFO nova.compute.manager [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Took 8.82 seconds to build instance.
Nov 06 13:30:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NqtJyMeh" returned: 0 in 0.046s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[12869757-1d60-4027-bf98-34de9caaced4]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NqtJyMeh'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.041s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4336606a-403f-4b89-935b-e4357cc0c7f3]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ed79b880-258f-4969-937d-beb3e3716168 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "e80a3f77-8f29-4f18-9707-c9793a124cc6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.018s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2149a9-d182-4ac7-a61c-265623d8249a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:30:21 user nova-compute[74821]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:30:21 user nova-compute[74821]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 (non-flash)
Nov 06 13:30:21 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:30:21 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:30:21 user nova-compute[74821]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:30:21 user nova-compute[74821]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 (non-flash)
Nov 06 13:30:21 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:30:21 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:30:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:22 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:22 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c532a82-d5d0-4ca1-a1ae-9879234d2bab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:22 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6, portal: 172.16.0.220,3260]
Nov 06 13:30:22 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6, portal: 172.16.0.220,3260] successful.
Nov 06 13:30:22 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:30:22 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:22 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.037s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:22 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5bad2d-c7cf-498d-a417-f0d80059bf0d]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:22 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:30:22 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:22 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:22 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fadb9dd-5247-4ef0-947d-9e45effd3327]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:22 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:30:22 user nova-compute[74821]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:30:22 user nova-compute[74821]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 (non-flash)
Nov 06 13:30:22 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:30:22 user nova-compute[74821]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)
Nov 06 13:30:22 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:30:22 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:30:22 user nova-compute[74821]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:30:22 user nova-compute[74821]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 (non-flash)
Nov 06 13:30:22 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:30:22 user nova-compute[74821]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)
Nov 06 13:30:22 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:30:22 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.439s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:30:22 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:30:22 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:30:22 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:30:22 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:22 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:22 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b34914c-688e-463a-aeab-4501b2376340]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:22 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:30:22 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NqtJyMeh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:30:23 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.478s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:30:23 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] <== connect_volume: return (1480ms) {'type': 'block', 'scsi_wwn': '23534376361636465', 'path': '/dev/sdc'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:30:23 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534376361636465', 'path': '/dev/sdc'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:30:23 user nova-compute[74821]: DEBUG nova.objects.instance [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lazy-loading 'flavor' on Instance uuid 2d8da345-f66d-45c2-8ccd-d22fdf79a14d {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:30:23 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 13:30:23 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:30:23 user nova-compute[74821]:   <source dev="/dev/sdc"/>
Nov 06 13:30:23 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:30:23 user nova-compute[74821]:   <serial>8fd6df57-5012-419e-86c9-eb8fca3325f6</serial>
Nov 06 13:30:23 user nova-compute[74821]: </disk>
Nov 06 13:30:23 user nova-compute[74821]:  {{(pid=74821) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 13:30:23 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:30:23 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:30:23 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] No VIF found with MAC fa:16:3e:69:f1:92, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:30:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fd7601cb-7bc9-445a-a3dc-bf8921fb32fe tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.129s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:30:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:27 user nova-compute[74821]: DEBUG nova.compute.manager [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Stashing vm_state: active {{(pid=74821) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 06 13:30:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:30:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:30:27 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:30:27 user nova-compute[74821]: INFO nova.compute.claims [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Claim successful on node user
Nov 06 13:30:27 user nova-compute[74821]: INFO nova.compute.resource_tracker [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Updating resource usage from migration f36ec03b-bcd7-43fc-b827-f385033a26f4
Nov 06 13:30:28 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:30:28 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:30:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.750s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:30:28 user nova-compute[74821]: INFO nova.compute.manager [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Migrating
Nov 06 13:30:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Acquiring lock "refresh_cache-2d8da345-f66d-45c2-8ccd-d22fdf79a14d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:30:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Acquired lock "refresh_cache-2d8da345-f66d-45c2-8ccd-d22fdf79a14d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:30:28 user nova-compute[74821]: DEBUG nova.network.neutron [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:30:28 user nova-compute[74821]: DEBUG nova.network.neutron [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Updating instance_info_cache with network_info: [{"id": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "address": "fa:16:3e:69:f1:92", "network": {"id": "fc4369de-77c4-4f2f-a73c-d556ca3ff47c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1805761900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56107e2c08004a26a96765ec143a6d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf768a2c5-10", "ovs_interfaceid": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:30:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Releasing lock "refresh_cache-2d8da345-f66d-45c2-8ccd-d22fdf79a14d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Starting migrate_disk_and_power_off {{(pid=74821) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG nova.compute.manager [req-fa61a393-82b5-4cbd-9319-b2157c709c86 req-a27a2d3e-3388-4b7e-a281-784531895c4c service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Received event network-vif-unplugged-f768a2c5-10b0-4442-9c76-3b2365a15ea1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fa61a393-82b5-4cbd-9319-b2157c709c86 req-a27a2d3e-3388-4b7e-a281-784531895c4c service nova] Acquiring lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fa61a393-82b5-4cbd-9319-b2157c709c86 req-a27a2d3e-3388-4b7e-a281-784531895c4c service nova] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fa61a393-82b5-4cbd-9319-b2157c709c86 req-a27a2d3e-3388-4b7e-a281-784531895c4c service nova] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG nova.compute.manager [req-fa61a393-82b5-4cbd-9319-b2157c709c86 req-a27a2d3e-3388-4b7e-a281-784531895c4c service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] No waiting events found dispatching network-vif-unplugged-f768a2c5-10b0-4442-9c76-3b2365a15ea1 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:30:29 user nova-compute[74821]: WARNING nova.compute.manager [req-fa61a393-82b5-4cbd-9319-b2157c709c86 req-a27a2d3e-3388-4b7e-a281-784531895c4c service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Received unexpected event network-vif-unplugged-f768a2c5-10b0-4442-9c76-3b2365a15ea1 for instance with vm_state active and task_state resize_migrating.
Nov 06 13:30:29 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Instance destroyed successfully.
Nov 06 13:30:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:26:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-233244178',display_name='tempest-ServerActionsTestOtherB-server-233244178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-233244178',id=30,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuJC1d4ehn860a5pUveloxEygkvx5gY8ln8i6Wkpyz/+95f+bQsPWUnUI4RTUqfdZx4+FPFbRCNSl970GfIGv9UYxW4qb3i2YKmZKus6nAHjmjCWQpj73f7nF5ypuSRew==',key_name='tempest-keypair-821004257',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:26:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='56107e2c08004a26a96765ec143a6d6f',ramdisk_id='',reservation_id='r-l2lbl00l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1724377265',owner_user_name='tempest-ServerActionsTestOtherB-1724377265-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:30:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88e8b4a7235140488a7b9cd34bd10f85',uuid=2d8da345-f66d-45c2-8ccd-d22fdf79a14d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "address": "fa:16:3e:69:f1:92", "network": {"id": "fc4369de-77c4-4f2f-a73c-d556ca3ff47c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1805761900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1805761900-network", "vif_mac": "fa:16:3e:69:f1:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56107e2c08004a26a96765ec143a6d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf768a2c5-10", "ovs_interfaceid": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Converting VIF {"id": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "address": "fa:16:3e:69:f1:92", "network": {"id": "fc4369de-77c4-4f2f-a73c-d556ca3ff47c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1805761900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1805761900-network", "vif_mac": "fa:16:3e:69:f1:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56107e2c08004a26a96765ec143a6d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf768a2c5-10", "ovs_interfaceid": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:f1:92,bridge_name='br-int',has_traffic_filtering=True,id=f768a2c5-10b0-4442-9c76-3b2365a15ea1,network=Network(fc4369de-77c4-4f2f-a73c-d556ca3ff47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf768a2c5-10') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG os_vif [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:f1:92,bridge_name='br-int',has_traffic_filtering=True,id=f768a2c5-10b0-4442-9c76-3b2365a15ea1,network=Network(fc4369de-77c4-4f2f-a73c-d556ca3ff47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf768a2c5-10') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf768a2c5-10, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fa98fa6f-74bf-426d-8432-83dea70666f1) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:30:29 user nova-compute[74821]: INFO os_vif [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:f1:92,bridge_name='br-int',has_traffic_filtering=True,id=f768a2c5-10b0-4442-9c76-3b2365a15ea1,network=Network(fc4369de-77c4-4f2f-a73c-d556ca3ff47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf768a2c5-10')
Nov 06 13:30:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NqtJyMeh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:30:29 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:30:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8797404-37c2-487b-9620-b7eec25042e7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:30:29 user nova-compute[74821]: No targets found.
Nov 06 13:30:29 user nova-compute[74821]: iSNS:
Nov 06 13:30:29 user nova-compute[74821]: No targets found.
Nov 06 13:30:29 user nova-compute[74821]: STATIC:
Nov 06 13:30:29 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af
Nov 06 13:30:29 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:30:29 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:30:29 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f
Nov 06 13:30:29 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:30:29 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:30:29 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979
Nov 06 13:30:29 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:30:29 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:30:29 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6
Nov 06 13:30:29 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:30:29 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:30:29 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815
Nov 06 13:30:29 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:30:29 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:30:29 user nova-compute[74821]: FIRMWARE:
Nov 06 13:30:29 user nova-compute[74821]: No targets found.
Nov 06 13:30:29 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:30:29 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:30:29 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.033s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e3e254-c5dc-459f-b1e4-1abe5c2a9c13]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b759cc-a9c6-4559-aa4d-b89ca8fa3288]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:30:29 user nova-compute[74821]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:30:29 user nova-compute[74821]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 (non-flash)
Nov 06 13:30:29 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:30:29 user nova-compute[74821]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)
Nov 06 13:30:29 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:30:29 user nova-compute[74821]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:30:29 user nova-compute[74821]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 (non-flash)
Nov 06 13:30:29 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:30:29 user nova-compute[74821]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)
Nov 06 13:30:29 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e404977f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6'): ({'sdc'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Removing single pathed devices sdc {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:30:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c181f2-3773-46b0-a234-48de05c8c812]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5a2acc-289f-454a-9aa5-b121f7f3eb25]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Flushing IO for device /dev/sdc {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf42e7d-3fda-4edb-9400-20de5b536423]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[60657fe3-966d-4bb4-b930-80f0a4fc0fe8]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] SCSI volumes sdc have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[77173270-dbc6-4d9a-a3a9-e236c789bfc7]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[351e0b54-b7e2-4b35-95f4-fb89c18eebf7]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6, portal: 172.16.0.220,3260]
Nov 06 13:30:30 user nova-compute[74821]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6, portal: 172.16.0.220,3260] successful.
Nov 06 13:30:30 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0adeade-30f1-4fd5-95c0-db1662cf8872]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] <== disconnect_volume: return (383ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:30:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d_resize/disk /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] CMD "cp -r /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d_resize/disk /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk" returned: 0 in 0.569s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d_resize/disk.info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk.info {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] CMD "cp -r /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d_resize/disk.info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk.info" returned: 0 in 0.037s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG nova.compute.manager [req-181321c6-b1c9-43db-9398-a48494777424 req-ad452913-6bb3-4aad-a4e3-88cb596a96fa service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Received event network-vif-plugged-f768a2c5-10b0-4442-9c76-3b2365a15ea1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-181321c6-b1c9-43db-9398-a48494777424 req-ad452913-6bb3-4aad-a4e3-88cb596a96fa service nova] Acquiring lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-181321c6-b1c9-43db-9398-a48494777424 req-ad452913-6bb3-4aad-a4e3-88cb596a96fa service nova] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-181321c6-b1c9-43db-9398-a48494777424 req-ad452913-6bb3-4aad-a4e3-88cb596a96fa service nova] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG nova.compute.manager [req-181321c6-b1c9-43db-9398-a48494777424 req-ad452913-6bb3-4aad-a4e3-88cb596a96fa service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] No waiting events found dispatching network-vif-plugged-f768a2c5-10b0-4442-9c76-3b2365a15ea1 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:30:31 user nova-compute[74821]: WARNING nova.compute.manager [req-181321c6-b1c9-43db-9398-a48494777424 req-ad452913-6bb3-4aad-a4e3-88cb596a96fa service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Received unexpected event network-vif-plugged-f768a2c5-10b0-4442-9c76-3b2365a15ea1 for instance with vm_state active and task_state resize_migrating.
Nov 06 13:30:31 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Starting finish_migration {{(pid=74821) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Instance directory exists: not creating {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 06 13:30:31 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Creating image(s)
Nov 06 13:30:31 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Did not create local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Ensure instance console log exists: /opt/stack/data/nova/instances/d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Start _get_guest_xml network_info=[{"id": "267248e7-6714-47b4-b1b2-1d94251305da", "address": "fa:16:3e:4e:3f:6c", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-161494849-network", "vif_mac": "fa:16:3e:4e:3f:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267248e7-67", "ovs_interfaceid": "267248e7-6714-47b4-b1b2-1d94251305da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrHLNeiI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'd508c34d-fd65-41b5-be8e-e7d5e3e0c1a8', 'attached_at': '2023-11-06T13:30:32.000000', 'detached_at': '', 'volume_id': '546db5ab-eb3b-46e2-a7e2-bf7fb31d6604', 'serial': '546db5ab-eb3b-46e2-a7e2-bf7fb31d6604'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '7f3f49d3-4e60-4e87-aa17-cc736cf0ecca', 'volume_type': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:30:31 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:30:31 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:30:31 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrHLNeiI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:30:31 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:30:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:30:31 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:30:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:30:31 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:30:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6f3e75-e0f6-499b-b96a-4c017e857ea7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:30:31 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4869bd95-3118-4d3c-bd64-99baa8af852a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604] added
Nov 06 13:30:31 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.044s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1a1e4a-5653-4b6f-98dc-a0d49313b520]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:30:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[07545aec-ca0d-427e-a0fe-9c2f98c1c41d]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BrHLNeiI {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BrHLNeiI" returned: 0 in 0.031s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a0e53f-36ea-454d-851d-ee79917fee24]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BrHLNeiI'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.039s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2792d8-a26a-4fff-a700-b26ca6e9762d]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[409685f4-8f37-4668-81b9-e4cf1030bfc6]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:30:32 user nova-compute[74821]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:30:32 user nova-compute[74821]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 (non-flash)
Nov 06 13:30:32 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:30:32 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:30:32 user nova-compute[74821]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:30:32 user nova-compute[74821]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 (non-flash)
Nov 06 13:30:32 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:30:32 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90a9a93-96ac-4403-8229-8d47233110ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604, portal: 172.16.0.220,3260]
Nov 06 13:30:32 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604, portal: 172.16.0.220,3260] successful.
Nov 06 13:30:32 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.041s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[65728116-f260-4281-bcc1-0cfc165577c2]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[090b962f-419d-461f-99f1-29994f684b6d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:30:32 user nova-compute[74821]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:30:32 user nova-compute[74821]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 (non-flash)
Nov 06 13:30:32 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:30:32 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:30:32 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:30:32 user nova-compute[74821]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:30:32 user nova-compute[74821]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 (non-flash)
Nov 06 13:30:32 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:30:32 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:30:32 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.419s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.343s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fcec26-cd37-410c-9fa4-8b284c85f309]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:30:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrHLNeiI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:30:33 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:30:33 user nova-compute[74821]: DEBUG nova.network.neutron [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Port f768a2c5-10b0-4442-9c76-3b2365a15ea1 binding to destination host user is already ACTIVE {{(pid=74821) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 06 13:30:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Acquiring lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:30:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:30:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:30:33 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.785s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:30:33 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] <== connect_volume: return (1787ms) {'type': 'block', 'scsi_wwn': '23164343361356138', 'path': '/dev/sdc'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:30:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164343361356138', 'path': '/dev/sdc'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:30:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Acquiring lock "refresh_cache-2d8da345-f66d-45c2-8ccd-d22fdf79a14d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:30:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Acquired lock "refresh_cache-2d8da345-f66d-45c2-8ccd-d22fdf79a14d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:30:33 user nova-compute[74821]: DEBUG nova.network.neutron [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:30:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:27:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-337626543',display_name='tempest-ServerActionsTestOtherA-server-337626543',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-337626543',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4JiUWhVtBLaIMVWmdaDGfPw0zGPPsGUpSPMYouFUdE8U/JVhpnD9HPYPDsmw237Zq0kahTjlP/cerosJ2tVPbLsi+XC2cHQjqtX7zMb9rwN9mSYsloUtu1O3SiQuCuOw==',key_name='tempest-keypair-1142367632',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:28:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='77233758870b4fdfbb7ca76829f0f82e',ramdisk_id='',reservation_id='r-ddppkv09',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1986828412',owner_user_name='tempest-ServerActionsTestOtherA-1986828412-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:29:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0620d1928d8d434fbe0bc1cdb31a2a89',uuid=d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "267248e7-6714-47b4-b1b2-1d94251305da", "address": "fa:16:3e:4e:3f:6c", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-161494849-network", "vif_mac": "fa:16:3e:4e:3f:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267248e7-67", "ovs_interfaceid": "267248e7-6714-47b4-b1b2-1d94251305da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:30:33 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Converting VIF {"id": "267248e7-6714-47b4-b1b2-1d94251305da", "address": "fa:16:3e:4e:3f:6c", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-161494849-network", "vif_mac": "fa:16:3e:4e:3f:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267248e7-67", "ovs_interfaceid": "267248e7-6714-47b4-b1b2-1d94251305da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:30:33 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:3f:6c,bridge_name='br-int',has_traffic_filtering=True,id=267248e7-6714-47b4-b1b2-1d94251305da,network=Network(a3838abe-b3bb-4878-9d5d-eb80a8cf60a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267248e7-67') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:30:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:30:33 user nova-compute[74821]:   <uuid>d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8</uuid>
Nov 06 13:30:33 user nova-compute[74821]:   <name>instance-00000022</name>
Nov 06 13:30:33 user nova-compute[74821]:   <memory>2097152</memory>
Nov 06 13:30:33 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:30:33 user nova-compute[74821]:   <metadata>
Nov 06 13:30:33 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:30:33 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:30:33 user nova-compute[74821]:       <nova:name>tempest-ServerActionsTestOtherA-server-337626543</nova:name>
Nov 06 13:30:33 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:30:31</nova:creationTime>
Nov 06 13:30:33 user nova-compute[74821]:       <nova:flavor name="m1.small">
Nov 06 13:30:33 user nova-compute[74821]:         <nova:memory>2048</nova:memory>
Nov 06 13:30:33 user nova-compute[74821]:         <nova:disk>20</nova:disk>
Nov 06 13:30:33 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:30:33 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:30:33 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:30:33 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:30:33 user nova-compute[74821]:       <nova:owner>
Nov 06 13:30:33 user nova-compute[74821]:         <nova:user uuid="0620d1928d8d434fbe0bc1cdb31a2a89">tempest-ServerActionsTestOtherA-1986828412-project-member</nova:user>
Nov 06 13:30:33 user nova-compute[74821]:         <nova:project uuid="77233758870b4fdfbb7ca76829f0f82e">tempest-ServerActionsTestOtherA-1986828412</nova:project>
Nov 06 13:30:33 user nova-compute[74821]:       </nova:owner>
Nov 06 13:30:33 user nova-compute[74821]:       <nova:ports>
Nov 06 13:30:33 user nova-compute[74821]:         <nova:port uuid="267248e7-6714-47b4-b1b2-1d94251305da">
Nov 06 13:30:33 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 13:30:33 user nova-compute[74821]:         </nova:port>
Nov 06 13:30:33 user nova-compute[74821]:       </nova:ports>
Nov 06 13:30:33 user nova-compute[74821]:     </nova:instance>
Nov 06 13:30:33 user nova-compute[74821]:   </metadata>
Nov 06 13:30:33 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:30:33 user nova-compute[74821]:     <system>
Nov 06 13:30:33 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:30:33 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:30:33 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:30:33 user nova-compute[74821]:       <entry name="serial">d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8</entry>
Nov 06 13:30:33 user nova-compute[74821]:       <entry name="uuid">d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8</entry>
Nov 06 13:30:33 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:30:33 user nova-compute[74821]:     </system>
Nov 06 13:30:33 user nova-compute[74821]:   </sysinfo>
Nov 06 13:30:33 user nova-compute[74821]:   <os>
Nov 06 13:30:33 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:30:33 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:30:33 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:30:33 user nova-compute[74821]:   </os>
Nov 06 13:30:33 user nova-compute[74821]:   <features>
Nov 06 13:30:33 user nova-compute[74821]:     <acpi/>
Nov 06 13:30:33 user nova-compute[74821]:     <apic/>
Nov 06 13:30:33 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:30:33 user nova-compute[74821]:   </features>
Nov 06 13:30:33 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:30:33 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:30:33 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:30:33 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:30:33 user nova-compute[74821]:   </clock>
Nov 06 13:30:33 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:30:33 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:30:33 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:30:33 user nova-compute[74821]:   </cpu>
Nov 06 13:30:33 user nova-compute[74821]:   <devices>
Nov 06 13:30:33 user nova-compute[74821]:     <disk type="block" device="disk">
Nov 06 13:30:33 user nova-compute[74821]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:30:33 user nova-compute[74821]:       <source dev="/dev/sdc"/>
Nov 06 13:30:33 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:30:33 user nova-compute[74821]:       <serial>546db5ab-eb3b-46e2-a7e2-bf7fb31d6604</serial>
Nov 06 13:30:33 user nova-compute[74821]:     </disk>
Nov 06 13:30:33 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:30:33 user nova-compute[74821]:       <mac address="fa:16:3e:4e:3f:6c"/>
Nov 06 13:30:33 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:30:33 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:30:33 user nova-compute[74821]:       <target dev="tap267248e7-67"/>
Nov 06 13:30:33 user nova-compute[74821]:     </interface>
Nov 06 13:30:33 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:30:33 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8/console.log" append="off"/>
Nov 06 13:30:33 user nova-compute[74821]:     </serial>
Nov 06 13:30:33 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:30:33 user nova-compute[74821]:     <video>
Nov 06 13:30:33 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:30:33 user nova-compute[74821]:     </video>
Nov 06 13:30:33 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:30:33 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:30:33 user nova-compute[74821]:     </rng>
Nov 06 13:30:33 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:30:33 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:30:33 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:30:33 user nova-compute[74821]:     </memballoon>
Nov 06 13:30:33 user nova-compute[74821]:   </devices>
Nov 06 13:30:33 user nova-compute[74821]: </domain>
Nov 06 13:30:33 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:30:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:27:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-337626543',display_name='tempest-ServerActionsTestOtherA-server-337626543',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-337626543',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4JiUWhVtBLaIMVWmdaDGfPw0zGPPsGUpSPMYouFUdE8U/JVhpnD9HPYPDsmw237Zq0kahTjlP/cerosJ2tVPbLsi+XC2cHQjqtX7zMb9rwN9mSYsloUtu1O3SiQuCuOw==',key_name='tempest-keypair-1142367632',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:28:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='77233758870b4fdfbb7ca76829f0f82e',ramdisk_id='',reservation_id='r-ddppkv09',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1986828412',owner_user_name='tempest-ServerActionsTestOtherA-1986828412-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:29:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0620d1928d8d434fbe0bc1cdb31a2a89',uuid=d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "267248e7-6714-47b4-b1b2-1d94251305da", "address": "fa:16:3e:4e:3f:6c", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-161494849-network", "vif_mac": "fa:16:3e:4e:3f:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267248e7-67", "ovs_interfaceid": "267248e7-6714-47b4-b1b2-1d94251305da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:30:33 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Converting VIF {"id": "267248e7-6714-47b4-b1b2-1d94251305da", "address": "fa:16:3e:4e:3f:6c", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-161494849-network", "vif_mac": "fa:16:3e:4e:3f:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267248e7-67", "ovs_interfaceid": "267248e7-6714-47b4-b1b2-1d94251305da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:30:33 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:3f:6c,bridge_name='br-int',has_traffic_filtering=True,id=267248e7-6714-47b4-b1b2-1d94251305da,network=Network(a3838abe-b3bb-4878-9d5d-eb80a8cf60a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267248e7-67') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:30:33 user nova-compute[74821]: DEBUG os_vif [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:3f:6c,bridge_name='br-int',has_traffic_filtering=True,id=267248e7-6714-47b4-b1b2-1d94251305da,network=Network(a3838abe-b3bb-4878-9d5d-eb80a8cf60a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267248e7-67') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:30:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:30:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:30:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6eca12e4-63e4-571d-9392-8a803400b771', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:30:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap267248e7-67, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:30:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap267248e7-67, col_values=(('qos', UUID('4ceeec57-61e8-445d-879f-bb53fcedb621')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:30:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap267248e7-67, col_values=(('external_ids', {'iface-id': '267248e7-6714-47b4-b1b2-1d94251305da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:3f:6c', 'vm-uuid': 'd508c34d-fd65-41b5-be8e-e7d5e3e0c1a8'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:30:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:30:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:33 user nova-compute[74821]: INFO os_vif [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:3f:6c,bridge_name='br-int',has_traffic_filtering=True,id=267248e7-6714-47b4-b1b2-1d94251305da,network=Network(a3838abe-b3bb-4878-9d5d-eb80a8cf60a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267248e7-67')
Nov 06 13:30:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:30:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] No VIF found with MAC fa:16:3e:4e:3f:6c, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:30:34 user nova-compute[74821]: DEBUG nova.network.neutron [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Updating instance_info_cache with network_info: [{"id": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "address": "fa:16:3e:69:f1:92", "network": {"id": "fc4369de-77c4-4f2f-a73c-d556ca3ff47c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1805761900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56107e2c08004a26a96765ec143a6d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf768a2c5-10", "ovs_interfaceid": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:30:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Releasing lock "refresh_cache-2d8da345-f66d-45c2-8ccd-d22fdf79a14d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:30:34 user nova-compute[74821]: DEBUG os_brick.utils [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:30:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:34 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84958e4-315e-4673-b2fa-ecd1ebc491d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:34 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f6bfc4-bf6a-4d7b-80d2-e7ef476a9357]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:34 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d042c833-1501-4a19-96a8-e09d48c30590]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:34 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[58735812-b368-4493-864a-6eb931651905]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:30:34 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:30:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:34 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:30:34 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:30:34 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0402f91a-e103-42c3-b5fe-c0c2070566d5]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:34 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:30:34 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:30:34 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:30:34 user nova-compute[74821]: DEBUG os_brick.utils [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:30:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:35 user nova-compute[74821]: DEBUG nova.compute.manager [req-c72385aa-9988-47e7-bb90-55fcf3167c80 req-27490e64-6653-43bc-a6c0-dab663735198 service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Received event network-vif-plugged-267248e7-6714-47b4-b1b2-1d94251305da {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:30:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c72385aa-9988-47e7-bb90-55fcf3167c80 req-27490e64-6653-43bc-a6c0-dab663735198 service nova] Acquiring lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:30:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c72385aa-9988-47e7-bb90-55fcf3167c80 req-27490e64-6653-43bc-a6c0-dab663735198 service nova] Lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:30:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c72385aa-9988-47e7-bb90-55fcf3167c80 req-27490e64-6653-43bc-a6c0-dab663735198 service nova] Lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:30:35 user nova-compute[74821]: DEBUG nova.compute.manager [req-c72385aa-9988-47e7-bb90-55fcf3167c80 req-27490e64-6653-43bc-a6c0-dab663735198 service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] No waiting events found dispatching network-vif-plugged-267248e7-6714-47b4-b1b2-1d94251305da {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:30:35 user nova-compute[74821]: WARNING nova.compute.manager [req-c72385aa-9988-47e7-bb90-55fcf3167c80 req-27490e64-6653-43bc-a6c0-dab663735198 service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Received unexpected event network-vif-plugged-267248e7-6714-47b4-b1b2-1d94251305da for instance with vm_state active and task_state resize_finish.
Nov 06 13:30:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:35 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:30:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:38 user nova-compute[74821]: DEBUG nova.compute.manager [req-c74773b9-7dcb-4521-9ac3-a08542cc4160 req-6771fbc3-4e63-4285-8049-24641eba170a service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Received event network-vif-plugged-267248e7-6714-47b4-b1b2-1d94251305da {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:30:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c74773b9-7dcb-4521-9ac3-a08542cc4160 req-6771fbc3-4e63-4285-8049-24641eba170a service nova] Acquiring lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:30:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c74773b9-7dcb-4521-9ac3-a08542cc4160 req-6771fbc3-4e63-4285-8049-24641eba170a service nova] Lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:30:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c74773b9-7dcb-4521-9ac3-a08542cc4160 req-6771fbc3-4e63-4285-8049-24641eba170a service nova] Lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:30:38 user nova-compute[74821]: DEBUG nova.compute.manager [req-c74773b9-7dcb-4521-9ac3-a08542cc4160 req-6771fbc3-4e63-4285-8049-24641eba170a service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] No waiting events found dispatching network-vif-plugged-267248e7-6714-47b4-b1b2-1d94251305da {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:30:38 user nova-compute[74821]: WARNING nova.compute.manager [req-c74773b9-7dcb-4521-9ac3-a08542cc4160 req-6771fbc3-4e63-4285-8049-24641eba170a service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Received unexpected event network-vif-plugged-267248e7-6714-47b4-b1b2-1d94251305da for instance with vm_state active and task_state resize_finish.
Nov 06 13:30:38 user nova-compute[74821]: DEBUG nova.compute.manager [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:30:38 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Instance running successfully.
Nov 06 13:30:38 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Failed to set time: agent not configured {{(pid=74821) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 06 13:30:38 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-4f9e5beb-2016-4eba-82e2-8af36d4f4316 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] finish_migration finished successfully. {{(pid=74821) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 06 13:30:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Acquiring lock "89b04a09-41d8-461f-8d14-bb3b9c72ed76" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:30:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "89b04a09-41d8-461f-8d14-bb3b9c72ed76" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:30:38 user nova-compute[74821]: INFO nova.compute.manager [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Detaching volume 52357f8d-a952-448e-9c2a-8714beae1815
Nov 06 13:30:38 user nova-compute[74821]: INFO nova.virt.block_device [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Attempting to driver detach volume 52357f8d-a952-448e-9c2a-8714beae1815 from mountpoint /dev/vdb
Nov 06 13:30:38 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Attempting to detach device vdb from instance 89b04a09-41d8-461f-8d14-bb3b9c72ed76 from the persistent domain config. {{(pid=74821) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 13:30:38 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:30:38 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:30:38 user nova-compute[74821]:   <source dev="/dev/sdg"/>
Nov 06 13:30:38 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:30:38 user nova-compute[74821]:   <serial>52357f8d-a952-448e-9c2a-8714beae1815</serial>
Nov 06 13:30:38 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:30:38 user nova-compute[74821]: </disk>
Nov 06 13:30:38 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:30:38 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Successfully detached device vdb from instance 89b04a09-41d8-461f-8d14-bb3b9c72ed76 from the persistent domain config.
Nov 06 13:30:38 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 89b04a09-41d8-461f-8d14-bb3b9c72ed76 from the live domain config. {{(pid=74821) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 13:30:38 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:30:38 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:30:38 user nova-compute[74821]:   <source dev="/dev/sdg"/>
Nov 06 13:30:38 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:30:38 user nova-compute[74821]:   <serial>52357f8d-a952-448e-9c2a-8714beae1815</serial>
Nov 06 13:30:38 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:30:38 user nova-compute[74821]: </disk>
Nov 06 13:30:38 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:30:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Acquiring lock "89b04a09-41d8-461f-8d14-bb3b9c72ed76" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:30:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:38 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 89b04a09-41d8-461f-8d14-bb3b9c72ed76 {{(pid=74821) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 13:30:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:40 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:30:40 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:30:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-496f8213-4b32-4211-a354-e33a4a088848" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:30:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-496f8213-4b32-4211-a354-e33a4a088848" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:30:41 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:30:41 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Updating instance_info_cache with network_info: [{"id": "0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc", "address": "fa:16:3e:de:d4:5d", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dbd0a11-07", "ovs_interfaceid": "0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:30:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-496f8213-4b32-4211-a354-e33a4a088848" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:30:41 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:30:41 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:30:41 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:30:41 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:30:42 user nova-compute[74821]: DEBUG nova.compute.manager [req-914b6dbc-1eee-4eec-9c13-99e21d91d0ee req-c8553a18-c286-47cd-9b54-7f308f203a98 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Received event network-changed-f35b642a-825f-4e17-9b97-3c8eba32a08e {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:30:42 user nova-compute[74821]: DEBUG nova.compute.manager [req-914b6dbc-1eee-4eec-9c13-99e21d91d0ee req-c8553a18-c286-47cd-9b54-7f308f203a98 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Refreshing instance network info cache due to event network-changed-f35b642a-825f-4e17-9b97-3c8eba32a08e. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:30:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-914b6dbc-1eee-4eec-9c13-99e21d91d0ee req-c8553a18-c286-47cd-9b54-7f308f203a98 service nova] Acquiring lock "refresh_cache-9cf1a0c3-4719-4637-a88d-e5864b2f1c3c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:30:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-914b6dbc-1eee-4eec-9c13-99e21d91d0ee req-c8553a18-c286-47cd-9b54-7f308f203a98 service nova] Acquired lock "refresh_cache-9cf1a0c3-4719-4637-a88d-e5864b2f1c3c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:30:42 user nova-compute[74821]: DEBUG nova.network.neutron [req-914b6dbc-1eee-4eec-9c13-99e21d91d0ee req-c8553a18-c286-47cd-9b54-7f308f203a98 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Refreshing network info cache for port f35b642a-825f-4e17-9b97-3c8eba32a08e {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:30:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Acquiring lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:30:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:30:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Acquiring lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:30:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:30:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:30:42 user nova-compute[74821]: INFO nova.compute.manager [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Terminating instance
Nov 06 13:30:42 user nova-compute[74821]: DEBUG nova.compute.manager [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:30:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:42 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:30:42 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG nova.network.neutron [req-914b6dbc-1eee-4eec-9c13-99e21d91d0ee req-c8553a18-c286-47cd-9b54-7f308f203a98 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Updated VIF entry in instance network info cache for port f35b642a-825f-4e17-9b97-3c8eba32a08e. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG nova.network.neutron [req-914b6dbc-1eee-4eec-9c13-99e21d91d0ee req-c8553a18-c286-47cd-9b54-7f308f203a98 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Updating instance_info_cache with network_info: [{"id": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "address": "fa:16:3e:3f:5e:be", "network": {"id": "20103956-1e64-4c7a-bed2-24edd5ae7724", "bridge": "br-int", "label": "tempest-TestShelveInstance-307843308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d32bd8dc1c9419b90607e20dfa5d50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35b642a-82", "ovs_interfaceid": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-914b6dbc-1eee-4eec-9c13-99e21d91d0ee req-c8553a18-c286-47cd-9b54-7f308f203a98 service nova] Releasing lock "refresh_cache-9cf1a0c3-4719-4637-a88d-e5864b2f1c3c" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG nova.compute.manager [req-c7bc0a64-6c48-49e8-914d-fbbfba749ec6 req-e2801f20-2c91-41d2-9ce5-7348d8035593 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Received event network-vif-unplugged-f35b642a-825f-4e17-9b97-3c8eba32a08e {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c7bc0a64-6c48-49e8-914d-fbbfba749ec6 req-e2801f20-2c91-41d2-9ce5-7348d8035593 service nova] Acquiring lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c7bc0a64-6c48-49e8-914d-fbbfba749ec6 req-e2801f20-2c91-41d2-9ce5-7348d8035593 service nova] Lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c7bc0a64-6c48-49e8-914d-fbbfba749ec6 req-e2801f20-2c91-41d2-9ce5-7348d8035593 service nova] Lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG nova.compute.manager [req-c7bc0a64-6c48-49e8-914d-fbbfba749ec6 req-e2801f20-2c91-41d2-9ce5-7348d8035593 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] No waiting events found dispatching network-vif-unplugged-f35b642a-825f-4e17-9b97-3c8eba32a08e {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG nova.compute.manager [req-c7bc0a64-6c48-49e8-914d-fbbfba749ec6 req-e2801f20-2c91-41d2-9ce5-7348d8035593 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Received event network-vif-unplugged-f35b642a-825f-4e17-9b97-3c8eba32a08e for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:30:43 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Instance destroyed successfully.
Nov 06 13:30:43 user nova-compute[74821]: DEBUG nova.objects.instance [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lazy-loading 'resources' on Instance uuid 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-06T13:24:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2121328163',display_name='tempest-TestShelveInstance-server-2121328163',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2121328163',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwfuvsbviphz947EVvwS0hBLH0hqkvelFZBVA/BbW13Na0YbmBH7ZF7KDI0Bt918tlo46Bl4nxkVdoSqlbR//uOE/jWGnGmLRd26zKs/LiEE+tlAwNPK69p2mKNICzRTw==',key_name='tempest-TestShelveInstance-1104151437',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:28:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d32bd8dc1c9419b90607e20dfa5d50b',ramdisk_id='',reservation_id='r-14h61fxg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-570916377',owner_user_name='tempest-TestShelveInstance-570916377-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:29:00Z,user_data=None,user_id='59d98c278c9349f3a010b526679a67b3',uuid=9cf1a0c3-4719-4637-a88d-e5864b2f1c3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "address": "fa:16:3e:3f:5e:be", "network": {"id": "20103956-1e64-4c7a-bed2-24edd5ae7724", "bridge": "br-int", "label": "tempest-TestShelveInstance-307843308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d32bd8dc1c9419b90607e20dfa5d50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35b642a-82", "ovs_interfaceid": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Converting VIF {"id": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "address": "fa:16:3e:3f:5e:be", "network": {"id": "20103956-1e64-4c7a-bed2-24edd5ae7724", "bridge": "br-int", "label": "tempest-TestShelveInstance-307843308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d32bd8dc1c9419b90607e20dfa5d50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf35b642a-82", "ovs_interfaceid": "f35b642a-825f-4e17-9b97-3c8eba32a08e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:5e:be,bridge_name='br-int',has_traffic_filtering=True,id=f35b642a-825f-4e17-9b97-3c8eba32a08e,network=Network(20103956-1e64-4c7a-bed2-24edd5ae7724),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf35b642a-82') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG os_vif [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:5e:be,bridge_name='br-int',has_traffic_filtering=True,id=f35b642a-825f-4e17-9b97-3c8eba32a08e,network=Network(20103956-1e64-4c7a-bed2-24edd5ae7724),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf35b642a-82') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf35b642a-82, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05e6b6da-d740-4cda-a2ee-f01e30471aef) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:43 user nova-compute[74821]: INFO os_vif [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:5e:be,bridge_name='br-int',has_traffic_filtering=True,id=f35b642a-825f-4e17-9b97-3c8eba32a08e,network=Network(20103956-1e64-4c7a-bed2-24edd5ae7724),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf35b642a-82')
Nov 06 13:30:43 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VqnwLbMR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:30:43 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:30:43 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb78f022-8eb4-42bc-a3cc-7eab53cda602]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:30:43 user nova-compute[74821]: No targets found.
Nov 06 13:30:43 user nova-compute[74821]: iSNS:
Nov 06 13:30:43 user nova-compute[74821]: No targets found.
Nov 06 13:30:43 user nova-compute[74821]: STATIC:
Nov 06 13:30:43 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af
Nov 06 13:30:43 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:30:43 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:30:43 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604
Nov 06 13:30:43 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:30:43 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:30:43 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f
Nov 06 13:30:43 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:30:43 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:30:43 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979
Nov 06 13:30:43 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:30:43 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:30:43 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815
Nov 06 13:30:43 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:30:43 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:30:43 user nova-compute[74821]: FIRMWARE:
Nov 06 13:30:43 user nova-compute[74821]: No targets found.
Nov 06 13:30:43 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:30:43 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:30:43 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c5f92c-1811-4fe6-b148-e8f125a15530]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[978f9451-8df7-4bff-b07a-ab197f59c6ca]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:30:43 user nova-compute[74821]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:30:43 user nova-compute[74821]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 (non-flash)
Nov 06 13:30:43 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:30:43 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:30:43 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:30:43 user nova-compute[74821]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af (non-flash)
Nov 06 13:30:43 user nova-compute[74821]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 (non-flash)
Nov 06 13:30:43 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:30:43 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:30:43 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e40631120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af'): ({'sdf'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Removing single pathed devices sdf {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1329ab13-8de9-4617-9a44-fa98267b1d6b]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.042s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfeef3c-f9de-4bbe-9812-2573b9c29e13]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Flushing IO for device /dev/sdf {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2aba5b-b625-4ae8-9cf4-ebfaec697e66]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.073s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[df016610-868d-4ae4-a650-43e18f1d274a]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] SCSI volumes sdf have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23335313566373062', '/dev/disk/by-id/scsi-1SCST_BIO21c1a7b7-3515f70b3e21deb8', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_21c1a7b7') {{(pid=85818) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 06 13:30:43 user nova-compute[74821]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23335313566373062
Nov 06 13:30:43 user nova-compute[74821]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO21c1a7b7-3515f70b3e21deb8
Nov 06 13:30:43 user nova-compute[74821]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_21c1a7b7
Nov 06 13:30:43 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b220c33-34e5-43ec-83f9-07206e24ef5b]: (4, None) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad7fb31-cff6-4d37-b748-90848e704479]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[64604b2c-746c-4a9e-9948-e951faa59f81]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af, portal: 172.16.0.220,3260]
Nov 06 13:30:43 user nova-compute[74821]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af, portal: 172.16.0.220,3260] successful.
Nov 06 13:30:43 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be4ce8c2-20da-4129-903f-4487642101af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dacc0b5-da02-4651-9cee-e33db5aa100f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.512s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] <== disconnect_volume: return (514ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:30:43 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:30:43 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Deleting instance files /opt/stack/data/nova/instances/9cf1a0c3-4719-4637-a88d-e5864b2f1c3c_del
Nov 06 13:30:43 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Deletion of /opt/stack/data/nova/instances/9cf1a0c3-4719-4637-a88d-e5864b2f1c3c_del complete
Nov 06 13:30:44 user nova-compute[74821]: INFO nova.compute.manager [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Took 1.56 seconds to destroy the instance on the hypervisor.
Nov 06 13:30:44 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:30:44 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:30:44 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:30:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:45 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:30:45 user nova-compute[74821]: DEBUG nova.compute.manager [req-75cdca3c-bc69-4120-b8f0-c488901e2140 req-9768103c-20a5-4815-8a3f-b47aa7eb06b4 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Received event network-vif-plugged-f35b642a-825f-4e17-9b97-3c8eba32a08e {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:30:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-75cdca3c-bc69-4120-b8f0-c488901e2140 req-9768103c-20a5-4815-8a3f-b47aa7eb06b4 service nova] Acquiring lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:30:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-75cdca3c-bc69-4120-b8f0-c488901e2140 req-9768103c-20a5-4815-8a3f-b47aa7eb06b4 service nova] Lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:30:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-75cdca3c-bc69-4120-b8f0-c488901e2140 req-9768103c-20a5-4815-8a3f-b47aa7eb06b4 service nova] Lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:30:45 user nova-compute[74821]: DEBUG nova.compute.manager [req-75cdca3c-bc69-4120-b8f0-c488901e2140 req-9768103c-20a5-4815-8a3f-b47aa7eb06b4 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] No waiting events found dispatching network-vif-plugged-f35b642a-825f-4e17-9b97-3c8eba32a08e {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:30:45 user nova-compute[74821]: WARNING nova.compute.manager [req-75cdca3c-bc69-4120-b8f0-c488901e2140 req-9768103c-20a5-4815-8a3f-b47aa7eb06b4 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Received unexpected event network-vif-plugged-f35b642a-825f-4e17-9b97-3c8eba32a08e for instance with vm_state active and task_state deleting.
Nov 06 13:30:45 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Took 1.33 seconds to deallocate network for instance.
Nov 06 13:30:45 user nova-compute[74821]: DEBUG nova.compute.manager [req-5926b889-9b21-4525-baec-78e08bd0a323 req-f0e8e7f7-9e1a-4e4c-915c-5c623eaa5d26 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Received event network-vif-deleted-f35b642a-825f-4e17-9b97-3c8eba32a08e {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:30:45 user nova-compute[74821]: INFO nova.compute.manager [req-5926b889-9b21-4525-baec-78e08bd0a323 req-f0e8e7f7-9e1a-4e4c-915c-5c623eaa5d26 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Neutron deleted interface f35b642a-825f-4e17-9b97-3c8eba32a08e; detaching it from the instance and deleting it from the info cache
Nov 06 13:30:45 user nova-compute[74821]: DEBUG nova.network.neutron [req-5926b889-9b21-4525-baec-78e08bd0a323 req-f0e8e7f7-9e1a-4e4c-915c-5c623eaa5d26 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:30:45 user nova-compute[74821]: DEBUG nova.compute.manager [req-5926b889-9b21-4525-baec-78e08bd0a323 req-f0e8e7f7-9e1a-4e4c-915c-5c623eaa5d26 service nova] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Detach interface failed, port_id=f35b642a-825f-4e17-9b97-3c8eba32a08e, reason: Instance 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c could not be found. {{(pid=74821) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 13:30:46 user nova-compute[74821]: INFO nova.compute.manager [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Took 1.08 seconds to detach 1 volumes for instance.
Nov 06 13:30:46 user nova-compute[74821]: DEBUG nova.compute.manager [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] [instance: 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c] Deleting volume: be4ce8c2-20da-4129-903f-4487642101af {{(pid=74821) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 06 13:30:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:30:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:30:46 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:30:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:30:47 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:30:47 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:30:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.606s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:30:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.311s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:30:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:30:47 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:30:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:47 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Deleted allocations for instance 9cf1a0c3-4719-4637-a88d-e5864b2f1c3c
Nov 06 13:30:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e06586cf-a512-4882-86d6-84317617cc25 tempest-TestShelveInstance-570916377 tempest-TestShelveInstance-570916377-project-member] Lock "9cf1a0c3-4719-4637-a88d-e5864b2f1c3c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.953s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:30:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:30:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b04a09-41d8-461f-8d14-bb3b9c72ed76/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b04a09-41d8-461f-8d14-bb3b9c72ed76/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b04a09-41d8-461f-8d14-bb3b9c72ed76/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89b04a09-41d8-461f-8d14-bb3b9c72ed76/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:30:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:48 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.350s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e80a3f77-8f29-4f18-9707-c9793a124cc6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e80a3f77-8f29-4f18-9707-c9793a124cc6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e80a3f77-8f29-4f18-9707-c9793a124cc6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e80a3f77-8f29-4f18-9707-c9793a124cc6/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:30:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:30:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:51 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:30:51 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:30:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=7593MB free_disk=24.912776947021484GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:30:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:30:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:30:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Applying migration context for instance d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8 as it has an incoming, in-progress migration adaac260-5214-4b8e-952e-65a22f39b3da. Migration status is finished {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 06 13:30:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Applying migration context for instance 2d8da345-f66d-45c2-8ccd-d22fdf79a14d as it has an incoming, in-progress migration f36ec03b-bcd7-43fc-b827-f385033a26f4. Migration status is post-migrating {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 06 13:30:51 user nova-compute[74821]: INFO nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Updating resource usage from migration adaac260-5214-4b8e-952e-65a22f39b3da
Nov 06 13:30:51 user nova-compute[74821]: INFO nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Updating resource usage from migration f36ec03b-bcd7-43fc-b827-f385033a26f4
Nov 06 13:30:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 2de346cb-9858-47b8-a86c-4fde720d6127 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:30:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 49c65aca-8392-46ba-8fa3-b47ff2416cb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:30:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 496f8213-4b32-4211-a354-e33a4a088848 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:30:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 1290bdb3-827f-4365-a4f1-4ae063de780d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:30:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 4bc6444e-b55d-4d81-88d1-f4d147255119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:30:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 89b04a09-41d8-461f-8d14-bb3b9c72ed76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:30:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 64ae6f5e-38a1-4871-8015-c2097f64b33b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:30:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 6121ff1a-d276-485f-85f8-ba451f5b0d37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:30:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Migration adaac260-5214-4b8e-952e-65a22f39b3da is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 06 13:30:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:30:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance e80a3f77-8f29-4f18-9707-c9793a124cc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:30:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Migration f36ec03b-bcd7-43fc-b827-f385033a26f4 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 06 13:30:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 2d8da345-f66d-45c2-8ccd-d22fdf79a14d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:30:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:30:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=10240MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:30:52 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:30:52 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:30:52 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:30:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.694s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:30:53 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:30:53 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:30:53 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Acquiring lock "6f2a94d6-c16f-4f1f-a627-66e0dddc1615" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:30:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Lock "6f2a94d6-c16f-4f1f-a627-66e0dddc1615" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:30:54 user nova-compute[74821]: DEBUG nova.compute.manager [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:30:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:30:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:30:54 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:30:54 user nova-compute[74821]: INFO nova.compute.claims [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Claim successful on node user
Nov 06 13:30:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:54 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:30:54 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:30:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.551s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:30:54 user nova-compute[74821]: DEBUG nova.compute.manager [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:30:54 user nova-compute[74821]: DEBUG nova.compute.manager [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:30:54 user nova-compute[74821]: DEBUG nova.network.neutron [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:30:54 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:30:54 user nova-compute[74821]: DEBUG nova.compute.manager [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:30:55 user nova-compute[74821]: DEBUG nova.policy [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e9ebc4729972430f8840859070fefc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73b4663a8c224eac879b6c6694396624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:30:55 user nova-compute[74821]: DEBUG nova.compute.manager [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:30:55 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:30:55 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Creating image(s)
Nov 06 13:30:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f2a94d6-c16f-4f1f-a627-66e0dddc1615/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:30:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Lock "/opt/stack/data/nova/instances/6f2a94d6-c16f-4f1f-a627-66e0dddc1615/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:30:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Lock "/opt/stack/data/nova/instances/6f2a94d6-c16f-4f1f-a627-66e0dddc1615/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:30:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.176s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:30:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:30:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.186s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/6f2a94d6-c16f-4f1f-a627-66e0dddc1615/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/6f2a94d6-c16f-4f1f-a627-66e0dddc1615/disk 1073741824" returned: 0 in 0.081s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:30:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.167s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:55 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f2a94d6-c16f-4f1f-a627-66e0dddc1615/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:30:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2a94d6-c16f-4f1f-a627-66e0dddc1615/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:55 user nova-compute[74821]: DEBUG nova.network.neutron [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Successfully created port: 8e9606b7-8bbe-47bc-87ac-03dd9f6fe085 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:30:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2a94d6-c16f-4f1f-a627-66e0dddc1615/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:55 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Cannot resize image /opt/stack/data/nova/instances/6f2a94d6-c16f-4f1f-a627-66e0dddc1615/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:30:55 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:30:55 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Ensure instance console log exists: /opt/stack/data/nova/instances/6f2a94d6-c16f-4f1f-a627-66e0dddc1615/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:30:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:30:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:30:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:30:56 user nova-compute[74821]: DEBUG nova.network.neutron [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Successfully updated port: 8e9606b7-8bbe-47bc-87ac-03dd9f6fe085 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:30:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Acquiring lock "refresh_cache-6f2a94d6-c16f-4f1f-a627-66e0dddc1615" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:30:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Acquired lock "refresh_cache-6f2a94d6-c16f-4f1f-a627-66e0dddc1615" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:30:56 user nova-compute[74821]: DEBUG nova.network.neutron [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:30:56 user nova-compute[74821]: DEBUG nova.compute.manager [req-d7fe9a93-3da5-48ab-8d15-63edad5a78e9 req-ccbde8dc-e658-44a5-a8d8-b158648c8128 service nova] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Received event network-changed-8e9606b7-8bbe-47bc-87ac-03dd9f6fe085 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:30:56 user nova-compute[74821]: DEBUG nova.compute.manager [req-d7fe9a93-3da5-48ab-8d15-63edad5a78e9 req-ccbde8dc-e658-44a5-a8d8-b158648c8128 service nova] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Refreshing instance network info cache due to event network-changed-8e9606b7-8bbe-47bc-87ac-03dd9f6fe085. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:30:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d7fe9a93-3da5-48ab-8d15-63edad5a78e9 req-ccbde8dc-e658-44a5-a8d8-b158648c8128 service nova] Acquiring lock "refresh_cache-6f2a94d6-c16f-4f1f-a627-66e0dddc1615" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:30:56 user nova-compute[74821]: DEBUG nova.network.neutron [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:30:56 user nova-compute[74821]: DEBUG nova.network.neutron [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Updating instance_info_cache with network_info: [{"id": "8e9606b7-8bbe-47bc-87ac-03dd9f6fe085", "address": "fa:16:3e:61:68:32", "network": {"id": "c4011ab9-7e5a-47da-a1f3-9fe74acc3b8f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1383136864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73b4663a8c224eac879b6c6694396624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9606b7-8b", "ovs_interfaceid": "8e9606b7-8bbe-47bc-87ac-03dd9f6fe085", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:30:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Releasing lock "refresh_cache-6f2a94d6-c16f-4f1f-a627-66e0dddc1615" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:30:56 user nova-compute[74821]: DEBUG nova.compute.manager [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Instance network_info: |[{"id": "8e9606b7-8bbe-47bc-87ac-03dd9f6fe085", "address": "fa:16:3e:61:68:32", "network": {"id": "c4011ab9-7e5a-47da-a1f3-9fe74acc3b8f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1383136864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73b4663a8c224eac879b6c6694396624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9606b7-8b", "ovs_interfaceid": "8e9606b7-8bbe-47bc-87ac-03dd9f6fe085", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:30:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d7fe9a93-3da5-48ab-8d15-63edad5a78e9 req-ccbde8dc-e658-44a5-a8d8-b158648c8128 service nova] Acquired lock "refresh_cache-6f2a94d6-c16f-4f1f-a627-66e0dddc1615" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:30:56 user nova-compute[74821]: DEBUG nova.network.neutron [req-d7fe9a93-3da5-48ab-8d15-63edad5a78e9 req-ccbde8dc-e658-44a5-a8d8-b158648c8128 service nova] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Refreshing network info cache for port 8e9606b7-8bbe-47bc-87ac-03dd9f6fe085 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:30:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Start _get_guest_xml network_info=[{"id": "8e9606b7-8bbe-47bc-87ac-03dd9f6fe085", "address": "fa:16:3e:61:68:32", "network": {"id": "c4011ab9-7e5a-47da-a1f3-9fe74acc3b8f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1383136864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73b4663a8c224eac879b6c6694396624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9606b7-8b", "ovs_interfaceid": "8e9606b7-8bbe-47bc-87ac-03dd9f6fe085", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:30:56 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:30:56 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:30:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:30:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:30:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:30:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:30:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:30:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:30:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:30:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:30:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:30:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:30:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:30:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:30:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:30:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:30:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:30:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:30:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1604097736',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1604097736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1604097',id=38,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHR0UbT3l0QsZBv6NXwoSEa+gjEMIzs04Fs9zmLKsHExr3ZjcYzxy4eeY1/41GxzLYiNnG+faltY50eUqgB7I8UMM0OxDyuFw8vHSygWEp5pzmoF1xLoskcpiAMmCyg2hQ==',key_name='tempest-keypair-1757829620',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73b4663a8c224eac879b6c6694396624',ramdisk_id='',reservation_id='r-xgtdt4m8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1833933965',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:30:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9ebc4729972430f8840859070fefc37',uuid=6f2a94d6-c16f-4f1f-a627-66e0dddc1615,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e9606b7-8bbe-47bc-87ac-03dd9f6fe085", "address": "fa:16:3e:61:68:32", "network": {"id": "c4011ab9-7e5a-47da-a1f3-9fe74acc3b8f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1383136864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73b4663a8c224eac879b6c6694396624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9606b7-8b", "ovs_interfaceid": "8e9606b7-8bbe-47bc-87ac-03dd9f6fe085", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:30:56 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Converting VIF {"id": "8e9606b7-8bbe-47bc-87ac-03dd9f6fe085", "address": "fa:16:3e:61:68:32", "network": {"id": "c4011ab9-7e5a-47da-a1f3-9fe74acc3b8f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1383136864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73b4663a8c224eac879b6c6694396624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9606b7-8b", "ovs_interfaceid": "8e9606b7-8bbe-47bc-87ac-03dd9f6fe085", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:30:56 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:68:32,bridge_name='br-int',has_traffic_filtering=True,id=8e9606b7-8bbe-47bc-87ac-03dd9f6fe085,network=Network(c4011ab9-7e5a-47da-a1f3-9fe74acc3b8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e9606b7-8b') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:30:56 user nova-compute[74821]: DEBUG nova.objects.instance [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f2a94d6-c16f-4f1f-a627-66e0dddc1615 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:30:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:30:57 user nova-compute[74821]:   <uuid>6f2a94d6-c16f-4f1f-a627-66e0dddc1615</uuid>
Nov 06 13:30:57 user nova-compute[74821]:   <name>instance-00000026</name>
Nov 06 13:30:57 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:30:57 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:30:57 user nova-compute[74821]:   <metadata>
Nov 06 13:30:57 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:30:57 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:30:57 user nova-compute[74821]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1604097736</nova:name>
Nov 06 13:30:57 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:30:56</nova:creationTime>
Nov 06 13:30:57 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:30:57 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:30:57 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:30:57 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:30:57 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:30:57 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:30:57 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:30:57 user nova-compute[74821]:       <nova:owner>
Nov 06 13:30:57 user nova-compute[74821]:         <nova:user uuid="e9ebc4729972430f8840859070fefc37">tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member</nova:user>
Nov 06 13:30:57 user nova-compute[74821]:         <nova:project uuid="73b4663a8c224eac879b6c6694396624">tempest-TestServerVolumeAttachScenarioOldVersion-1833933965</nova:project>
Nov 06 13:30:57 user nova-compute[74821]:       </nova:owner>
Nov 06 13:30:57 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:30:57 user nova-compute[74821]:       <nova:ports>
Nov 06 13:30:57 user nova-compute[74821]:         <nova:port uuid="8e9606b7-8bbe-47bc-87ac-03dd9f6fe085">
Nov 06 13:30:57 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 06 13:30:57 user nova-compute[74821]:         </nova:port>
Nov 06 13:30:57 user nova-compute[74821]:       </nova:ports>
Nov 06 13:30:57 user nova-compute[74821]:     </nova:instance>
Nov 06 13:30:57 user nova-compute[74821]:   </metadata>
Nov 06 13:30:57 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:30:57 user nova-compute[74821]:     <system>
Nov 06 13:30:57 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:30:57 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:30:57 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:30:57 user nova-compute[74821]:       <entry name="serial">6f2a94d6-c16f-4f1f-a627-66e0dddc1615</entry>
Nov 06 13:30:57 user nova-compute[74821]:       <entry name="uuid">6f2a94d6-c16f-4f1f-a627-66e0dddc1615</entry>
Nov 06 13:30:57 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:30:57 user nova-compute[74821]:     </system>
Nov 06 13:30:57 user nova-compute[74821]:   </sysinfo>
Nov 06 13:30:57 user nova-compute[74821]:   <os>
Nov 06 13:30:57 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:30:57 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:30:57 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:30:57 user nova-compute[74821]:   </os>
Nov 06 13:30:57 user nova-compute[74821]:   <features>
Nov 06 13:30:57 user nova-compute[74821]:     <acpi/>
Nov 06 13:30:57 user nova-compute[74821]:     <apic/>
Nov 06 13:30:57 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:30:57 user nova-compute[74821]:   </features>
Nov 06 13:30:57 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:30:57 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:30:57 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:30:57 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:30:57 user nova-compute[74821]:   </clock>
Nov 06 13:30:57 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:30:57 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:30:57 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:30:57 user nova-compute[74821]:   </cpu>
Nov 06 13:30:57 user nova-compute[74821]:   <devices>
Nov 06 13:30:57 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:30:57 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:30:57 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/6f2a94d6-c16f-4f1f-a627-66e0dddc1615/disk"/>
Nov 06 13:30:57 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:30:57 user nova-compute[74821]:     </disk>
Nov 06 13:30:57 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:30:57 user nova-compute[74821]:       <mac address="fa:16:3e:61:68:32"/>
Nov 06 13:30:57 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:30:57 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:30:57 user nova-compute[74821]:       <target dev="tap8e9606b7-8b"/>
Nov 06 13:30:57 user nova-compute[74821]:     </interface>
Nov 06 13:30:57 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:30:57 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/6f2a94d6-c16f-4f1f-a627-66e0dddc1615/console.log" append="off"/>
Nov 06 13:30:57 user nova-compute[74821]:     </serial>
Nov 06 13:30:57 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:30:57 user nova-compute[74821]:     <video>
Nov 06 13:30:57 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:30:57 user nova-compute[74821]:     </video>
Nov 06 13:30:57 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:30:57 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:30:57 user nova-compute[74821]:     </rng>
Nov 06 13:30:57 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:30:57 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:30:57 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:30:57 user nova-compute[74821]:     </memballoon>
Nov 06 13:30:57 user nova-compute[74821]:   </devices>
Nov 06 13:30:57 user nova-compute[74821]: </domain>
Nov 06 13:30:57 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:30:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1604097736',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1604097736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1604097',id=38,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHR0UbT3l0QsZBv6NXwoSEa+gjEMIzs04Fs9zmLKsHExr3ZjcYzxy4eeY1/41GxzLYiNnG+faltY50eUqgB7I8UMM0OxDyuFw8vHSygWEp5pzmoF1xLoskcpiAMmCyg2hQ==',key_name='tempest-keypair-1757829620',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73b4663a8c224eac879b6c6694396624',ramdisk_id='',reservation_id='r-xgtdt4m8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1833933965',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:30:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9ebc4729972430f8840859070fefc37',uuid=6f2a94d6-c16f-4f1f-a627-66e0dddc1615,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e9606b7-8bbe-47bc-87ac-03dd9f6fe085", "address": "fa:16:3e:61:68:32", "network": {"id": "c4011ab9-7e5a-47da-a1f3-9fe74acc3b8f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1383136864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73b4663a8c224eac879b6c6694396624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9606b7-8b", "ovs_interfaceid": "8e9606b7-8bbe-47bc-87ac-03dd9f6fe085", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:30:57 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Converting VIF {"id": "8e9606b7-8bbe-47bc-87ac-03dd9f6fe085", "address": "fa:16:3e:61:68:32", "network": {"id": "c4011ab9-7e5a-47da-a1f3-9fe74acc3b8f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1383136864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73b4663a8c224eac879b6c6694396624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9606b7-8b", "ovs_interfaceid": "8e9606b7-8bbe-47bc-87ac-03dd9f6fe085", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:30:57 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:68:32,bridge_name='br-int',has_traffic_filtering=True,id=8e9606b7-8bbe-47bc-87ac-03dd9f6fe085,network=Network(c4011ab9-7e5a-47da-a1f3-9fe74acc3b8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e9606b7-8b') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:30:57 user nova-compute[74821]: DEBUG os_vif [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:68:32,bridge_name='br-int',has_traffic_filtering=True,id=8e9606b7-8bbe-47bc-87ac-03dd9f6fe085,network=Network(c4011ab9-7e5a-47da-a1f3-9fe74acc3b8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e9606b7-8b') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:30:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:30:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:30:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '14d3ffd7-33b3-54a0-b532-51bcd0ec8573', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:30:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e9606b7-8b, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:30:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8e9606b7-8b, col_values=(('qos', UUID('437dd0cd-ce51-4cd4-9965-347a5f8fe562')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:30:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8e9606b7-8b, col_values=(('external_ids', {'iface-id': '8e9606b7-8bbe-47bc-87ac-03dd9f6fe085', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:68:32', 'vm-uuid': '6f2a94d6-c16f-4f1f-a627-66e0dddc1615'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:30:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:30:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:57 user nova-compute[74821]: INFO os_vif [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:68:32,bridge_name='br-int',has_traffic_filtering=True,id=8e9606b7-8bbe-47bc-87ac-03dd9f6fe085,network=Network(c4011ab9-7e5a-47da-a1f3-9fe74acc3b8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e9606b7-8b')
Nov 06 13:30:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:30:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] No VIF found with MAC fa:16:3e:61:68:32, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:30:57 user nova-compute[74821]: DEBUG nova.network.neutron [req-d7fe9a93-3da5-48ab-8d15-63edad5a78e9 req-ccbde8dc-e658-44a5-a8d8-b158648c8128 service nova] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Updated VIF entry in instance network info cache for port 8e9606b7-8bbe-47bc-87ac-03dd9f6fe085. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:30:57 user nova-compute[74821]: DEBUG nova.network.neutron [req-d7fe9a93-3da5-48ab-8d15-63edad5a78e9 req-ccbde8dc-e658-44a5-a8d8-b158648c8128 service nova] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Updating instance_info_cache with network_info: [{"id": "8e9606b7-8bbe-47bc-87ac-03dd9f6fe085", "address": "fa:16:3e:61:68:32", "network": {"id": "c4011ab9-7e5a-47da-a1f3-9fe74acc3b8f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1383136864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73b4663a8c224eac879b6c6694396624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9606b7-8b", "ovs_interfaceid": "8e9606b7-8bbe-47bc-87ac-03dd9f6fe085", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:30:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d7fe9a93-3da5-48ab-8d15-63edad5a78e9 req-ccbde8dc-e658-44a5-a8d8-b158648c8128 service nova] Releasing lock "refresh_cache-6f2a94d6-c16f-4f1f-a627-66e0dddc1615" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:30:58 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:58 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:58 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:58 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:58 user nova-compute[74821]: DEBUG nova.compute.manager [req-9bc95350-018b-4a0b-b778-7ffc23741655 req-505f0095-e64f-4c7d-9287-8c083d2b5877 service nova] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Received event network-vif-plugged-8e9606b7-8bbe-47bc-87ac-03dd9f6fe085 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:30:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-9bc95350-018b-4a0b-b778-7ffc23741655 req-505f0095-e64f-4c7d-9287-8c083d2b5877 service nova] Acquiring lock "6f2a94d6-c16f-4f1f-a627-66e0dddc1615-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:30:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-9bc95350-018b-4a0b-b778-7ffc23741655 req-505f0095-e64f-4c7d-9287-8c083d2b5877 service nova] Lock "6f2a94d6-c16f-4f1f-a627-66e0dddc1615-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:30:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-9bc95350-018b-4a0b-b778-7ffc23741655 req-505f0095-e64f-4c7d-9287-8c083d2b5877 service nova] Lock "6f2a94d6-c16f-4f1f-a627-66e0dddc1615-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:30:58 user nova-compute[74821]: DEBUG nova.compute.manager [req-9bc95350-018b-4a0b-b778-7ffc23741655 req-505f0095-e64f-4c7d-9287-8c083d2b5877 service nova] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] No waiting events found dispatching network-vif-plugged-8e9606b7-8bbe-47bc-87ac-03dd9f6fe085 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:30:58 user nova-compute[74821]: WARNING nova.compute.manager [req-9bc95350-018b-4a0b-b778-7ffc23741655 req-505f0095-e64f-4c7d-9287-8c083d2b5877 service nova] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Received unexpected event network-vif-plugged-8e9606b7-8bbe-47bc-87ac-03dd9f6fe085 for instance with vm_state building and task_state spawning.
Nov 06 13:30:58 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 89b04a09-41d8-461f-8d14-bb3b9c72ed76 is timed out.
Nov 06 13:30:58 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Successfully detached device vdb from instance 89b04a09-41d8-461f-8d14-bb3b9c72ed76 from the live domain config.
Nov 06 13:30:58 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:30:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'piPIlZHh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:30:58 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:30:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:30:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:30:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:58 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[37275c5c-bc26-459e-b0b7-e81838390df6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:30:58 user nova-compute[74821]: No targets found.
Nov 06 13:30:58 user nova-compute[74821]: iSNS:
Nov 06 13:30:58 user nova-compute[74821]: No targets found.
Nov 06 13:30:58 user nova-compute[74821]: STATIC:
Nov 06 13:30:58 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604
Nov 06 13:30:58 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:30:58 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:30:58 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f
Nov 06 13:30:58 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:30:58 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:30:58 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979
Nov 06 13:30:58 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:30:58 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:30:58 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815
Nov 06 13:30:58 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:30:58 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:30:58 user nova-compute[74821]: FIRMWARE:
Nov 06 13:30:58 user nova-compute[74821]: No targets found.
Nov 06 13:30:58 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:30:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:30:58 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:30:58 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:30:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:30:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:58 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5e729b-d78d-4d40-b845-2c91c3f5a61e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:58 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf041ed-46c6-4231-8f50-2694661517a0]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:30:58 user nova-compute[74821]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 (non-flash)
Nov 06 13:30:58 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:30:58 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:30:58 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:30:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:30:58 user nova-compute[74821]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 (non-flash)
Nov 06 13:30:58 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:30:58 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:30:58 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e50331000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815'): ({'sdg'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Removing single pathed devices sdg {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa92cf9-9b68-4128-a67f-8bc7a8257cd6]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2cb005-4f77-4052-a932-3c8cfac5fa75]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Flushing IO for device /dev/sdg {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eec5f13-385c-4b4d-945b-ebf79e0a96f4]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.058s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51bd1da-e9a8-4084-bac6-2cabeea611bd]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] SCSI volumes sdg have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e040a369-66c7-489f-9a02-96fd710210ba]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5323ceeb-e89f-410a-b791-af1d148df251]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815, portal: 172.16.0.220,3260]
Nov 06 13:30:59 user nova-compute[74821]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815, portal: 172.16.0.220,3260] successful.
Nov 06 13:30:59 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[22979600-4d14-4378-a850-2053cb6a8d35]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] <== disconnect_volume: return (407ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:30:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:00 user nova-compute[74821]: DEBUG nova.objects.instance [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lazy-loading 'flavor' on Instance uuid 89b04a09-41d8-461f-8d14-bb3b9c72ed76 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:31:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c88c6c56-25ab-4764-94dc-19ac2340f0ec tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "89b04a09-41d8-461f-8d14-bb3b9c72ed76" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.146s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:31:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "89b04a09-41d8-461f-8d14-bb3b9c72ed76" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.947s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:31:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Acquiring lock "89b04a09-41d8-461f-8d14-bb3b9c72ed76-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:31:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "89b04a09-41d8-461f-8d14-bb3b9c72ed76-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:31:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "89b04a09-41d8-461f-8d14-bb3b9c72ed76-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:31:00 user nova-compute[74821]: INFO nova.compute.manager [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Terminating instance
Nov 06 13:31:00 user nova-compute[74821]: DEBUG nova.compute.manager [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:31:00 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:00 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:00 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:00 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:00 user nova-compute[74821]: DEBUG nova.compute.manager [req-5dab9e0b-cbbc-4610-bc9b-ec497c891f23 req-f80bdd3e-0603-48a3-b34f-7c248297fb87 service nova] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Received event network-vif-unplugged-aa074cf5-9a21-409b-8200-453a48485332 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:31:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5dab9e0b-cbbc-4610-bc9b-ec497c891f23 req-f80bdd3e-0603-48a3-b34f-7c248297fb87 service nova] Acquiring lock "89b04a09-41d8-461f-8d14-bb3b9c72ed76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:31:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5dab9e0b-cbbc-4610-bc9b-ec497c891f23 req-f80bdd3e-0603-48a3-b34f-7c248297fb87 service nova] Lock "89b04a09-41d8-461f-8d14-bb3b9c72ed76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:31:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5dab9e0b-cbbc-4610-bc9b-ec497c891f23 req-f80bdd3e-0603-48a3-b34f-7c248297fb87 service nova] Lock "89b04a09-41d8-461f-8d14-bb3b9c72ed76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:31:00 user nova-compute[74821]: DEBUG nova.compute.manager [req-5dab9e0b-cbbc-4610-bc9b-ec497c891f23 req-f80bdd3e-0603-48a3-b34f-7c248297fb87 service nova] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] No waiting events found dispatching network-vif-unplugged-aa074cf5-9a21-409b-8200-453a48485332 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:31:00 user nova-compute[74821]: DEBUG nova.compute.manager [req-5dab9e0b-cbbc-4610-bc9b-ec497c891f23 req-f80bdd3e-0603-48a3-b34f-7c248297fb87 service nova] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Received event network-vif-unplugged-aa074cf5-9a21-409b-8200-453a48485332 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:31:00 user nova-compute[74821]: DEBUG nova.compute.manager [req-14cc3ac1-1454-4cdf-a8e1-02236ec6405a req-e12ed1ff-a2f1-43cc-b15e-e996fe2e68e5 service nova] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Received event network-vif-plugged-8e9606b7-8bbe-47bc-87ac-03dd9f6fe085 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:31:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-14cc3ac1-1454-4cdf-a8e1-02236ec6405a req-e12ed1ff-a2f1-43cc-b15e-e996fe2e68e5 service nova] Acquiring lock "6f2a94d6-c16f-4f1f-a627-66e0dddc1615-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:31:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-14cc3ac1-1454-4cdf-a8e1-02236ec6405a req-e12ed1ff-a2f1-43cc-b15e-e996fe2e68e5 service nova] Lock "6f2a94d6-c16f-4f1f-a627-66e0dddc1615-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:31:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-14cc3ac1-1454-4cdf-a8e1-02236ec6405a req-e12ed1ff-a2f1-43cc-b15e-e996fe2e68e5 service nova] Lock "6f2a94d6-c16f-4f1f-a627-66e0dddc1615-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:31:00 user nova-compute[74821]: DEBUG nova.compute.manager [req-14cc3ac1-1454-4cdf-a8e1-02236ec6405a req-e12ed1ff-a2f1-43cc-b15e-e996fe2e68e5 service nova] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] No waiting events found dispatching network-vif-plugged-8e9606b7-8bbe-47bc-87ac-03dd9f6fe085 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:31:00 user nova-compute[74821]: WARNING nova.compute.manager [req-14cc3ac1-1454-4cdf-a8e1-02236ec6405a req-e12ed1ff-a2f1-43cc-b15e-e996fe2e68e5 service nova] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Received unexpected event network-vif-plugged-8e9606b7-8bbe-47bc-87ac-03dd9f6fe085 for instance with vm_state building and task_state spawning.
Nov 06 13:31:00 user nova-compute[74821]: DEBUG nova.compute.manager [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:31:00 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:31:00 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Instance spawned successfully.
Nov 06 13:31:00 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:31:00 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:31:00 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:31:00 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:31:00 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:31:00 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:31:00 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:31:01 user nova-compute[74821]: INFO nova.compute.manager [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Took 5.95 seconds to spawn the instance on the hypervisor.
Nov 06 13:31:01 user nova-compute[74821]: DEBUG nova.compute.manager [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:31:01 user nova-compute[74821]: INFO nova.compute.manager [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Took 6.91 seconds to build instance.
Nov 06 13:31:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6525aa61-46f7-4557-b318-299d487c6910 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Lock "6f2a94d6-c16f-4f1f-a627-66e0dddc1615" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.023s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:31:01 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Instance destroyed successfully.
Nov 06 13:31:01 user nova-compute[74821]: DEBUG nova.objects.instance [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lazy-loading 'resources' on Instance uuid 89b04a09-41d8-461f-8d14-bb3b9c72ed76 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:31:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:26:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-899326587',display_name='tempest-VolumesSnapshotTestJSON-instance-899326587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-899326587',id=32,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCOy7DwGbcANolD65+FZ4hSu7p2w6YSA9X0IjZDwI5q2Yj2a/maudSFXH9hOYXHHIhD4XNrdqAMO2EIILQMv6ov5Ydpo6W6JXRrgcfrkrXdNKJU8LTugugxJPfU42EasA==',key_name='tempest-keypair-1680964766',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:26:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f25eb95045d145c99d728e5d007ec1b6',ramdisk_id='',reservation_id='r-fb4kdg6t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1889603116',owner_user_name='tempest-VolumesSnapshotTestJSON-1889603116-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:26:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d34c030545b43f8a1ab4d071189d7fc',uuid=89b04a09-41d8-461f-8d14-bb3b9c72ed76,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa074cf5-9a21-409b-8200-453a48485332", "address": "fa:16:3e:af:cb:31", "network": {"id": "9fe30aa2-5c5b-448b-8bd5-cdeda2721e6b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2097801930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f25eb95045d145c99d728e5d007ec1b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa074cf5-9a", "ovs_interfaceid": "aa074cf5-9a21-409b-8200-453a48485332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:31:01 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Converting VIF {"id": "aa074cf5-9a21-409b-8200-453a48485332", "address": "fa:16:3e:af:cb:31", "network": {"id": "9fe30aa2-5c5b-448b-8bd5-cdeda2721e6b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2097801930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f25eb95045d145c99d728e5d007ec1b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa074cf5-9a", "ovs_interfaceid": "aa074cf5-9a21-409b-8200-453a48485332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:31:01 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:cb:31,bridge_name='br-int',has_traffic_filtering=True,id=aa074cf5-9a21-409b-8200-453a48485332,network=Network(9fe30aa2-5c5b-448b-8bd5-cdeda2721e6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa074cf5-9a') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:31:01 user nova-compute[74821]: DEBUG os_vif [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:cb:31,bridge_name='br-int',has_traffic_filtering=True,id=aa074cf5-9a21-409b-8200-453a48485332,network=Network(9fe30aa2-5c5b-448b-8bd5-cdeda2721e6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa074cf5-9a') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:31:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa074cf5-9a, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:31:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:31:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a00b49e2-ed34-415b-af5d-3fe580befa2d) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:31:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:01 user nova-compute[74821]: INFO os_vif [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:cb:31,bridge_name='br-int',has_traffic_filtering=True,id=aa074cf5-9a21-409b-8200-453a48485332,network=Network(9fe30aa2-5c5b-448b-8bd5-cdeda2721e6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa074cf5-9a')
Nov 06 13:31:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:31:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'piPIlZHh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:31:01 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:31:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:31:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:31:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:01 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2feaf59c-d674-429f-9a07-38bc6aa0509a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:31:01 user nova-compute[74821]: No targets found.
Nov 06 13:31:01 user nova-compute[74821]: iSNS:
Nov 06 13:31:01 user nova-compute[74821]: No targets found.
Nov 06 13:31:01 user nova-compute[74821]: STATIC:
Nov 06 13:31:01 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604
Nov 06 13:31:01 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:31:01 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:31:01 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f
Nov 06 13:31:01 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:31:01 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:31:01 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979
Nov 06 13:31:01 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:31:01 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:31:01 user nova-compute[74821]: FIRMWARE:
Nov 06 13:31:01 user nova-compute[74821]: No targets found.
Nov 06 13:31:01 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:31:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:31:01 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:31:01 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:31:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52357f8d-a952-448e-9c2a-8714beae1815', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:31:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:01 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[39102632-7f9d-4707-94a6-2de6d83528a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:01 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a504cd9d-cc39-4eea-9572-2d9fa96eb341]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:31:01 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:31:01 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:31:01 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:31:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:31:01 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:31:01 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:31:01 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:31:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e500e1630>, {}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:31:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Disconnecting from: [] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:31:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.080s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:31:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] <== disconnect_volume: return (81ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:31:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:31:01 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Deleting instance files /opt/stack/data/nova/instances/89b04a09-41d8-461f-8d14-bb3b9c72ed76_del
Nov 06 13:31:01 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Deletion of /opt/stack/data/nova/instances/89b04a09-41d8-461f-8d14-bb3b9c72ed76_del complete
Nov 06 13:31:01 user nova-compute[74821]: INFO nova.compute.manager [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 06 13:31:01 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:31:01 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:31:01 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Starting finish_migration {{(pid=74821) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Instance directory exists: not creating {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 06 13:31:02 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Creating image(s)
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:31:02 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Took 0.78 seconds to deallocate network for instance.
Nov 06 13:31:02 user nova-compute[74821]: WARNING nova.volume.cinder [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Attachment 7d6e7940-d4aa-455e-a556-98f5358b736f does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 7d6e7940-d4aa-455e-a556-98f5358b736f. (HTTP 404) (Request-ID: req-77b151a5-9af4-4cbb-a270-7e08ed25b38a)
Nov 06 13:31:02 user nova-compute[74821]: INFO nova.compute.manager [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Took 0.03 seconds to detach 1 volumes for instance.
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.205s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk. size=21474836480 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk 21474836480 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk 21474836480" returned: 0 in 0.075s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Did not create local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Ensure instance console log exists: /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Start _get_guest_xml network_info=[{"id": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "address": "fa:16:3e:69:f1:92", "network": {"id": "fc4369de-77c4-4f2f-a73c-d556ca3ff47c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1805761900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1805761900-network", "vif_mac": "fa:16:3e:69:f1:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56107e2c08004a26a96765ec143a6d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf768a2c5-10", "ovs_interfaceid": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NqtJyMeh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '2d8da345-f66d-45c2-8ccd-d22fdf79a14d', 'attached_at': '2023-11-06T13:31:02.000000', 'detached_at': '', 'volume_id': '8fd6df57-5012-419e-86c9-eb8fca3325f6', 'serial': '8fd6df57-5012-419e-86c9-eb8fca3325f6'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'b675c5d8-578e-42d0-a5c4-ffd1235e80ab', 'volume_type': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:31:02 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:31:02 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:31:02 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NqtJyMeh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:31:02 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:31:02 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:31:02 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:31:02 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:31:02 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0fe8e9-a0af-4d78-8c15-a7857aab0072]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:31:02 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[edacf90d-27f9-4322-a40f-6d26072bd053]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6] added
Nov 06 13:31:02 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd916f32-2b8a-4331-8d7c-32d6e92b00ba]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG nova.compute.manager [req-7ac02850-b2d7-4c42-8696-c21e58808ab4 req-43431f28-ff5b-413f-951c-ba898c8cb67b service nova] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Received event network-vif-plugged-aa074cf5-9a21-409b-8200-453a48485332 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-7ac02850-b2d7-4c42-8696-c21e58808ab4 req-43431f28-ff5b-413f-951c-ba898c8cb67b service nova] Acquiring lock "89b04a09-41d8-461f-8d14-bb3b9c72ed76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-7ac02850-b2d7-4c42-8696-c21e58808ab4 req-43431f28-ff5b-413f-951c-ba898c8cb67b service nova] Lock "89b04a09-41d8-461f-8d14-bb3b9c72ed76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-7ac02850-b2d7-4c42-8696-c21e58808ab4 req-43431f28-ff5b-413f-951c-ba898c8cb67b service nova] Lock "89b04a09-41d8-461f-8d14-bb3b9c72ed76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG nova.compute.manager [req-7ac02850-b2d7-4c42-8696-c21e58808ab4 req-43431f28-ff5b-413f-951c-ba898c8cb67b service nova] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] No waiting events found dispatching network-vif-plugged-aa074cf5-9a21-409b-8200-453a48485332 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:31:02 user nova-compute[74821]: WARNING nova.compute.manager [req-7ac02850-b2d7-4c42-8696-c21e58808ab4 req-43431f28-ff5b-413f-951c-ba898c8cb67b service nova] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Received unexpected event network-vif-plugged-aa074cf5-9a21-409b-8200-453a48485332 for instance with vm_state deleted and task_state None.
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eaf0c06-9826-41e9-83c4-c3fea1baa62f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NqtJyMeh {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NqtJyMeh" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9890fcf8-df99-4e75-a455-7b599b0c1a26]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NqtJyMeh'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec4399f-597f-4cde-b414-7ec7cd029fe7]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG nova.compute.manager [req-0e8a09a7-e445-4e83-82cd-f8b4b1246bc1 req-008c772a-16bd-4186-971d-000af3dcb51a service nova] [instance: 89b04a09-41d8-461f-8d14-bb3b9c72ed76] Received event network-vif-deleted-aa074cf5-9a21-409b-8200-453a48485332 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee54cc6-ab9f-42b2-b70e-aaf959a41f1e]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:31:02 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:31:02 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:31:02 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:31:02 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:31:02 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:31:02 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.627s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c301304-5dd9-438d-968e-d26c523fcff3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6, portal: 172.16.0.220,3260]
Nov 06 13:31:02 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6, portal: 172.16.0.220,3260] successful.
Nov 06 13:31:02 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:02 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Deleted allocations for instance 89b04a09-41d8-461f-8d14-bb3b9c72ed76
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e06941e-654b-4999-ac8d-2288cbdb0d85]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:31:02 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:03 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55faa97-e910-49a0-9af6-3ebd390767ad]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:31:03 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:31:03 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:31:03 user nova-compute[74821]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)
Nov 06 13:31:03 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:31:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:31:03 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:31:03 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:31:03 user nova-compute[74821]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)
Nov 06 13:31:03 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:31:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:31:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:31:03 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:31:03 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:31:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.041s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:03 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c72ec1-dfa2-4a8c-ab5a-3a6cadbe15bf]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:03 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:31:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NqtJyMeh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:31:03 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-15e7e3b8-c401-4c5b-92c3-0799df073c51 tempest-VolumesSnapshotTestJSON-1889603116 tempest-VolumesSnapshotTestJSON-1889603116-project-member] Lock "89b04a09-41d8-461f-8d14-bb3b9c72ed76" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.744s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:31:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:31:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '23534376361636465', 'path': '/dev/sde'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:31:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534376361636465', 'path': '/dev/sde'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:31:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:26:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-233244178',display_name='tempest-ServerActionsTestOtherB-server-233244178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-233244178',id=30,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuJC1d4ehn860a5pUveloxEygkvx5gY8ln8i6Wkpyz/+95f+bQsPWUnUI4RTUqfdZx4+FPFbRCNSl970GfIGv9UYxW4qb3i2YKmZKus6nAHjmjCWQpj73f7nF5ypuSRew==',key_name='tempest-keypair-821004257',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:26:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='56107e2c08004a26a96765ec143a6d6f',ramdisk_id='',reservation_id='r-l2lbl00l',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1724377265',owner_user_name='tempest-ServerActionsTestOtherB-1724377265-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:30:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88e8b4a7235140488a7b9cd34bd10f85',uuid=2d8da345-f66d-45c2-8ccd-d22fdf79a14d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "address": "fa:16:3e:69:f1:92", "network": {"id": "fc4369de-77c4-4f2f-a73c-d556ca3ff47c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1805761900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1805761900-network", "vif_mac": "fa:16:3e:69:f1:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56107e2c08004a26a96765ec143a6d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf768a2c5-10", "ovs_interfaceid": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:31:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Converting VIF {"id": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "address": "fa:16:3e:69:f1:92", "network": {"id": "fc4369de-77c4-4f2f-a73c-d556ca3ff47c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1805761900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1805761900-network", "vif_mac": "fa:16:3e:69:f1:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56107e2c08004a26a96765ec143a6d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf768a2c5-10", "ovs_interfaceid": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:31:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:f1:92,bridge_name='br-int',has_traffic_filtering=True,id=f768a2c5-10b0-4442-9c76-3b2365a15ea1,network=Network(fc4369de-77c4-4f2f-a73c-d556ca3ff47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf768a2c5-10') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:31:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:31:04 user nova-compute[74821]:   <uuid>2d8da345-f66d-45c2-8ccd-d22fdf79a14d</uuid>
Nov 06 13:31:04 user nova-compute[74821]:   <name>instance-0000001e</name>
Nov 06 13:31:04 user nova-compute[74821]:   <memory>2097152</memory>
Nov 06 13:31:04 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:31:04 user nova-compute[74821]:   <metadata>
Nov 06 13:31:04 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:31:04 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:31:04 user nova-compute[74821]:       <nova:name>tempest-ServerActionsTestOtherB-server-233244178</nova:name>
Nov 06 13:31:04 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:31:02</nova:creationTime>
Nov 06 13:31:04 user nova-compute[74821]:       <nova:flavor name="m1.small">
Nov 06 13:31:04 user nova-compute[74821]:         <nova:memory>2048</nova:memory>
Nov 06 13:31:04 user nova-compute[74821]:         <nova:disk>20</nova:disk>
Nov 06 13:31:04 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:31:04 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:31:04 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:31:04 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:31:04 user nova-compute[74821]:       <nova:owner>
Nov 06 13:31:04 user nova-compute[74821]:         <nova:user uuid="88e8b4a7235140488a7b9cd34bd10f85">tempest-ServerActionsTestOtherB-1724377265-project-member</nova:user>
Nov 06 13:31:04 user nova-compute[74821]:         <nova:project uuid="56107e2c08004a26a96765ec143a6d6f">tempest-ServerActionsTestOtherB-1724377265</nova:project>
Nov 06 13:31:04 user nova-compute[74821]:       </nova:owner>
Nov 06 13:31:04 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:31:04 user nova-compute[74821]:       <nova:ports>
Nov 06 13:31:04 user nova-compute[74821]:         <nova:port uuid="f768a2c5-10b0-4442-9c76-3b2365a15ea1">
Nov 06 13:31:04 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 06 13:31:04 user nova-compute[74821]:         </nova:port>
Nov 06 13:31:04 user nova-compute[74821]:       </nova:ports>
Nov 06 13:31:04 user nova-compute[74821]:     </nova:instance>
Nov 06 13:31:04 user nova-compute[74821]:   </metadata>
Nov 06 13:31:04 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:31:04 user nova-compute[74821]:     <system>
Nov 06 13:31:04 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:31:04 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:31:04 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:31:04 user nova-compute[74821]:       <entry name="serial">2d8da345-f66d-45c2-8ccd-d22fdf79a14d</entry>
Nov 06 13:31:04 user nova-compute[74821]:       <entry name="uuid">2d8da345-f66d-45c2-8ccd-d22fdf79a14d</entry>
Nov 06 13:31:04 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:31:04 user nova-compute[74821]:     </system>
Nov 06 13:31:04 user nova-compute[74821]:   </sysinfo>
Nov 06 13:31:04 user nova-compute[74821]:   <os>
Nov 06 13:31:04 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:31:04 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:31:04 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:31:04 user nova-compute[74821]:   </os>
Nov 06 13:31:04 user nova-compute[74821]:   <features>
Nov 06 13:31:04 user nova-compute[74821]:     <acpi/>
Nov 06 13:31:04 user nova-compute[74821]:     <apic/>
Nov 06 13:31:04 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:31:04 user nova-compute[74821]:   </features>
Nov 06 13:31:04 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:31:04 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:31:04 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:31:04 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:31:04 user nova-compute[74821]:   </clock>
Nov 06 13:31:04 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:31:04 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:31:04 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:31:04 user nova-compute[74821]:   </cpu>
Nov 06 13:31:04 user nova-compute[74821]:   <devices>
Nov 06 13:31:04 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:31:04 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:31:04 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk"/>
Nov 06 13:31:04 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:31:04 user nova-compute[74821]:     </disk>
Nov 06 13:31:04 user nova-compute[74821]:     <disk type="block" device="disk">
Nov 06 13:31:04 user nova-compute[74821]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:31:04 user nova-compute[74821]:       <source dev="/dev/sde"/>
Nov 06 13:31:04 user nova-compute[74821]:       <target dev="vdb" bus="virtio"/>
Nov 06 13:31:04 user nova-compute[74821]:       <serial>8fd6df57-5012-419e-86c9-eb8fca3325f6</serial>
Nov 06 13:31:04 user nova-compute[74821]:     </disk>
Nov 06 13:31:04 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:31:04 user nova-compute[74821]:       <mac address="fa:16:3e:69:f1:92"/>
Nov 06 13:31:04 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:31:04 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:31:04 user nova-compute[74821]:       <target dev="tapf768a2c5-10"/>
Nov 06 13:31:04 user nova-compute[74821]:     </interface>
Nov 06 13:31:04 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:31:04 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/console.log" append="off"/>
Nov 06 13:31:04 user nova-compute[74821]:     </serial>
Nov 06 13:31:04 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:31:04 user nova-compute[74821]:     <video>
Nov 06 13:31:04 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:31:04 user nova-compute[74821]:     </video>
Nov 06 13:31:04 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:31:04 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:31:04 user nova-compute[74821]:     </rng>
Nov 06 13:31:04 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:31:04 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:31:04 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:31:04 user nova-compute[74821]:     </memballoon>
Nov 06 13:31:04 user nova-compute[74821]:   </devices>
Nov 06 13:31:04 user nova-compute[74821]: </domain>
Nov 06 13:31:04 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:31:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:26:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-233244178',display_name='tempest-ServerActionsTestOtherB-server-233244178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-233244178',id=30,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuJC1d4ehn860a5pUveloxEygkvx5gY8ln8i6Wkpyz/+95f+bQsPWUnUI4RTUqfdZx4+FPFbRCNSl970GfIGv9UYxW4qb3i2YKmZKus6nAHjmjCWQpj73f7nF5ypuSRew==',key_name='tempest-keypair-821004257',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:26:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='56107e2c08004a26a96765ec143a6d6f',ramdisk_id='',reservation_id='r-l2lbl00l',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1724377265',owner_user_name='tempest-ServerActionsTestOtherB-1724377265-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:30:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88e8b4a7235140488a7b9cd34bd10f85',uuid=2d8da345-f66d-45c2-8ccd-d22fdf79a14d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "address": "fa:16:3e:69:f1:92", "network": {"id": "fc4369de-77c4-4f2f-a73c-d556ca3ff47c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1805761900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1805761900-network", "vif_mac": "fa:16:3e:69:f1:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56107e2c08004a26a96765ec143a6d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf768a2c5-10", "ovs_interfaceid": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:31:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Converting VIF {"id": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "address": "fa:16:3e:69:f1:92", "network": {"id": "fc4369de-77c4-4f2f-a73c-d556ca3ff47c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1805761900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1805761900-network", "vif_mac": "fa:16:3e:69:f1:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56107e2c08004a26a96765ec143a6d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf768a2c5-10", "ovs_interfaceid": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:31:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:f1:92,bridge_name='br-int',has_traffic_filtering=True,id=f768a2c5-10b0-4442-9c76-3b2365a15ea1,network=Network(fc4369de-77c4-4f2f-a73c-d556ca3ff47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf768a2c5-10') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:31:04 user nova-compute[74821]: DEBUG os_vif [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:f1:92,bridge_name='br-int',has_traffic_filtering=True,id=f768a2c5-10b0-4442-9c76-3b2365a15ea1,network=Network(fc4369de-77c4-4f2f-a73c-d556ca3ff47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf768a2c5-10') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:31:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:31:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:31:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c3570c2b-e326-5ff2-9a73-a94f5497905f', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:31:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:31:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf768a2c5-10, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:31:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf768a2c5-10, col_values=(('qos', UUID('b32eb724-e567-49ba-9c95-da3793d279ea')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:31:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf768a2c5-10, col_values=(('external_ids', {'iface-id': 'f768a2c5-10b0-4442-9c76-3b2365a15ea1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:f1:92', 'vm-uuid': '2d8da345-f66d-45c2-8ccd-d22fdf79a14d'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:31:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:31:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:04 user nova-compute[74821]: INFO os_vif [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:f1:92,bridge_name='br-int',has_traffic_filtering=True,id=f768a2c5-10b0-4442-9c76-3b2365a15ea1,network=Network(fc4369de-77c4-4f2f-a73c-d556ca3ff47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf768a2c5-10')
Nov 06 13:31:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:31:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:31:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] No VIF found with MAC fa:16:3e:69:f1:92, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:31:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:05 user nova-compute[74821]: DEBUG nova.compute.manager [req-3a1de897-0741-4063-bfa8-f53cd7b18655 req-4e8e4e62-2dab-453e-97d5-2d705d86eba9 service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Received event network-vif-plugged-f768a2c5-10b0-4442-9c76-3b2365a15ea1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:31:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3a1de897-0741-4063-bfa8-f53cd7b18655 req-4e8e4e62-2dab-453e-97d5-2d705d86eba9 service nova] Acquiring lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:31:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3a1de897-0741-4063-bfa8-f53cd7b18655 req-4e8e4e62-2dab-453e-97d5-2d705d86eba9 service nova] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:31:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3a1de897-0741-4063-bfa8-f53cd7b18655 req-4e8e4e62-2dab-453e-97d5-2d705d86eba9 service nova] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:31:05 user nova-compute[74821]: DEBUG nova.compute.manager [req-3a1de897-0741-4063-bfa8-f53cd7b18655 req-4e8e4e62-2dab-453e-97d5-2d705d86eba9 service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] No waiting events found dispatching network-vif-plugged-f768a2c5-10b0-4442-9c76-3b2365a15ea1 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:31:05 user nova-compute[74821]: WARNING nova.compute.manager [req-3a1de897-0741-4063-bfa8-f53cd7b18655 req-4e8e4e62-2dab-453e-97d5-2d705d86eba9 service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Received unexpected event network-vif-plugged-f768a2c5-10b0-4442-9c76-3b2365a15ea1 for instance with vm_state active and task_state resize_finish.
Nov 06 13:31:06 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:06 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:06 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:06 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:08 user nova-compute[74821]: DEBUG nova.compute.manager [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:31:08 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Instance running successfully.
Nov 06 13:31:08 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Failed to set time: agent not configured {{(pid=74821) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 06 13:31:08 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-6f1b2b02-fffa-4f81-98bd-11cfb337aa75 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] finish_migration finished successfully. {{(pid=74821) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 06 13:31:08 user nova-compute[74821]: DEBUG nova.compute.manager [req-406bad78-18ac-4f68-a2f9-20fa6d46100e req-1a1b63b2-e84b-4aa6-a33d-4c840ea9b1a3 service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Received event network-vif-plugged-f768a2c5-10b0-4442-9c76-3b2365a15ea1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:31:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-406bad78-18ac-4f68-a2f9-20fa6d46100e req-1a1b63b2-e84b-4aa6-a33d-4c840ea9b1a3 service nova] Acquiring lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:31:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-406bad78-18ac-4f68-a2f9-20fa6d46100e req-1a1b63b2-e84b-4aa6-a33d-4c840ea9b1a3 service nova] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:31:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-406bad78-18ac-4f68-a2f9-20fa6d46100e req-1a1b63b2-e84b-4aa6-a33d-4c840ea9b1a3 service nova] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:31:08 user nova-compute[74821]: DEBUG nova.compute.manager [req-406bad78-18ac-4f68-a2f9-20fa6d46100e req-1a1b63b2-e84b-4aa6-a33d-4c840ea9b1a3 service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] No waiting events found dispatching network-vif-plugged-f768a2c5-10b0-4442-9c76-3b2365a15ea1 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:31:08 user nova-compute[74821]: WARNING nova.compute.manager [req-406bad78-18ac-4f68-a2f9-20fa6d46100e req-1a1b63b2-e84b-4aa6-a33d-4c840ea9b1a3 service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Received unexpected event network-vif-plugged-f768a2c5-10b0-4442-9c76-3b2365a15ea1 for instance with vm_state active and task_state resize_finish.
Nov 06 13:31:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:13 user nova-compute[74821]: DEBUG nova.compute.manager [req-1d3e846c-7c48-4eda-9b85-37ad78732a09 req-638d5261-bccd-46c6-a997-deeb3c3375c3 service nova] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Received event network-changed-1e1f285c-2014-4b04-a4c3-83ccc1d695fd {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:31:13 user nova-compute[74821]: DEBUG nova.compute.manager [req-1d3e846c-7c48-4eda-9b85-37ad78732a09 req-638d5261-bccd-46c6-a997-deeb3c3375c3 service nova] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Refreshing instance network info cache due to event network-changed-1e1f285c-2014-4b04-a4c3-83ccc1d695fd. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:31:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1d3e846c-7c48-4eda-9b85-37ad78732a09 req-638d5261-bccd-46c6-a997-deeb3c3375c3 service nova] Acquiring lock "refresh_cache-6121ff1a-d276-485f-85f8-ba451f5b0d37" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:31:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1d3e846c-7c48-4eda-9b85-37ad78732a09 req-638d5261-bccd-46c6-a997-deeb3c3375c3 service nova] Acquired lock "refresh_cache-6121ff1a-d276-485f-85f8-ba451f5b0d37" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:31:13 user nova-compute[74821]: DEBUG nova.network.neutron [req-1d3e846c-7c48-4eda-9b85-37ad78732a09 req-638d5261-bccd-46c6-a997-deeb3c3375c3 service nova] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Refreshing network info cache for port 1e1f285c-2014-4b04-a4c3-83ccc1d695fd {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:31:14 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:14 user nova-compute[74821]: DEBUG nova.network.neutron [req-1d3e846c-7c48-4eda-9b85-37ad78732a09 req-638d5261-bccd-46c6-a997-deeb3c3375c3 service nova] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Updated VIF entry in instance network info cache for port 1e1f285c-2014-4b04-a4c3-83ccc1d695fd. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:31:14 user nova-compute[74821]: DEBUG nova.network.neutron [req-1d3e846c-7c48-4eda-9b85-37ad78732a09 req-638d5261-bccd-46c6-a997-deeb3c3375c3 service nova] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Updating instance_info_cache with network_info: [{"id": "1e1f285c-2014-4b04-a4c3-83ccc1d695fd", "address": "fa:16:3e:9c:4f:f3", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e1f285c-20", "ovs_interfaceid": "1e1f285c-2014-4b04-a4c3-83ccc1d695fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:31:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1d3e846c-7c48-4eda-9b85-37ad78732a09 req-638d5261-bccd-46c6-a997-deeb3c3375c3 service nova] Releasing lock "refresh_cache-6121ff1a-d276-485f-85f8-ba451f5b0d37" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:31:14 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "6121ff1a-d276-485f-85f8-ba451f5b0d37" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:31:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "6121ff1a-d276-485f-85f8-ba451f5b0d37" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:31:19 user nova-compute[74821]: DEBUG nova.objects.instance [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lazy-loading 'flavor' on Instance uuid 6121ff1a-d276-485f-85f8-ba451f5b0d37 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:31:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "6121ff1a-d276-485f-85f8-ba451f5b0d37" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:31:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "6121ff1a-d276-485f-85f8-ba451f5b0d37" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:31:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "6121ff1a-d276-485f-85f8-ba451f5b0d37" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:31:20 user nova-compute[74821]: INFO nova.compute.manager [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Attaching volume 379ea2b9-c5af-4652-a630-572a70b50b82 to /dev/vdb
Nov 06 13:31:20 user nova-compute[74821]: DEBUG os_brick.utils [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:31:20 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:20 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:20 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38bc4cb-30aa-4561-8b8f-52ae3997b0a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:20 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:20 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:20 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a96ce7-bd8c-4b23-a9f0-1eea14933a1d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:20 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:20 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:20 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[443bd7ae-f28e-4884-ac13-c0ef3710705e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:20 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7559ec6e-fd41-4560-ad43-8d1a51c63928]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:20 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:20 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:31:20 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:31:20 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:20 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:31:20 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:31:20 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8629e10-6744-47a2-9267-9d886d368c33]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:20 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:31:20 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:31:20 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:31:20 user nova-compute[74821]: DEBUG os_brick.utils [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:31:20 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Updating existing volume attachment record: 304895bb-9caf-4cb1-a504-ef364e5a546d {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:31:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:34 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:31:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:37 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:31:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:40 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:31:40 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:31:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-1290bdb3-827f-4365-a4f1-4ae063de780d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:31:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-1290bdb3-827f-4365-a4f1-4ae063de780d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:31:41 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:31:42 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Updating instance_info_cache with network_info: [{"id": "289e941f-a075-4d4c-804a-7fe3d666037c", "address": "fa:16:3e:be:ab:5c", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap289e941f-a0", "ovs_interfaceid": "289e941f-a075-4d4c-804a-7fe3d666037c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:31:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-1290bdb3-827f-4365-a4f1-4ae063de780d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:31:42 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:31:42 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:31:42 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:31:42 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:31:42 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:31:42 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:31:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:31:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:31:43 user nova-compute[74821]: DEBUG nova.compute.manager [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:31:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:31:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:31:43 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:31:43 user nova-compute[74821]: INFO nova.compute.claims [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Claim successful on node user
Nov 06 13:31:43 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:31:43 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:31:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.742s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:31:44 user nova-compute[74821]: DEBUG nova.compute.manager [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:31:44 user nova-compute[74821]: DEBUG nova.compute.manager [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:31:44 user nova-compute[74821]: DEBUG nova.network.neutron [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:31:44 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:31:44 user nova-compute[74821]: DEBUG nova.compute.manager [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:31:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:44 user nova-compute[74821]: DEBUG nova.policy [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19e457098f3242979db3fc25390965a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2772db4aac63412fb8cfe945c89f7156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:31:44 user nova-compute[74821]: DEBUG nova.compute.manager [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:31:44 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:31:44 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Creating image(s)
Nov 06 13:31:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "/opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:31:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "/opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:31:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "/opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:31:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "2168b23d5cf1db6819fd7454256e109af9aabb92" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:31:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "2168b23d5cf1db6819fd7454256e109af9aabb92" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:31:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2168b23d5cf1db6819fd7454256e109af9aabb92.part --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2168b23d5cf1db6819fd7454256e109af9aabb92.part --force-share --output=json" returned: 0 in 0.207s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:45 user nova-compute[74821]: DEBUG nova.virt.images [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] 149fc74a-1ade-4b08-9498-88510804c090 was qcow2, converting to raw {{(pid=74821) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 13:31:45 user nova-compute[74821]: DEBUG nova.privsep.utils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74821) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 13:31:45 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2168b23d5cf1db6819fd7454256e109af9aabb92.part /opt/stack/data/nova/instances/_base/2168b23d5cf1db6819fd7454256e109af9aabb92.converted {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:45 user nova-compute[74821]: DEBUG nova.network.neutron [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Successfully created port: 30866a49-b7d0-458d-87a6-e97d3c533640 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:31:45 user nova-compute[74821]: INFO nova.compute.manager [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Rescuing
Nov 06 13:31:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "refresh_cache-64ae6f5e-38a1-4871-8015-c2097f64b33b" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:31:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquired lock "refresh_cache-64ae6f5e-38a1-4871-8015-c2097f64b33b" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:31:45 user nova-compute[74821]: DEBUG nova.network.neutron [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:31:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2168b23d5cf1db6819fd7454256e109af9aabb92.part /opt/stack/data/nova/instances/_base/2168b23d5cf1db6819fd7454256e109af9aabb92.converted" returned: 0 in 0.677s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2168b23d5cf1db6819fd7454256e109af9aabb92.converted --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2168b23d5cf1db6819fd7454256e109af9aabb92.converted --force-share --output=json" returned: 0 in 0.192s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "2168b23d5cf1db6819fd7454256e109af9aabb92" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.825s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:31:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2168b23d5cf1db6819fd7454256e109af9aabb92 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:46 user nova-compute[74821]: DEBUG nova.network.neutron [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Updating instance_info_cache with network_info: [{"id": "ded8f989-f920-42ed-a158-04455e6abbc1", "address": "fa:16:3e:b2:3e:a6", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8f989-f9", "ovs_interfaceid": "ded8f989-f920-42ed-a158-04455e6abbc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:31:46 user nova-compute[74821]: DEBUG nova.network.neutron [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Successfully updated port: 30866a49-b7d0-458d-87a6-e97d3c533640 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:31:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Releasing lock "refresh_cache-64ae6f5e-38a1-4871-8015-c2097f64b33b" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:31:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "refresh_cache-8467fdc8-ec8e-4eda-abbc-b146e58e90c8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:31:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquired lock "refresh_cache-8467fdc8-ec8e-4eda-abbc-b146e58e90c8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:31:46 user nova-compute[74821]: DEBUG nova.network.neutron [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:31:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2168b23d5cf1db6819fd7454256e109af9aabb92 --force-share --output=json" returned: 0 in 0.212s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "2168b23d5cf1db6819fd7454256e109af9aabb92" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:31:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "2168b23d5cf1db6819fd7454256e109af9aabb92" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:31:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2168b23d5cf1db6819fd7454256e109af9aabb92 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:46 user nova-compute[74821]: DEBUG nova.network.neutron [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:31:46 user nova-compute[74821]: DEBUG nova.compute.manager [req-aef596cf-047a-4f39-8025-036e0b7574e1 req-d6c88a53-73e4-41b4-bba7-8ca6bef10f69 service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Received event network-changed-30866a49-b7d0-458d-87a6-e97d3c533640 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:31:46 user nova-compute[74821]: DEBUG nova.compute.manager [req-aef596cf-047a-4f39-8025-036e0b7574e1 req-d6c88a53-73e4-41b4-bba7-8ca6bef10f69 service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Refreshing instance network info cache due to event network-changed-30866a49-b7d0-458d-87a6-e97d3c533640. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:31:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-aef596cf-047a-4f39-8025-036e0b7574e1 req-d6c88a53-73e4-41b4-bba7-8ca6bef10f69 service nova] Acquiring lock "refresh_cache-8467fdc8-ec8e-4eda-abbc-b146e58e90c8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:31:46 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:46 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2168b23d5cf1db6819fd7454256e109af9aabb92 --force-share --output=json" returned: 0 in 0.194s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2168b23d5cf1db6819fd7454256e109af9aabb92,backing_fmt=raw /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2168b23d5cf1db6819fd7454256e109af9aabb92,backing_fmt=raw /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk 1073741824" returned: 0 in 0.075s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "2168b23d5cf1db6819fd7454256e109af9aabb92" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:31:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2168b23d5cf1db6819fd7454256e109af9aabb92 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:46 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:46 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2168b23d5cf1db6819fd7454256e109af9aabb92 --force-share --output=json" returned: 0 in 0.227s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:46 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:31:46 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:46 user nova-compute[74821]: DEBUG nova.network.neutron [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Updating instance_info_cache with network_info: [{"id": "30866a49-b7d0-458d-87a6-e97d3c533640", "address": "fa:16:3e:7c:2c:c7", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30866a49-b7", "ovs_interfaceid": "30866a49-b7d0-458d-87a6-e97d3c533640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Cleaning up deleted instances {{(pid=74821) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Releasing lock "refresh_cache-8467fdc8-ec8e-4eda-abbc-b146e58e90c8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.compute.manager [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Instance network_info: |[{"id": "30866a49-b7d0-458d-87a6-e97d3c533640", "address": "fa:16:3e:7c:2c:c7", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30866a49-b7", "ovs_interfaceid": "30866a49-b7d0-458d-87a6-e97d3c533640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-aef596cf-047a-4f39-8025-036e0b7574e1 req-d6c88a53-73e4-41b4-bba7-8ca6bef10f69 service nova] Acquired lock "refresh_cache-8467fdc8-ec8e-4eda-abbc-b146e58e90c8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.network.neutron [req-aef596cf-047a-4f39-8025-036e0b7574e1 req-d6c88a53-73e4-41b4-bba7-8ca6bef10f69 service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Refreshing network info cache for port 30866a49-b7d0-458d-87a6-e97d3c533640 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] There are 0 instances to clean {{(pid=74821) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Cannot resize image /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Ensure instance console log exists: /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Start _get_guest_xml network_info=[{"id": "30866a49-b7d0-458d-87a6-e97d3c533640", "address": "fa:16:3e:7c:2c:c7", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30866a49-b7", "ovs_interfaceid": "30866a49-b7d0-458d-87a6-e97d3c533640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:31:40Z,direct_url=<?>,disk_format='qcow2',id=149fc74a-1ade-4b08-9498-88510804c090,min_disk=0,min_ram=0,name='tempest-scenario-img--148815991',owner='2772db4aac63412fb8cfe945c89f7156',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:31:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '149fc74a-1ade-4b08-9498-88510804c090'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:31:47 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:31:47 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:31:40Z,direct_url=<?>,disk_format='qcow2',id=149fc74a-1ade-4b08-9498-88510804c090,min_disk=0,min_ram=0,name='tempest-scenario-img--148815991',owner='2772db4aac63412fb8cfe945c89f7156',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:31:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:31:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1664915128',display_name='tempest-TestMinimumBasicScenario-server-1664915128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1664915128',id=39,image_ref='149fc74a-1ade-4b08-9498-88510804c090',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPC/WyWwJ1mdb7Q1HCFQa68dEwI0XyfAWMaXm4AvxqK0uA59dwuMN3WSFpUeeufZrkTJoJN71RO50MRXJvZqvtDVtE16HLEjQ928R5bTilrQQ7UOiHqmsqTXF4fpZzdNYA==',key_name='tempest-TestMinimumBasicScenario-2075493504',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2772db4aac63412fb8cfe945c89f7156',ramdisk_id='',reservation_id='r-dh6uy30j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='149fc74a-1ade-4b08-9498-88510804c090',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1779731878',owner_user_name='tempest-TestMinimumBasicScenario-1779731878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:31:44Z,user_data=None,user_id='19e457098f3242979db3fc25390965a4',uuid=8467fdc8-ec8e-4eda-abbc-b146e58e90c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30866a49-b7d0-458d-87a6-e97d3c533640", "address": "fa:16:3e:7c:2c:c7", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30866a49-b7", "ovs_interfaceid": "30866a49-b7d0-458d-87a6-e97d3c533640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Converting VIF {"id": "30866a49-b7d0-458d-87a6-e97d3c533640", "address": "fa:16:3e:7c:2c:c7", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30866a49-b7", "ovs_interfaceid": "30866a49-b7d0-458d-87a6-e97d3c533640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:2c:c7,bridge_name='br-int',has_traffic_filtering=True,id=30866a49-b7d0-458d-87a6-e97d3c533640,network=Network(57870f63-b015-4453-ae32-18f642d7c4b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30866a49-b7') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.objects.instance [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lazy-loading 'pci_devices' on Instance uuid 8467fdc8-ec8e-4eda-abbc-b146e58e90c8 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:31:47 user nova-compute[74821]:   <uuid>8467fdc8-ec8e-4eda-abbc-b146e58e90c8</uuid>
Nov 06 13:31:47 user nova-compute[74821]:   <name>instance-00000027</name>
Nov 06 13:31:47 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:31:47 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:31:47 user nova-compute[74821]:   <metadata>
Nov 06 13:31:47 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:31:47 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:31:47 user nova-compute[74821]:       <nova:name>tempest-TestMinimumBasicScenario-server-1664915128</nova:name>
Nov 06 13:31:47 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:31:47</nova:creationTime>
Nov 06 13:31:47 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:31:47 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:31:47 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:31:47 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:31:47 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:31:47 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:31:47 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:31:47 user nova-compute[74821]:       <nova:owner>
Nov 06 13:31:47 user nova-compute[74821]:         <nova:user uuid="19e457098f3242979db3fc25390965a4">tempest-TestMinimumBasicScenario-1779731878-project-member</nova:user>
Nov 06 13:31:47 user nova-compute[74821]:         <nova:project uuid="2772db4aac63412fb8cfe945c89f7156">tempest-TestMinimumBasicScenario-1779731878</nova:project>
Nov 06 13:31:47 user nova-compute[74821]:       </nova:owner>
Nov 06 13:31:47 user nova-compute[74821]:       <nova:root type="image" uuid="149fc74a-1ade-4b08-9498-88510804c090"/>
Nov 06 13:31:47 user nova-compute[74821]:       <nova:ports>
Nov 06 13:31:47 user nova-compute[74821]:         <nova:port uuid="30866a49-b7d0-458d-87a6-e97d3c533640">
Nov 06 13:31:47 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 06 13:31:47 user nova-compute[74821]:         </nova:port>
Nov 06 13:31:47 user nova-compute[74821]:       </nova:ports>
Nov 06 13:31:47 user nova-compute[74821]:     </nova:instance>
Nov 06 13:31:47 user nova-compute[74821]:   </metadata>
Nov 06 13:31:47 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:31:47 user nova-compute[74821]:     <system>
Nov 06 13:31:47 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:31:47 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:31:47 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:31:47 user nova-compute[74821]:       <entry name="serial">8467fdc8-ec8e-4eda-abbc-b146e58e90c8</entry>
Nov 06 13:31:47 user nova-compute[74821]:       <entry name="uuid">8467fdc8-ec8e-4eda-abbc-b146e58e90c8</entry>
Nov 06 13:31:47 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:31:47 user nova-compute[74821]:     </system>
Nov 06 13:31:47 user nova-compute[74821]:   </sysinfo>
Nov 06 13:31:47 user nova-compute[74821]:   <os>
Nov 06 13:31:47 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:31:47 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:31:47 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:31:47 user nova-compute[74821]:   </os>
Nov 06 13:31:47 user nova-compute[74821]:   <features>
Nov 06 13:31:47 user nova-compute[74821]:     <acpi/>
Nov 06 13:31:47 user nova-compute[74821]:     <apic/>
Nov 06 13:31:47 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:31:47 user nova-compute[74821]:   </features>
Nov 06 13:31:47 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:31:47 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:31:47 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:31:47 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:31:47 user nova-compute[74821]:   </clock>
Nov 06 13:31:47 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:31:47 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:31:47 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:31:47 user nova-compute[74821]:   </cpu>
Nov 06 13:31:47 user nova-compute[74821]:   <devices>
Nov 06 13:31:47 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:31:47 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:31:47 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk"/>
Nov 06 13:31:47 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:31:47 user nova-compute[74821]:     </disk>
Nov 06 13:31:47 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:31:47 user nova-compute[74821]:       <mac address="fa:16:3e:7c:2c:c7"/>
Nov 06 13:31:47 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:31:47 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:31:47 user nova-compute[74821]:       <target dev="tap30866a49-b7"/>
Nov 06 13:31:47 user nova-compute[74821]:     </interface>
Nov 06 13:31:47 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:31:47 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/console.log" append="off"/>
Nov 06 13:31:47 user nova-compute[74821]:     </serial>
Nov 06 13:31:47 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:31:47 user nova-compute[74821]:     <video>
Nov 06 13:31:47 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:31:47 user nova-compute[74821]:     </video>
Nov 06 13:31:47 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:31:47 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:31:47 user nova-compute[74821]:     </rng>
Nov 06 13:31:47 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:31:47 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:31:47 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:31:47 user nova-compute[74821]:     </memballoon>
Nov 06 13:31:47 user nova-compute[74821]:   </devices>
Nov 06 13:31:47 user nova-compute[74821]: </domain>
Nov 06 13:31:47 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:31:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1664915128',display_name='tempest-TestMinimumBasicScenario-server-1664915128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1664915128',id=39,image_ref='149fc74a-1ade-4b08-9498-88510804c090',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPC/WyWwJ1mdb7Q1HCFQa68dEwI0XyfAWMaXm4AvxqK0uA59dwuMN3WSFpUeeufZrkTJoJN71RO50MRXJvZqvtDVtE16HLEjQ928R5bTilrQQ7UOiHqmsqTXF4fpZzdNYA==',key_name='tempest-TestMinimumBasicScenario-2075493504',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2772db4aac63412fb8cfe945c89f7156',ramdisk_id='',reservation_id='r-dh6uy30j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='149fc74a-1ade-4b08-9498-88510804c090',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1779731878',owner_user_name='tempest-TestMinimumBasicScenario-1779731878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:31:44Z,user_data=None,user_id='19e457098f3242979db3fc25390965a4',uuid=8467fdc8-ec8e-4eda-abbc-b146e58e90c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30866a49-b7d0-458d-87a6-e97d3c533640", "address": "fa:16:3e:7c:2c:c7", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30866a49-b7", "ovs_interfaceid": "30866a49-b7d0-458d-87a6-e97d3c533640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Converting VIF {"id": "30866a49-b7d0-458d-87a6-e97d3c533640", "address": "fa:16:3e:7c:2c:c7", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30866a49-b7", "ovs_interfaceid": "30866a49-b7d0-458d-87a6-e97d3c533640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:2c:c7,bridge_name='br-int',has_traffic_filtering=True,id=30866a49-b7d0-458d-87a6-e97d3c533640,network=Network(57870f63-b015-4453-ae32-18f642d7c4b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30866a49-b7') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG os_vif [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:2c:c7,bridge_name='br-int',has_traffic_filtering=True,id=30866a49-b7d0-458d-87a6-e97d3c533640,network=Network(57870f63-b015-4453-ae32-18f642d7c4b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30866a49-b7') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '02eb8c5b-6ecc-50be-9708-8eaf4a2109bf', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:31:47 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Instance destroyed successfully.
Nov 06 13:31:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:47 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Attempting a stable device rescue
Nov 06 13:31:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30866a49-b7, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap30866a49-b7, col_values=(('qos', UUID('6bf209af-8e19-4fcb-9abe-df46a0850b08')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap30866a49-b7, col_values=(('external_ids', {'iface-id': '30866a49-b7d0-458d-87a6-e97d3c533640', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:2c:c7', 'vm-uuid': '8467fdc8-ec8e-4eda-abbc-b146e58e90c8'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:47 user nova-compute[74821]: INFO os_vif [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:2c:c7,bridge_name='br-int',has_traffic_filtering=True,id=30866a49-b7d0-458d-87a6-e97d3c533640,network=Network(57870f63-b015-4453-ae32-18f642d7c4b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30866a49-b7')
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74821) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Instance directory exists: not creating {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 06 13:31:47 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Creating image(s)
Nov 06 13:31:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "/opt/stack/data/nova/instances/64ae6f5e-38a1-4871-8015-c2097f64b33b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "/opt/stack/data/nova/instances/64ae6f5e-38a1-4871-8015-c2097f64b33b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "/opt/stack/data/nova/instances/64ae6f5e-38a1-4871-8015-c2097f64b33b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.objects.instance [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lazy-loading 'trusted_certs' on Instance uuid 64ae6f5e-38a1-4871-8015-c2097f64b33b {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "392377818b8196e889922901bb678f357a6c57a5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "392377818b8196e889922901bb678f357a6c57a5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:31:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] No VIF found with MAC fa:16:3e:7c:2c:c7, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/392377818b8196e889922901bb678f357a6c57a5.part --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG nova.network.neutron [req-aef596cf-047a-4f39-8025-036e0b7574e1 req-d6c88a53-73e4-41b4-bba7-8ca6bef10f69 service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Updated VIF entry in instance network info cache for port 30866a49-b7d0-458d-87a6-e97d3c533640. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG nova.network.neutron [req-aef596cf-047a-4f39-8025-036e0b7574e1 req-d6c88a53-73e4-41b4-bba7-8ca6bef10f69 service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Updating instance_info_cache with network_info: [{"id": "30866a49-b7d0-458d-87a6-e97d3c533640", "address": "fa:16:3e:7c:2c:c7", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30866a49-b7", "ovs_interfaceid": "30866a49-b7d0-458d-87a6-e97d3c533640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-aef596cf-047a-4f39-8025-036e0b7574e1 req-d6c88a53-73e4-41b4-bba7-8ca6bef10f69 service nova] Releasing lock "refresh_cache-8467fdc8-ec8e-4eda-abbc-b146e58e90c8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG nova.compute.manager [req-ab6d1ad6-2ba8-4a87-9481-47a0243acd5e req-462a9796-3614-45ab-b681-6396877b73a9 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Received event network-vif-unplugged-ded8f989-f920-42ed-a158-04455e6abbc1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ab6d1ad6-2ba8-4a87-9481-47a0243acd5e req-462a9796-3614-45ab-b681-6396877b73a9 service nova] Acquiring lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ab6d1ad6-2ba8-4a87-9481-47a0243acd5e req-462a9796-3614-45ab-b681-6396877b73a9 service nova] Lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ab6d1ad6-2ba8-4a87-9481-47a0243acd5e req-462a9796-3614-45ab-b681-6396877b73a9 service nova] Lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG nova.compute.manager [req-ab6d1ad6-2ba8-4a87-9481-47a0243acd5e req-462a9796-3614-45ab-b681-6396877b73a9 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] No waiting events found dispatching network-vif-unplugged-ded8f989-f920-42ed-a158-04455e6abbc1 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:31:48 user nova-compute[74821]: WARNING nova.compute.manager [req-ab6d1ad6-2ba8-4a87-9481-47a0243acd5e req-462a9796-3614-45ab-b681-6396877b73a9 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Received unexpected event network-vif-unplugged-ded8f989-f920-42ed-a158-04455e6abbc1 for instance with vm_state active and task_state rescuing.
Nov 06 13:31:48 user nova-compute[74821]: DEBUG nova.compute.manager [req-ab6d1ad6-2ba8-4a87-9481-47a0243acd5e req-462a9796-3614-45ab-b681-6396877b73a9 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Received event network-vif-plugged-ded8f989-f920-42ed-a158-04455e6abbc1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ab6d1ad6-2ba8-4a87-9481-47a0243acd5e req-462a9796-3614-45ab-b681-6396877b73a9 service nova] Acquiring lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ab6d1ad6-2ba8-4a87-9481-47a0243acd5e req-462a9796-3614-45ab-b681-6396877b73a9 service nova] Lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ab6d1ad6-2ba8-4a87-9481-47a0243acd5e req-462a9796-3614-45ab-b681-6396877b73a9 service nova] Lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG nova.compute.manager [req-ab6d1ad6-2ba8-4a87-9481-47a0243acd5e req-462a9796-3614-45ab-b681-6396877b73a9 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] No waiting events found dispatching network-vif-plugged-ded8f989-f920-42ed-a158-04455e6abbc1 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:31:48 user nova-compute[74821]: WARNING nova.compute.manager [req-ab6d1ad6-2ba8-4a87-9481-47a0243acd5e req-462a9796-3614-45ab-b681-6396877b73a9 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Received unexpected event network-vif-plugged-ded8f989-f920-42ed-a158-04455e6abbc1 for instance with vm_state active and task_state rescuing.
Nov 06 13:31:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/392377818b8196e889922901bb678f357a6c57a5.part --force-share --output=json" returned: 0 in 0.186s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG nova.virt.images [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] 32c18fc4-83b2-4e47-8b03-20ee0fe4647e was qcow2, converting to raw {{(pid=74821) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG nova.privsep.utils [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74821) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/392377818b8196e889922901bb678f357a6c57a5.part /opt/stack/data/nova/instances/_base/392377818b8196e889922901bb678f357a6c57a5.converted {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bKeMCAXj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:31:48 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:31:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:31:48 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:31:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:31:48 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:31:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12e7d59-92d2-4672-8be1-dfedf0120720]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:31:48 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2d25e2-1723-46c1-bfa5-3d027464c142]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82] added
Nov 06 13:31:48 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c20db3-784a-4a84-8425-aa9702f311fe]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d87ad3-d4b5-4462-8278-516dcaf0f0b4]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bKeMCAXj {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:48 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bKeMCAXj" returned: 0 in 0.049s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8115286a-fcbf-48c5-9127-16052a9a8fa1]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bKeMCAXj'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.065s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10a10a0-2e27-45d1-83a3-3b639e8a4d2f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cd9043-cd0b-469e-a708-9460066bd4c8]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:31:49 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:31:49 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:31:49 user nova-compute[74821]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)
Nov 06 13:31:49 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:31:49 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:31:49 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:31:49 user nova-compute[74821]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)
Nov 06 13:31:49 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG nova.compute.manager [req-206424bb-3e43-45ae-a69b-c05c1dfbe67d req-10fef53b-4770-49ef-911a-ffb1ac191837 service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Received event network-vif-plugged-30866a49-b7d0-458d-87a6-e97d3c533640 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-206424bb-3e43-45ae-a69b-c05c1dfbe67d req-10fef53b-4770-49ef-911a-ffb1ac191837 service nova] Acquiring lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-206424bb-3e43-45ae-a69b-c05c1dfbe67d req-10fef53b-4770-49ef-911a-ffb1ac191837 service nova] Lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-206424bb-3e43-45ae-a69b-c05c1dfbe67d req-10fef53b-4770-49ef-911a-ffb1ac191837 service nova] Lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG nova.compute.manager [req-206424bb-3e43-45ae-a69b-c05c1dfbe67d req-10fef53b-4770-49ef-911a-ffb1ac191837 service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] No waiting events found dispatching network-vif-plugged-30866a49-b7d0-458d-87a6-e97d3c533640 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:31:49 user nova-compute[74821]: WARNING nova.compute.manager [req-206424bb-3e43-45ae-a69b-c05c1dfbe67d req-10fef53b-4770-49ef-911a-ffb1ac191837 service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Received unexpected event network-vif-plugged-30866a49-b7d0-458d-87a6-e97d3c533640 for instance with vm_state building and task_state spawning.
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/392377818b8196e889922901bb678f357a6c57a5.part /opt/stack/data/nova/instances/_base/392377818b8196e889922901bb678f357a6c57a5.converted" returned: 0 in 0.541s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/392377818b8196e889922901bb678f357a6c57a5.converted --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 -p 172.16.0.220:3260 --login" returned: 0 in 0.237s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f5ff83-d635-4c68-8c11-3cb3a001f8f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82, portal: 172.16.0.220,3260]
Nov 06 13:31:49 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82, portal: 172.16.0.220,3260] successful.
Nov 06 13:31:49 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[802a04c7-657f-45a0-9eff-59645b1ea3bd]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ba9852-9fde-4aea-89be-58e7dba40301]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:31:49 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:31:49 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:31:49 user nova-compute[74821]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)
Nov 06 13:31:49 user nova-compute[74821]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)
Nov 06 13:31:49 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:31:49 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:31:49 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:31:49 user nova-compute[74821]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)
Nov 06 13:31:49 user nova-compute[74821]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)
Nov 06 13:31:49 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.677s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] HCTL ('37', '-', '-', 0) found on session 34 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[30659d91-5d2c-4c9e-ba48-4dad56d80375]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bKeMCAXj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/392377818b8196e889922901bb678f357a6c57a5.converted --force-share --output=json" returned: 0 in 0.225s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "392377818b8196e889922901bb678f357a6c57a5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.099s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "392377818b8196e889922901bb678f357a6c57a5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "392377818b8196e889922901bb678f357a6c57a5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/392377818b8196e889922901bb678f357a6c57a5 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2a94d6-c16f-4f1f-a627-66e0dddc1615/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/392377818b8196e889922901bb678f357a6c57a5 --force-share --output=json" returned: 0 in 0.235s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/392377818b8196e889922901bb678f357a6c57a5,backing_fmt=raw /opt/stack/data/nova/instances/64ae6f5e-38a1-4871-8015-c2097f64b33b/disk.rescue {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/392377818b8196e889922901bb678f357a6c57a5,backing_fmt=raw /opt/stack/data/nova/instances/64ae6f5e-38a1-4871-8015-c2097f64b33b/disk.rescue" returned: 0 in 0.054s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "392377818b8196e889922901bb678f357a6c57a5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG nova.objects.instance [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lazy-loading 'migration_context' on Instance uuid 64ae6f5e-38a1-4871-8015-c2097f64b33b {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG nova.objects.base [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Object Instance<64ae6f5e-38a1-4871-8015-c2097f64b33b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Start _get_guest_xml network_info=[{"id": "ded8f989-f920-42ed-a158-04455e6abbc1", "address": "fa:16:3e:b2:3e:a6", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "vif_mac": "fa:16:3e:b2:3e:a6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8f989-f9", "ovs_interfaceid": "ded8f989-f920-42ed-a158-04455e6abbc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '32c18fc4-83b2-4e47-8b03-20ee0fe4647e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IBghSkKa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '64ae6f5e-38a1-4871-8015-c2097f64b33b', 'attached_at': '', 'detached_at': '', 'volume_id': '0b57743d-26b7-4805-a133-483e5e3cd42f', 'serial': '0b57743d-26b7-4805-a133-483e5e3cd42f'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '59550c62-1fed-45df-bebf-5f7f1360dd0c', 'volume_type': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG nova.objects.instance [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lazy-loading 'resources' on Instance uuid 64ae6f5e-38a1-4871-8015-c2097f64b33b {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG nova.objects.base [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Object Instance<64ae6f5e-38a1-4871-8015-c2097f64b33b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG nova.objects.instance [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lazy-loading 'numa_topology' on Instance uuid 64ae6f5e-38a1-4871-8015-c2097f64b33b {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG nova.objects.base [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Object Instance<64ae6f5e-38a1-4871-8015-c2097f64b33b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:31:49 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:31:49 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:31:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG nova.objects.instance [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lazy-loading 'vcpu_model' on Instance uuid 64ae6f5e-38a1-4871-8015-c2097f64b33b {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2a94d6-c16f-4f1f-a627-66e0dddc1615/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2a94d6-c16f-4f1f-a627-66e0dddc1615/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG nova.objects.base [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Object Instance<64ae6f5e-38a1-4871-8015-c2097f64b33b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:31:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IBghSkKa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:31:49 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:31:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2a94d6-c16f-4f1f-a627-66e0dddc1615/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.732s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] <== connect_volume: return (1737ms) {'type': 'block', 'scsi_wwn': '23966363964363865', 'path': '/dev/sdf'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966363964363865', 'path': '/dev/sdf'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.559s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:31:50 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:31:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:31:50 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:31:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG nova.objects.instance [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lazy-loading 'flavor' on Instance uuid 6121ff1a-d276-485f-85f8-ba451f5b0d37 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f -p 172.16.0.220:3260" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b5a032-c0f7-4bb3-99cd-85e93f69db57]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = IBghSkKa\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 06 13:31:50 user nova-compute[74821]: node.name = iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f
Nov 06 13:31:50 user nova-compute[74821]: node.tpgt = -1
Nov 06 13:31:50 user nova-compute[74821]: node.startup = automatic
Nov 06 13:31:50 user nova-compute[74821]: node.leading_login = No
Nov 06 13:31:50 user nova-compute[74821]: iface.iscsi_ifacename = default
Nov 06 13:31:50 user nova-compute[74821]: iface.net_ifacename = <empty>
Nov 06 13:31:50 user nova-compute[74821]: iface.ipaddress = <empty>
Nov 06 13:31:50 user nova-compute[74821]: iface.prefix_len = 0
Nov 06 13:31:50 user nova-compute[74821]: iface.hwaddress = <empty>
Nov 06 13:31:50 user nova-compute[74821]: iface.transport_name = tcp
Nov 06 13:31:50 user nova-compute[74821]: iface.initiatorname = <empty>
Nov 06 13:31:50 user nova-compute[74821]: iface.state = <empty>
Nov 06 13:31:50 user nova-compute[74821]: iface.vlan_id = 0
Nov 06 13:31:50 user nova-compute[74821]: iface.vlan_priority = 0
Nov 06 13:31:50 user nova-compute[74821]: iface.vlan_state = <empty>
Nov 06 13:31:50 user nova-compute[74821]: iface.iface_num = 0
Nov 06 13:31:50 user nova-compute[74821]: iface.mtu = 0
Nov 06 13:31:50 user nova-compute[74821]: iface.port = 0
Nov 06 13:31:50 user nova-compute[74821]: iface.bootproto = <empty>
Nov 06 13:31:50 user nova-compute[74821]: iface.subnet_mask = <empty>
Nov 06 13:31:50 user nova-compute[74821]: iface.gateway = <empty>
Nov 06 13:31:50 user nova-compute[74821]: iface.dhcp_alt_client_id_state = <empty>
Nov 06 13:31:50 user nova-compute[74821]: iface.dhcp_alt_client_id = <empty>
Nov 06 13:31:50 user nova-compute[74821]: iface.dhcp_dns = <empty>
Nov 06 13:31:50 user nova-compute[74821]: iface.dhcp_learn_iqn = <empty>
Nov 06 13:31:50 user nova-compute[74821]: iface.dhcp_req_vendor_id_state = <empty>
Nov 06 13:31:50 user nova-compute[74821]: iface.dhcp_vendor_id_state = <empty>
Nov 06 13:31:50 user nova-compute[74821]: iface.dhcp_vendor_id = <empty>
Nov 06 13:31:50 user nova-compute[74821]: iface.dhcp_slp_da = <empty>
Nov 06 13:31:50 user nova-compute[74821]: iface.fragmentation = <empty>
Nov 06 13:31:50 user nova-compute[74821]: iface.gratuitous_arp = <empty>
Nov 06 13:31:50 user nova-compute[74821]: iface.incoming_forwarding = <empty>
Nov 06 13:31:50 user nova-compute[74821]: iface.tos_state = <empty>
Nov 06 13:31:50 user nova-compute[74821]: iface.tos = 0
Nov 06 13:31:50 user nova-compute[74821]: iface.ttl = 0
Nov 06 13:31:50 user nova-compute[74821]: iface.delayed_ack = <empty>
Nov 06 13:31:50 user nova-compute[74821]: iface.tcp_nagle = <empty>
Nov 06 13:31:50 user nova-compute[74821]: iface.tcp_wsf_state = <empty>
Nov 06 13:31:50 user nova-compute[74821]: iface.tcp_wsf = 0
Nov 06 13:31:50 user nova-compute[74821]: iface.tcp_timer_scale = 0
Nov 06 13:31:50 user nova-compute[74821]: iface.tcp_timestamp = <empty>
Nov 06 13:31:50 user nova-compute[74821]: iface.redirect = <empty>
Nov 06 13:31:50 user nova-compute[74821]: iface.def_task_mgmt_timeout = 0
Nov 06 13:31:50 user nova-compute[74821]: iface.header_digest = <empty>
Nov 06 13:31:50 user nova-compute[74821]: iface.data_digest = <empty>
Nov 06 13:31:50 user nova-compute[74821]: iface.immediate_data = <empty>
Nov 06 13:31:50 user nova-compute[74821]: iface.initial_r2t = <empty>
Nov 06 13:31:50 user nova-compute[74821]: iface.data_seq_inorder = <empty>
Nov 06 13:31:50 user nova-compute[74821]: iface.data_pdu_inorder = <empty>
Nov 06 13:31:50 user nova-compute[74821]: iface.erl = 0
Nov 06 13:31:50 user nova-compute[74821]: iface.max_receive_data_len = 0
Nov 06 13:31:50 user nova-compute[74821]: iface.first_burst_len = 0
Nov 06 13:31:50 user nova-compute[74821]: iface.max_outstanding_r2t = 0
Nov 06 13:31:50 user nova-compute[74821]: iface.max_burst_len = 0
Nov 06 13:31:50 user nova-compute[74821]: iface.chap_auth = <empty>
Nov 06 13:31:50 user nova-compute[74821]: iface.bidi_chap = <empty>
Nov 06 13:31:50 user nova-compute[74821]: iface.strict_login_compliance = <empty>
Nov 06 13:31:50 user nova-compute[74821]: iface.discovery_auth = <empty>
Nov 06 13:31:50 user nova-compute[74821]: iface.discovery_logout = <empty>
Nov 06 13:31:50 user nova-compute[74821]: node.discovery_address = <empty>
Nov 06 13:31:50 user nova-compute[74821]: node.discovery_port = 0
Nov 06 13:31:50 user nova-compute[74821]: node.discovery_type = static
Nov 06 13:31:50 user nova-compute[74821]: node.session.initial_cmdsn = 0
Nov 06 13:31:50 user nova-compute[74821]: node.session.initial_login_retry_max = 8
Nov 06 13:31:50 user nova-compute[74821]: node.session.xmit_thread_priority = -20
Nov 06 13:31:50 user nova-compute[74821]: node.session.cmds_max = 128
Nov 06 13:31:50 user nova-compute[74821]: node.session.queue_depth = 32
Nov 06 13:31:50 user nova-compute[74821]: node.session.nr_sessions = 1
Nov 06 13:31:50 user nova-compute[74821]: node.session.auth.authmethod = CHAP
Nov 06 13:31:50 user nova-compute[74821]: node.session.auth.username = IBghSkKa
Nov 06 13:31:50 user nova-compute[74821]: node.session.auth.password = ***
Nov 06 13:31:50 user nova-compute[74821]: node.session.auth.username_in = <empty>
Nov 06 13:31:50 user nova-compute[74821]: node.session.auth.password_in = <empty>
Nov 06 13:31:50 user nova-compute[74821]: node.session.auth.chap_algs = MD5
Nov 06 13:31:50 user nova-compute[74821]: node.session.timeo.replacement_timeout = 120
Nov 06 13:31:50 user nova-compute[74821]: node.session.err_timeo.abort_timeout = 15
Nov 06 13:31:50 user nova-compute[74821]: node.session.err_timeo.lu_reset_timeout = 30
Nov 06 13:31:50 user nova-compute[74821]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 06 13:31:50 user nova-compute[74821]: node.session.err_timeo.host_reset_timeout = 60
Nov 06 13:31:50 user nova-compute[74821]: node.session.iscsi.FastAbort = Yes
Nov 06 13:31:50 user nova-compute[74821]: node.session.iscsi.InitialR2T = No
Nov 06 13:31:50 user nova-compute[74821]: node.session.iscsi.ImmediateData = Yes
Nov 06 13:31:50 user nova-compute[74821]: node.session.iscsi.FirstBurstLength = 262144
Nov 06 13:31:50 user nova-compute[74821]: node.session.iscsi.MaxBurstLength = 16776192
Nov 06 13:31:50 user nova-compute[74821]: node.session.iscsi.DefaultTime2Retain = 0
Nov 06 13:31:50 user nova-compute[74821]: node.session.iscsi.DefaultTime2Wait = 2
Nov 06 13:31:50 user nova-compute[74821]: node.session.iscsi.MaxConnections = 1
Nov 06 13:31:50 user nova-compute[74821]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 06 13:31:50 user nova-compute[74821]: node.session.iscsi.ERL = 0
Nov 06 13:31:50 user nova-compute[74821]: node.session.scan = manual
Nov 06 13:31:50 user nova-compute[74821]: node.session.reopen_max = 0
Nov 06 13:31:50 user nova-compute[74821]: node.conn[0].address = 172.16.0.220
Nov 06 13:31:50 user nova-compute[74821]: node.conn[0].port = 3260
Nov 06 13:31:50 user nova-compute[74821]: node.conn[0].startup = manual
Nov 06 13:31:50 user nova-compute[74821]: node.conn[0].tcp.window_size = 524288
Nov 06 13:31:50 user nova-compute[74821]: node.conn[0].tcp.type_of_service = 0
Nov 06 13:31:50 user nova-compute[74821]: node.conn[0].timeo.logout_timeout = 15
Nov 06 13:31:50 user nova-compute[74821]: node.conn[0].timeo.login_timeout = 15
Nov 06 13:31:50 user nova-compute[74821]: node.conn[0].timeo.auth_timeout = 45
Nov 06 13:31:50 user nova-compute[74821]: node.conn[0].timeo.noop_out_interval = 5
Nov 06 13:31:50 user nova-compute[74821]: node.conn[0].timeo.noop_out_timeout = 5
Nov 06 13:31:50 user nova-compute[74821]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 06 13:31:50 user nova-compute[74821]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 06 13:31:50 user nova-compute[74821]: node.conn[0].iscsi.HeaderDigest = None
Nov 06 13:31:50 user nova-compute[74821]: node.conn[0].iscsi.DataDigest = None
Nov 06 13:31:50 user nova-compute[74821]: node.conn[0].iscsi.IFMarker = No
Nov 06 13:31:50 user nova-compute[74821]: node.conn[0].iscsi.OFMarker = No
Nov 06 13:31:50 user nova-compute[74821]: # END RECORD
Nov 06 13:31:50 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 13:31:50 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:31:50 user nova-compute[74821]:   <source dev="/dev/sdf"/>
Nov 06 13:31:50 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:31:50 user nova-compute[74821]:   <serial>379ea2b9-c5af-4652-a630-572a70b50b82</serial>
Nov 06 13:31:50 user nova-compute[74821]: </disk>
Nov 06 13:31:50 user nova-compute[74821]:  {{(pid=74821) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e7342b-ab60-44aa-8d00-838b52969109]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb3610b-203f-4273-9a6f-043ab398cf14]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IBghSkKa {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IBghSkKa" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b47975-4954-4467-a982-4a6444810c0d]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IBghSkKa'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f84996-2595-4771-a325-82eac7d7245a]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecc9032-851b-475b-9b90-ed12d4a0ba5c]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:31:50 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:31:50 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:31:50 user nova-compute[74821]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)
Nov 06 13:31:50 user nova-compute[74821]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)
Nov 06 13:31:50 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:31:50 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:31:50 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:31:50 user nova-compute[74821]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)
Nov 06 13:31:50 user nova-compute[74821]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)
Nov 06 13:31:50 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.208s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] HCTL ('33', '0', '0', 0) found on session 30 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5dd819-e91e-46d5-8599-46d901b399cf]: (4, ('0 0 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Searching for a device in session 30 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IBghSkKa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.233s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] <== connect_volume: return (793ms) {'type': 'block', 'scsi_wwn': '23230376336373462', 'path': '/dev/sdb'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230376336373462', 'path': '/dev/sdb'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:28:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1606742164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1606742164',id=35,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:30:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f745a322931e4150b12d139bfb17b94c',ramdisk_id='',reservation_id='r-lvxyahl7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1064633830',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:30:18Z,user_data=None,user_id='133932d1063241078d84731624e89216',uuid=64ae6f5e-38a1-4871-8015-c2097f64b33b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ded8f989-f920-42ed-a158-04455e6abbc1", "address": "fa:16:3e:b2:3e:a6", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "vif_mac": "fa:16:3e:b2:3e:a6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8f989-f9", "ovs_interfaceid": "ded8f989-f920-42ed-a158-04455e6abbc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Converting VIF {"id": "ded8f989-f920-42ed-a158-04455e6abbc1", "address": "fa:16:3e:b2:3e:a6", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "vif_mac": "fa:16:3e:b2:3e:a6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8f989-f9", "ovs_interfaceid": "ded8f989-f920-42ed-a158-04455e6abbc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:3e:a6,bridge_name='br-int',has_traffic_filtering=True,id=ded8f989-f920-42ed-a158-04455e6abbc1,network=Network(354bf335-0cac-46d9-acb8-5095411f5db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapded8f989-f9') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG nova.objects.instance [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lazy-loading 'pci_devices' on Instance uuid 64ae6f5e-38a1-4871-8015-c2097f64b33b {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG nova.objects.base [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Object Instance<64ae6f5e-38a1-4871-8015-c2097f64b33b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:31:50 user nova-compute[74821]:   <uuid>64ae6f5e-38a1-4871-8015-c2097f64b33b</uuid>
Nov 06 13:31:50 user nova-compute[74821]:   <name>instance-00000023</name>
Nov 06 13:31:50 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:31:50 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:31:50 user nova-compute[74821]:   <metadata>
Nov 06 13:31:50 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:31:50 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:31:50 user nova-compute[74821]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1606742164</nova:name>
Nov 06 13:31:50 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:31:49</nova:creationTime>
Nov 06 13:31:50 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:31:50 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:31:50 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:31:50 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:31:50 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:31:50 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:31:50 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:31:50 user nova-compute[74821]:       <nova:owner>
Nov 06 13:31:50 user nova-compute[74821]:         <nova:user uuid="133932d1063241078d84731624e89216">tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member</nova:user>
Nov 06 13:31:50 user nova-compute[74821]:         <nova:project uuid="f745a322931e4150b12d139bfb17b94c">tempest-ServerBootFromVolumeStableRescueTest-1064633830</nova:project>
Nov 06 13:31:50 user nova-compute[74821]:       </nova:owner>
Nov 06 13:31:50 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:31:50 user nova-compute[74821]:       <nova:ports>
Nov 06 13:31:50 user nova-compute[74821]:         <nova:port uuid="ded8f989-f920-42ed-a158-04455e6abbc1">
Nov 06 13:31:50 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 06 13:31:50 user nova-compute[74821]:         </nova:port>
Nov 06 13:31:50 user nova-compute[74821]:       </nova:ports>
Nov 06 13:31:50 user nova-compute[74821]:     </nova:instance>
Nov 06 13:31:50 user nova-compute[74821]:   </metadata>
Nov 06 13:31:50 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:31:50 user nova-compute[74821]:     <system>
Nov 06 13:31:50 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:31:50 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:31:50 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:31:50 user nova-compute[74821]:       <entry name="serial">64ae6f5e-38a1-4871-8015-c2097f64b33b</entry>
Nov 06 13:31:50 user nova-compute[74821]:       <entry name="uuid">64ae6f5e-38a1-4871-8015-c2097f64b33b</entry>
Nov 06 13:31:50 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:31:50 user nova-compute[74821]:     </system>
Nov 06 13:31:50 user nova-compute[74821]:   </sysinfo>
Nov 06 13:31:50 user nova-compute[74821]:   <os>
Nov 06 13:31:50 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:31:50 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:31:50 user nova-compute[74821]:   </os>
Nov 06 13:31:50 user nova-compute[74821]:   <features>
Nov 06 13:31:50 user nova-compute[74821]:     <acpi/>
Nov 06 13:31:50 user nova-compute[74821]:     <apic/>
Nov 06 13:31:50 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:31:50 user nova-compute[74821]:   </features>
Nov 06 13:31:50 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:31:50 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:31:50 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:31:50 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:31:50 user nova-compute[74821]:   </clock>
Nov 06 13:31:50 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:31:50 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:31:50 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:31:50 user nova-compute[74821]:   </cpu>
Nov 06 13:31:50 user nova-compute[74821]:   <devices>
Nov 06 13:31:50 user nova-compute[74821]:     <disk type="block" device="disk">
Nov 06 13:31:50 user nova-compute[74821]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:31:50 user nova-compute[74821]:       <source dev="/dev/sdb"/>
Nov 06 13:31:50 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:31:50 user nova-compute[74821]:       <serial>0b57743d-26b7-4805-a133-483e5e3cd42f</serial>
Nov 06 13:31:50 user nova-compute[74821]:     </disk>
Nov 06 13:31:50 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:31:50 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:31:50 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/64ae6f5e-38a1-4871-8015-c2097f64b33b/disk.rescue"/>
Nov 06 13:31:50 user nova-compute[74821]:       <target dev="vdb" bus="virtio"/>
Nov 06 13:31:50 user nova-compute[74821]:       <boot order="1"/>
Nov 06 13:31:50 user nova-compute[74821]:     </disk>
Nov 06 13:31:50 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:31:50 user nova-compute[74821]:       <mac address="fa:16:3e:b2:3e:a6"/>
Nov 06 13:31:50 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:31:50 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:31:50 user nova-compute[74821]:       <target dev="tapded8f989-f9"/>
Nov 06 13:31:50 user nova-compute[74821]:     </interface>
Nov 06 13:31:50 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:31:50 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/64ae6f5e-38a1-4871-8015-c2097f64b33b/console.log" append="off"/>
Nov 06 13:31:50 user nova-compute[74821]:     </serial>
Nov 06 13:31:50 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:31:50 user nova-compute[74821]:     <video>
Nov 06 13:31:50 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:31:50 user nova-compute[74821]:     </video>
Nov 06 13:31:50 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:31:50 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:31:50 user nova-compute[74821]:     </rng>
Nov 06 13:31:50 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:31:50 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:31:50 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:31:50 user nova-compute[74821]:     </memballoon>
Nov 06 13:31:50 user nova-compute[74821]:   </devices>
Nov 06 13:31:50 user nova-compute[74821]: </domain>
Nov 06 13:31:50 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:31:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:50 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Instance destroyed successfully.
Nov 06 13:31:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:31:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:31:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] No VIF found with MAC fa:16:3e:b2:3e:a6, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:31:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:31:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:31:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] No VIF found with MAC fa:16:3e:9c:4f:f3, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:31:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c447ff08-bee8-4884-be98-44218816b5dc tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "6121ff1a-d276-485f-85f8-ba451f5b0d37" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.082s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:31:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:51 user nova-compute[74821]: DEBUG nova.compute.manager [req-77c08d88-c6df-47e5-a110-e4ec0338da3c req-51791466-7a51-418d-b999-7ec16a9948bc service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Received event network-vif-plugged-30866a49-b7d0-458d-87a6-e97d3c533640 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:31:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-77c08d88-c6df-47e5-a110-e4ec0338da3c req-51791466-7a51-418d-b999-7ec16a9948bc service nova] Acquiring lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:31:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-77c08d88-c6df-47e5-a110-e4ec0338da3c req-51791466-7a51-418d-b999-7ec16a9948bc service nova] Lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:31:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-77c08d88-c6df-47e5-a110-e4ec0338da3c req-51791466-7a51-418d-b999-7ec16a9948bc service nova] Lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:31:51 user nova-compute[74821]: DEBUG nova.compute.manager [req-77c08d88-c6df-47e5-a110-e4ec0338da3c req-51791466-7a51-418d-b999-7ec16a9948bc service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] No waiting events found dispatching network-vif-plugged-30866a49-b7d0-458d-87a6-e97d3c533640 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:31:51 user nova-compute[74821]: WARNING nova.compute.manager [req-77c08d88-c6df-47e5-a110-e4ec0338da3c req-51791466-7a51-418d-b999-7ec16a9948bc service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Received unexpected event network-vif-plugged-30866a49-b7d0-458d-87a6-e97d3c533640 for instance with vm_state building and task_state spawning.
Nov 06 13:31:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:51 user nova-compute[74821]: DEBUG nova.compute.manager [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:31:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:31:51 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Instance spawned successfully.
Nov 06 13:31:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:31:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:31:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:31:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:31:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:31:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:31:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:31:51 user nova-compute[74821]: INFO nova.compute.manager [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Took 7.16 seconds to spawn the instance on the hypervisor.
Nov 06 13:31:51 user nova-compute[74821]: DEBUG nova.compute.manager [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:31:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:51 user nova-compute[74821]: INFO nova.compute.manager [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Took 8.41 seconds to build instance.
Nov 06 13:31:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-54abac55-d958-41e6-9f5b-551ae7f86c42 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.537s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:31:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e80a3f77-8f29-4f18-9707-c9793a124cc6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e80a3f77-8f29-4f18-9707-c9793a124cc6/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e80a3f77-8f29-4f18-9707-c9793a124cc6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e80a3f77-8f29-4f18-9707-c9793a124cc6/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:31:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-10110cfe-c3ac-42e8-999b-58ea7763a29d req-7e718bf5-8fc2-4918-80b5-43dc0b3feed5 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Received event network-vif-plugged-ded8f989-f920-42ed-a158-04455e6abbc1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:31:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-10110cfe-c3ac-42e8-999b-58ea7763a29d req-7e718bf5-8fc2-4918-80b5-43dc0b3feed5 service nova] Acquiring lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:31:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-10110cfe-c3ac-42e8-999b-58ea7763a29d req-7e718bf5-8fc2-4918-80b5-43dc0b3feed5 service nova] Lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:31:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-10110cfe-c3ac-42e8-999b-58ea7763a29d req-7e718bf5-8fc2-4918-80b5-43dc0b3feed5 service nova] Lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:31:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-10110cfe-c3ac-42e8-999b-58ea7763a29d req-7e718bf5-8fc2-4918-80b5-43dc0b3feed5 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] No waiting events found dispatching network-vif-plugged-ded8f989-f920-42ed-a158-04455e6abbc1 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:31:52 user nova-compute[74821]: WARNING nova.compute.manager [req-10110cfe-c3ac-42e8-999b-58ea7763a29d req-7e718bf5-8fc2-4918-80b5-43dc0b3feed5 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Received unexpected event network-vif-plugged-ded8f989-f920-42ed-a158-04455e6abbc1 for instance with vm_state active and task_state rescuing.
Nov 06 13:31:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:53 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:31:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:55 user nova-compute[74821]: DEBUG nova.compute.manager [req-4e82d76b-16bb-422a-b2da-d38b327bc7a2 req-4a8416e9-f614-4f58-9d62-6d1f5df9f840 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Received event network-vif-plugged-ded8f989-f920-42ed-a158-04455e6abbc1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:31:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4e82d76b-16bb-422a-b2da-d38b327bc7a2 req-4a8416e9-f614-4f58-9d62-6d1f5df9f840 service nova] Acquiring lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:31:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4e82d76b-16bb-422a-b2da-d38b327bc7a2 req-4a8416e9-f614-4f58-9d62-6d1f5df9f840 service nova] Lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:31:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4e82d76b-16bb-422a-b2da-d38b327bc7a2 req-4a8416e9-f614-4f58-9d62-6d1f5df9f840 service nova] Lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:31:55 user nova-compute[74821]: DEBUG nova.compute.manager [req-4e82d76b-16bb-422a-b2da-d38b327bc7a2 req-4a8416e9-f614-4f58-9d62-6d1f5df9f840 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] No waiting events found dispatching network-vif-plugged-ded8f989-f920-42ed-a158-04455e6abbc1 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:31:55 user nova-compute[74821]: WARNING nova.compute.manager [req-4e82d76b-16bb-422a-b2da-d38b327bc7a2 req-4a8416e9-f614-4f58-9d62-6d1f5df9f840 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Received unexpected event network-vif-plugged-ded8f989-f920-42ed-a158-04455e6abbc1 for instance with vm_state active and task_state rescuing.
Nov 06 13:31:55 user nova-compute[74821]: DEBUG nova.compute.manager [None req-ad41119c-5b51-4531-bf43-f7f93527a717 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:31:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "f7b2673b-023a-46eb-88ea-2fa42c33b173" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:31:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "f7b2673b-023a-46eb-88ea-2fa42c33b173" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:31:55 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:31:55 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:31:55 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=7460MB free_disk=24.721240997314453GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:31:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:31:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:31:55 user nova-compute[74821]: DEBUG nova.compute.manager [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:31:55 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Applying migration context for instance d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8 as it has an incoming, in-progress migration adaac260-5214-4b8e-952e-65a22f39b3da. Migration status is finished {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 06 13:31:55 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Applying migration context for instance 2d8da345-f66d-45c2-8ccd-d22fdf79a14d as it has an incoming, in-progress migration f36ec03b-bcd7-43fc-b827-f385033a26f4. Migration status is finished {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 06 13:31:55 user nova-compute[74821]: INFO nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Updating resource usage from migration adaac260-5214-4b8e-952e-65a22f39b3da
Nov 06 13:31:55 user nova-compute[74821]: INFO nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Updating resource usage from migration f36ec03b-bcd7-43fc-b827-f385033a26f4
Nov 06 13:31:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:31:55 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 2de346cb-9858-47b8-a86c-4fde720d6127 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:31:55 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 49c65aca-8392-46ba-8fa3-b47ff2416cb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:31:55 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 496f8213-4b32-4211-a354-e33a4a088848 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:31:55 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 1290bdb3-827f-4365-a4f1-4ae063de780d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:31:55 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 4bc6444e-b55d-4d81-88d1-f4d147255119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:31:55 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 64ae6f5e-38a1-4871-8015-c2097f64b33b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:31:55 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 6121ff1a-d276-485f-85f8-ba451f5b0d37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:31:55 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Migration adaac260-5214-4b8e-952e-65a22f39b3da is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 06 13:31:55 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:31:55 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance e80a3f77-8f29-4f18-9707-c9793a124cc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:31:55 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Migration f36ec03b-bcd7-43fc-b827-f385033a26f4 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 06 13:31:55 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 2d8da345-f66d-45c2-8ccd-d22fdf79a14d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:31:55 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 6f2a94d6-c16f-4f1f-a627-66e0dddc1615 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:31:55 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 8467fdc8-ec8e-4eda-abbc-b146e58e90c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:31:55 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance f7b2673b-023a-46eb-88ea-2fa42c33b173 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 06 13:31:55 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:31:55 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=10752MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:31:55 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Refreshing inventories for resource provider a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 13:31:55 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Updating ProviderTree inventory for provider a45ec519-15f5-48fe-877b-466db09f8afe from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 13:31:55 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Updating inventory in ProviderTree for provider a45ec519-15f5-48fe-877b-466db09f8afe with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 13:31:55 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Refreshing aggregate associations for resource provider a45ec519-15f5-48fe-877b-466db09f8afe, aggregates: None {{(pid=74821) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 13:31:55 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Refreshing trait associations for resource provider a45ec519-15f5-48fe-877b-466db09f8afe, traits: COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42 {{(pid=74821) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 13:31:56 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:31:56 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:31:56 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:31:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.019s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:31:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.796s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:31:56 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:31:56 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Cleaning up deleted instances with incomplete migration  {{(pid=74821) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 13:31:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:31:56 user nova-compute[74821]: INFO nova.compute.claims [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Claim successful on node user
Nov 06 13:31:56 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:31:56 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:31:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.596s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:31:57 user nova-compute[74821]: DEBUG nova.compute.manager [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:31:57 user nova-compute[74821]: DEBUG nova.compute.manager [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:31:57 user nova-compute[74821]: DEBUG nova.network.neutron [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:31:57 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:31:57 user nova-compute[74821]: DEBUG nova.compute.manager [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:31:57 user nova-compute[74821]: DEBUG nova.policy [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5ffddfc972374f6aa7d81288d34690cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6d2ded0b1d4af09f1e05582bcbd3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:31:57 user nova-compute[74821]: DEBUG nova.compute.manager [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:31:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:31:57 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Creating image(s)
Nov 06 13:31:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "/opt/stack/data/nova/instances/f7b2673b-023a-46eb-88ea-2fa42c33b173/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:31:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "/opt/stack/data/nova/instances/f7b2673b-023a-46eb-88ea-2fa42c33b173/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:31:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "/opt/stack/data/nova/instances/f7b2673b-023a-46eb-88ea-2fa42c33b173/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:31:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.189s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:31:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:31:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.215s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/f7b2673b-023a-46eb-88ea-2fa42c33b173/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/f7b2673b-023a-46eb-88ea-2fa42c33b173/disk 1073741824" returned: 0 in 0.052s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:31:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.204s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:57 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f7b2673b-023a-46eb-88ea-2fa42c33b173/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:31:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b2673b-023a-46eb-88ea-2fa42c33b173/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:31:58 user nova-compute[74821]: DEBUG nova.network.neutron [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Successfully created port: ca4bd1cf-c2c7-43c3-81db-5cda9a48d593 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:31:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b2673b-023a-46eb-88ea-2fa42c33b173/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:31:58 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Cannot resize image /opt/stack/data/nova/instances/f7b2673b-023a-46eb-88ea-2fa42c33b173/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:31:58 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:31:58 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Ensure instance console log exists: /opt/stack/data/nova/instances/f7b2673b-023a-46eb-88ea-2fa42c33b173/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:31:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:31:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:31:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:31:58 user nova-compute[74821]: DEBUG nova.network.neutron [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Successfully updated port: ca4bd1cf-c2c7-43c3-81db-5cda9a48d593 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:31:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "refresh_cache-f7b2673b-023a-46eb-88ea-2fa42c33b173" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:31:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquired lock "refresh_cache-f7b2673b-023a-46eb-88ea-2fa42c33b173" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:31:58 user nova-compute[74821]: DEBUG nova.network.neutron [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:31:58 user nova-compute[74821]: DEBUG nova.compute.manager [req-83d30083-8c26-445d-b9ed-c3ee7a2875b6 req-5fd9e1e8-0525-4ad9-9c95-08e6c59458b8 service nova] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Received event network-changed-ca4bd1cf-c2c7-43c3-81db-5cda9a48d593 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:31:58 user nova-compute[74821]: DEBUG nova.compute.manager [req-83d30083-8c26-445d-b9ed-c3ee7a2875b6 req-5fd9e1e8-0525-4ad9-9c95-08e6c59458b8 service nova] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Refreshing instance network info cache due to event network-changed-ca4bd1cf-c2c7-43c3-81db-5cda9a48d593. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:31:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-83d30083-8c26-445d-b9ed-c3ee7a2875b6 req-5fd9e1e8-0525-4ad9-9c95-08e6c59458b8 service nova] Acquiring lock "refresh_cache-f7b2673b-023a-46eb-88ea-2fa42c33b173" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:31:58 user nova-compute[74821]: DEBUG nova.network.neutron [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:31:58 user nova-compute[74821]: DEBUG nova.network.neutron [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Updating instance_info_cache with network_info: [{"id": "ca4bd1cf-c2c7-43c3-81db-5cda9a48d593", "address": "fa:16:3e:a5:1d:46", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4bd1cf-c2", "ovs_interfaceid": "ca4bd1cf-c2c7-43c3-81db-5cda9a48d593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:31:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Releasing lock "refresh_cache-f7b2673b-023a-46eb-88ea-2fa42c33b173" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:31:58 user nova-compute[74821]: DEBUG nova.compute.manager [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Instance network_info: |[{"id": "ca4bd1cf-c2c7-43c3-81db-5cda9a48d593", "address": "fa:16:3e:a5:1d:46", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4bd1cf-c2", "ovs_interfaceid": "ca4bd1cf-c2c7-43c3-81db-5cda9a48d593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:31:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-83d30083-8c26-445d-b9ed-c3ee7a2875b6 req-5fd9e1e8-0525-4ad9-9c95-08e6c59458b8 service nova] Acquired lock "refresh_cache-f7b2673b-023a-46eb-88ea-2fa42c33b173" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:31:58 user nova-compute[74821]: DEBUG nova.network.neutron [req-83d30083-8c26-445d-b9ed-c3ee7a2875b6 req-5fd9e1e8-0525-4ad9-9c95-08e6c59458b8 service nova] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Refreshing network info cache for port ca4bd1cf-c2c7-43c3-81db-5cda9a48d593 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Start _get_guest_xml network_info=[{"id": "ca4bd1cf-c2c7-43c3-81db-5cda9a48d593", "address": "fa:16:3e:a5:1d:46", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4bd1cf-c2", "ovs_interfaceid": "ca4bd1cf-c2c7-43c3-81db-5cda9a48d593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:31:59 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:31:59 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:31:59 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:31:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1814398905',display_name='tempest-AttachVolumeNegativeTest-server-1814398905',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1814398905',id=40,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXSfyFLtJ2SYAUk29F2WDVG8Lp04fJ9oKPLR4VCROb5auH7r7yLMEswsgPSjsulV3Q1gLFmUfc7sI53l90/RlEPvMv5DJO+Swqb9kIKN9Biav3H/PTtO2kDME8kHL468g==',key_name='tempest-keypair-1512070866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c6d2ded0b1d4af09f1e05582bcbd3ae',ramdisk_id='',reservation_id='r-e2wcr4vk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1164383705',owner_user_name='tempest-AttachVolumeNegativeTest-1164383705-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:31:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ffddfc972374f6aa7d81288d34690cf',uuid=f7b2673b-023a-46eb-88ea-2fa42c33b173,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca4bd1cf-c2c7-43c3-81db-5cda9a48d593", "address": "fa:16:3e:a5:1d:46", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4bd1cf-c2", "ovs_interfaceid": "ca4bd1cf-c2c7-43c3-81db-5cda9a48d593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Converting VIF {"id": "ca4bd1cf-c2c7-43c3-81db-5cda9a48d593", "address": "fa:16:3e:a5:1d:46", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4bd1cf-c2", "ovs_interfaceid": "ca4bd1cf-c2c7-43c3-81db-5cda9a48d593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:1d:46,bridge_name='br-int',has_traffic_filtering=True,id=ca4bd1cf-c2c7-43c3-81db-5cda9a48d593,network=Network(3e1f6a20-5316-4c49-93a5-deabb70d8608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4bd1cf-c2') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG nova.objects.instance [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lazy-loading 'pci_devices' on Instance uuid f7b2673b-023a-46eb-88ea-2fa42c33b173 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:31:59 user nova-compute[74821]:   <uuid>f7b2673b-023a-46eb-88ea-2fa42c33b173</uuid>
Nov 06 13:31:59 user nova-compute[74821]:   <name>instance-00000028</name>
Nov 06 13:31:59 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:31:59 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:31:59 user nova-compute[74821]:   <metadata>
Nov 06 13:31:59 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:31:59 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:31:59 user nova-compute[74821]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1814398905</nova:name>
Nov 06 13:31:59 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:31:59</nova:creationTime>
Nov 06 13:31:59 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:31:59 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:31:59 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:31:59 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:31:59 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:31:59 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:31:59 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:31:59 user nova-compute[74821]:       <nova:owner>
Nov 06 13:31:59 user nova-compute[74821]:         <nova:user uuid="5ffddfc972374f6aa7d81288d34690cf">tempest-AttachVolumeNegativeTest-1164383705-project-member</nova:user>
Nov 06 13:31:59 user nova-compute[74821]:         <nova:project uuid="4c6d2ded0b1d4af09f1e05582bcbd3ae">tempest-AttachVolumeNegativeTest-1164383705</nova:project>
Nov 06 13:31:59 user nova-compute[74821]:       </nova:owner>
Nov 06 13:31:59 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:31:59 user nova-compute[74821]:       <nova:ports>
Nov 06 13:31:59 user nova-compute[74821]:         <nova:port uuid="ca4bd1cf-c2c7-43c3-81db-5cda9a48d593">
Nov 06 13:31:59 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 06 13:31:59 user nova-compute[74821]:         </nova:port>
Nov 06 13:31:59 user nova-compute[74821]:       </nova:ports>
Nov 06 13:31:59 user nova-compute[74821]:     </nova:instance>
Nov 06 13:31:59 user nova-compute[74821]:   </metadata>
Nov 06 13:31:59 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:31:59 user nova-compute[74821]:     <system>
Nov 06 13:31:59 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:31:59 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:31:59 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:31:59 user nova-compute[74821]:       <entry name="serial">f7b2673b-023a-46eb-88ea-2fa42c33b173</entry>
Nov 06 13:31:59 user nova-compute[74821]:       <entry name="uuid">f7b2673b-023a-46eb-88ea-2fa42c33b173</entry>
Nov 06 13:31:59 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:31:59 user nova-compute[74821]:     </system>
Nov 06 13:31:59 user nova-compute[74821]:   </sysinfo>
Nov 06 13:31:59 user nova-compute[74821]:   <os>
Nov 06 13:31:59 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:31:59 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:31:59 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:31:59 user nova-compute[74821]:   </os>
Nov 06 13:31:59 user nova-compute[74821]:   <features>
Nov 06 13:31:59 user nova-compute[74821]:     <acpi/>
Nov 06 13:31:59 user nova-compute[74821]:     <apic/>
Nov 06 13:31:59 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:31:59 user nova-compute[74821]:   </features>
Nov 06 13:31:59 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:31:59 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:31:59 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:31:59 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:31:59 user nova-compute[74821]:   </clock>
Nov 06 13:31:59 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:31:59 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:31:59 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:31:59 user nova-compute[74821]:   </cpu>
Nov 06 13:31:59 user nova-compute[74821]:   <devices>
Nov 06 13:31:59 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:31:59 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:31:59 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/f7b2673b-023a-46eb-88ea-2fa42c33b173/disk"/>
Nov 06 13:31:59 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:31:59 user nova-compute[74821]:     </disk>
Nov 06 13:31:59 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:31:59 user nova-compute[74821]:       <mac address="fa:16:3e:a5:1d:46"/>
Nov 06 13:31:59 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:31:59 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:31:59 user nova-compute[74821]:       <target dev="tapca4bd1cf-c2"/>
Nov 06 13:31:59 user nova-compute[74821]:     </interface>
Nov 06 13:31:59 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:31:59 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/f7b2673b-023a-46eb-88ea-2fa42c33b173/console.log" append="off"/>
Nov 06 13:31:59 user nova-compute[74821]:     </serial>
Nov 06 13:31:59 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:31:59 user nova-compute[74821]:     <video>
Nov 06 13:31:59 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:31:59 user nova-compute[74821]:     </video>
Nov 06 13:31:59 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:31:59 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:31:59 user nova-compute[74821]:     </rng>
Nov 06 13:31:59 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:31:59 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:31:59 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:31:59 user nova-compute[74821]:     </memballoon>
Nov 06 13:31:59 user nova-compute[74821]:   </devices>
Nov 06 13:31:59 user nova-compute[74821]: </domain>
Nov 06 13:31:59 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:31:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1814398905',display_name='tempest-AttachVolumeNegativeTest-server-1814398905',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1814398905',id=40,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXSfyFLtJ2SYAUk29F2WDVG8Lp04fJ9oKPLR4VCROb5auH7r7yLMEswsgPSjsulV3Q1gLFmUfc7sI53l90/RlEPvMv5DJO+Swqb9kIKN9Biav3H/PTtO2kDME8kHL468g==',key_name='tempest-keypair-1512070866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c6d2ded0b1d4af09f1e05582bcbd3ae',ramdisk_id='',reservation_id='r-e2wcr4vk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1164383705',owner_user_name='tempest-AttachVolumeNegativeTest-1164383705-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:31:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ffddfc972374f6aa7d81288d34690cf',uuid=f7b2673b-023a-46eb-88ea-2fa42c33b173,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca4bd1cf-c2c7-43c3-81db-5cda9a48d593", "address": "fa:16:3e:a5:1d:46", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4bd1cf-c2", "ovs_interfaceid": "ca4bd1cf-c2c7-43c3-81db-5cda9a48d593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Converting VIF {"id": "ca4bd1cf-c2c7-43c3-81db-5cda9a48d593", "address": "fa:16:3e:a5:1d:46", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4bd1cf-c2", "ovs_interfaceid": "ca4bd1cf-c2c7-43c3-81db-5cda9a48d593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:1d:46,bridge_name='br-int',has_traffic_filtering=True,id=ca4bd1cf-c2c7-43c3-81db-5cda9a48d593,network=Network(3e1f6a20-5316-4c49-93a5-deabb70d8608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4bd1cf-c2') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG os_vif [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:1d:46,bridge_name='br-int',has_traffic_filtering=True,id=ca4bd1cf-c2c7-43c3-81db-5cda9a48d593,network=Network(3e1f6a20-5316-4c49-93a5-deabb70d8608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4bd1cf-c2') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6384c5e3-5d3a-502e-8abd-62bbe701e849', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca4bd1cf-c2, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapca4bd1cf-c2, col_values=(('qos', UUID('a55b6ee8-6886-44e5-92a7-6aa3e4bd9226')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapca4bd1cf-c2, col_values=(('external_ids', {'iface-id': 'ca4bd1cf-c2c7-43c3-81db-5cda9a48d593', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:1d:46', 'vm-uuid': 'f7b2673b-023a-46eb-88ea-2fa42c33b173'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:31:59 user nova-compute[74821]: INFO os_vif [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:1d:46,bridge_name='br-int',has_traffic_filtering=True,id=ca4bd1cf-c2c7-43c3-81db-5cda9a48d593,network=Network(3e1f6a20-5316-4c49-93a5-deabb70d8608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4bd1cf-c2')
Nov 06 13:31:59 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] No VIF found with MAC fa:16:3e:a5:1d:46, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG nova.network.neutron [req-83d30083-8c26-445d-b9ed-c3ee7a2875b6 req-5fd9e1e8-0525-4ad9-9c95-08e6c59458b8 service nova] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Updated VIF entry in instance network info cache for port ca4bd1cf-c2c7-43c3-81db-5cda9a48d593. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG nova.network.neutron [req-83d30083-8c26-445d-b9ed-c3ee7a2875b6 req-5fd9e1e8-0525-4ad9-9c95-08e6c59458b8 service nova] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Updating instance_info_cache with network_info: [{"id": "ca4bd1cf-c2c7-43c3-81db-5cda9a48d593", "address": "fa:16:3e:a5:1d:46", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4bd1cf-c2", "ovs_interfaceid": "ca4bd1cf-c2c7-43c3-81db-5cda9a48d593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-83d30083-8c26-445d-b9ed-c3ee7a2875b6 req-5fd9e1e8-0525-4ad9-9c95-08e6c59458b8 service nova] Releasing lock "refresh_cache-f7b2673b-023a-46eb-88ea-2fa42c33b173" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:31:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:00 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:32:00 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:00 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:00 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:00 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:01 user nova-compute[74821]: DEBUG nova.compute.manager [req-b5e44b76-baff-4dcd-b269-5cc65e848194 req-210ee014-ac33-4c9e-996f-ee4a98f05aca service nova] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Received event network-vif-plugged-ca4bd1cf-c2c7-43c3-81db-5cda9a48d593 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:32:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b5e44b76-baff-4dcd-b269-5cc65e848194 req-210ee014-ac33-4c9e-996f-ee4a98f05aca service nova] Acquiring lock "f7b2673b-023a-46eb-88ea-2fa42c33b173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:32:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b5e44b76-baff-4dcd-b269-5cc65e848194 req-210ee014-ac33-4c9e-996f-ee4a98f05aca service nova] Lock "f7b2673b-023a-46eb-88ea-2fa42c33b173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:32:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b5e44b76-baff-4dcd-b269-5cc65e848194 req-210ee014-ac33-4c9e-996f-ee4a98f05aca service nova] Lock "f7b2673b-023a-46eb-88ea-2fa42c33b173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:32:01 user nova-compute[74821]: DEBUG nova.compute.manager [req-b5e44b76-baff-4dcd-b269-5cc65e848194 req-210ee014-ac33-4c9e-996f-ee4a98f05aca service nova] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] No waiting events found dispatching network-vif-plugged-ca4bd1cf-c2c7-43c3-81db-5cda9a48d593 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:32:01 user nova-compute[74821]: WARNING nova.compute.manager [req-b5e44b76-baff-4dcd-b269-5cc65e848194 req-210ee014-ac33-4c9e-996f-ee4a98f05aca service nova] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Received unexpected event network-vif-plugged-ca4bd1cf-c2c7-43c3-81db-5cda9a48d593 for instance with vm_state building and task_state spawning.
Nov 06 13:32:03 user nova-compute[74821]: DEBUG nova.compute.manager [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:32:03 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:32:03 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Instance spawned successfully.
Nov 06 13:32:03 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:32:03 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:32:03 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:32:03 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:32:03 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:32:03 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:32:03 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:32:03 user nova-compute[74821]: DEBUG nova.compute.manager [req-9c441393-4f00-4d8d-a564-d528e7cc3f15 req-363eeb1d-abf5-41f5-9c40-ea77a033d813 service nova] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Received event network-vif-plugged-ca4bd1cf-c2c7-43c3-81db-5cda9a48d593 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:32:03 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-9c441393-4f00-4d8d-a564-d528e7cc3f15 req-363eeb1d-abf5-41f5-9c40-ea77a033d813 service nova] Acquiring lock "f7b2673b-023a-46eb-88ea-2fa42c33b173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:32:03 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-9c441393-4f00-4d8d-a564-d528e7cc3f15 req-363eeb1d-abf5-41f5-9c40-ea77a033d813 service nova] Lock "f7b2673b-023a-46eb-88ea-2fa42c33b173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:32:03 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-9c441393-4f00-4d8d-a564-d528e7cc3f15 req-363eeb1d-abf5-41f5-9c40-ea77a033d813 service nova] Lock "f7b2673b-023a-46eb-88ea-2fa42c33b173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:32:03 user nova-compute[74821]: DEBUG nova.compute.manager [req-9c441393-4f00-4d8d-a564-d528e7cc3f15 req-363eeb1d-abf5-41f5-9c40-ea77a033d813 service nova] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] No waiting events found dispatching network-vif-plugged-ca4bd1cf-c2c7-43c3-81db-5cda9a48d593 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:32:03 user nova-compute[74821]: WARNING nova.compute.manager [req-9c441393-4f00-4d8d-a564-d528e7cc3f15 req-363eeb1d-abf5-41f5-9c40-ea77a033d813 service nova] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Received unexpected event network-vif-plugged-ca4bd1cf-c2c7-43c3-81db-5cda9a48d593 for instance with vm_state building and task_state spawning.
Nov 06 13:32:03 user nova-compute[74821]: INFO nova.compute.manager [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Took 5.99 seconds to spawn the instance on the hypervisor.
Nov 06 13:32:03 user nova-compute[74821]: DEBUG nova.compute.manager [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:32:03 user nova-compute[74821]: INFO nova.compute.manager [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Took 7.90 seconds to build instance.
Nov 06 13:32:03 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-379caa59-8f26-4168-b3b9-0a2c37f2bde4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "f7b2673b-023a-46eb-88ea-2fa42c33b173" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:32:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:05 user nova-compute[74821]: DEBUG nova.compute.manager [req-df043497-2872-4e04-b18c-456732963881 req-14fc5bcb-ebf6-416e-8e41-c36a2fab97d6 service nova] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Received event network-changed-6d137b0d-23f0-478c-a6a9-b4fc955ce4c2 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:32:05 user nova-compute[74821]: DEBUG nova.compute.manager [req-df043497-2872-4e04-b18c-456732963881 req-14fc5bcb-ebf6-416e-8e41-c36a2fab97d6 service nova] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Refreshing instance network info cache due to event network-changed-6d137b0d-23f0-478c-a6a9-b4fc955ce4c2. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:32:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-df043497-2872-4e04-b18c-456732963881 req-14fc5bcb-ebf6-416e-8e41-c36a2fab97d6 service nova] Acquiring lock "refresh_cache-e80a3f77-8f29-4f18-9707-c9793a124cc6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:32:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-df043497-2872-4e04-b18c-456732963881 req-14fc5bcb-ebf6-416e-8e41-c36a2fab97d6 service nova] Acquired lock "refresh_cache-e80a3f77-8f29-4f18-9707-c9793a124cc6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:32:05 user nova-compute[74821]: DEBUG nova.network.neutron [req-df043497-2872-4e04-b18c-456732963881 req-14fc5bcb-ebf6-416e-8e41-c36a2fab97d6 service nova] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Refreshing network info cache for port 6d137b0d-23f0-478c-a6a9-b4fc955ce4c2 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:32:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Acquiring lock "e80a3f77-8f29-4f18-9707-c9793a124cc6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:32:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "e80a3f77-8f29-4f18-9707-c9793a124cc6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:32:05 user nova-compute[74821]: DEBUG nova.objects.instance [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lazy-loading 'flavor' on Instance uuid e80a3f77-8f29-4f18-9707-c9793a124cc6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:32:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "e80a3f77-8f29-4f18-9707-c9793a124cc6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.154s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:32:06 user nova-compute[74821]: DEBUG nova.network.neutron [req-df043497-2872-4e04-b18c-456732963881 req-14fc5bcb-ebf6-416e-8e41-c36a2fab97d6 service nova] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Updated VIF entry in instance network info cache for port 6d137b0d-23f0-478c-a6a9-b4fc955ce4c2. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:32:06 user nova-compute[74821]: DEBUG nova.network.neutron [req-df043497-2872-4e04-b18c-456732963881 req-14fc5bcb-ebf6-416e-8e41-c36a2fab97d6 service nova] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Updating instance_info_cache with network_info: [{"id": "6d137b0d-23f0-478c-a6a9-b4fc955ce4c2", "address": "fa:16:3e:57:6c:0b", "network": {"id": "5e673907-9763-4136-845d-b3154200d004", "bridge": "br-int", "label": "tempest-TestStampPattern-539864653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608cf017c43942a4a94982b1d5d4d2b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d137b0d-23", "ovs_interfaceid": "6d137b0d-23f0-478c-a6a9-b4fc955ce4c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:32:06 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Acquiring lock "e80a3f77-8f29-4f18-9707-c9793a124cc6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:32:06 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "e80a3f77-8f29-4f18-9707-c9793a124cc6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:32:06 user nova-compute[74821]: INFO nova.compute.manager [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Attaching volume 6a6f7564-9cb9-423c-aae2-5ee36dca41a9 to /dev/vdb
Nov 06 13:32:06 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-df043497-2872-4e04-b18c-456732963881 req-14fc5bcb-ebf6-416e-8e41-c36a2fab97d6 service nova] Releasing lock "refresh_cache-e80a3f77-8f29-4f18-9707-c9793a124cc6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:32:06 user nova-compute[74821]: DEBUG os_brick.utils [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:32:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:06 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13f736a-f84d-4605-8543-e956b654da0b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:06 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cddb2e-28ea-4dda-87b0-8cca2bd01035]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:06 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0513d56a-c982-4d7c-8a82-613b6205401b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:06 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d9815e-f208-4a97-8a08-6dd1f3d4fd52]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:32:06 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:32:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:32:06 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:32:06 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b31756d-fe39-4732-9f80-bf5099fc3190]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:06 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:32:06 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:32:06 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:32:06 user nova-compute[74821]: DEBUG os_brick.utils [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:32:06 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Updating existing volume attachment record: b71c4198-95a5-4586-86e5-4b2939ff06c7 {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:32:08 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:32:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:14 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:14 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:17 user nova-compute[74821]: DEBUG nova.network.neutron [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Port f768a2c5-10b0-4442-9c76-3b2365a15ea1 binding to destination host user is already ACTIVE {{(pid=74821) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 06 13:32:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Acquiring lock "refresh_cache-2d8da345-f66d-45c2-8ccd-d22fdf79a14d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:32:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Acquired lock "refresh_cache-2d8da345-f66d-45c2-8ccd-d22fdf79a14d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:32:17 user nova-compute[74821]: DEBUG nova.network.neutron [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:32:17 user nova-compute[74821]: DEBUG nova.network.neutron [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Updating instance_info_cache with network_info: [{"id": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "address": "fa:16:3e:69:f1:92", "network": {"id": "fc4369de-77c4-4f2f-a73c-d556ca3ff47c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1805761900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56107e2c08004a26a96765ec143a6d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf768a2c5-10", "ovs_interfaceid": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:32:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Releasing lock "refresh_cache-2d8da345-f66d-45c2-8ccd-d22fdf79a14d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:32:17 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Creating tmpfile /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/tmpwtqggo8z to verify with other compute node that the instance is on the same shared storage. {{(pid=74821) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 06 13:32:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG nova.compute.manager [req-808efe69-abdb-4a37-ab07-386a12a4325f req-d2ce9553-1c08-4781-b1b3-1b1a3203f3b1 service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Received event network-vif-unplugged-f768a2c5-10b0-4442-9c76-3b2365a15ea1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-808efe69-abdb-4a37-ab07-386a12a4325f req-d2ce9553-1c08-4781-b1b3-1b1a3203f3b1 service nova] Acquiring lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-808efe69-abdb-4a37-ab07-386a12a4325f req-d2ce9553-1c08-4781-b1b3-1b1a3203f3b1 service nova] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-808efe69-abdb-4a37-ab07-386a12a4325f req-d2ce9553-1c08-4781-b1b3-1b1a3203f3b1 service nova] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG nova.compute.manager [req-808efe69-abdb-4a37-ab07-386a12a4325f req-d2ce9553-1c08-4781-b1b3-1b1a3203f3b1 service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] No waiting events found dispatching network-vif-unplugged-f768a2c5-10b0-4442-9c76-3b2365a15ea1 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:32:18 user nova-compute[74821]: WARNING nova.compute.manager [req-808efe69-abdb-4a37-ab07-386a12a4325f req-d2ce9553-1c08-4781-b1b3-1b1a3203f3b1 service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Received unexpected event network-vif-unplugged-f768a2c5-10b0-4442-9c76-3b2365a15ea1 for instance with vm_state resized and task_state resize_reverting.
Nov 06 13:32:18 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Instance destroyed successfully.
Nov 06 13:32:18 user nova-compute[74821]: DEBUG nova.objects.instance [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lazy-loading 'resources' on Instance uuid 2d8da345-f66d-45c2-8ccd-d22fdf79a14d {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:26:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-233244178',display_name='tempest-ServerActionsTestOtherB-server-233244178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-233244178',id=30,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuJC1d4ehn860a5pUveloxEygkvx5gY8ln8i6Wkpyz/+95f+bQsPWUnUI4RTUqfdZx4+FPFbRCNSl970GfIGv9UYxW4qb3i2YKmZKus6nAHjmjCWQpj73f7nF5ypuSRew==',key_name='tempest-keypair-821004257',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:31:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56107e2c08004a26a96765ec143a6d6f',ramdisk_id='',reservation_id='r-l2lbl00l',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1724377265',owner_user_name='tempest-ServerActionsTestOtherB-1724377265-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:31:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88e8b4a7235140488a7b9cd34bd10f85',uuid=2d8da345-f66d-45c2-8ccd-d22fdf79a14d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "address": "fa:16:3e:69:f1:92", "network": {"id": "fc4369de-77c4-4f2f-a73c-d556ca3ff47c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1805761900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56107e2c08004a26a96765ec143a6d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf768a2c5-10", "ovs_interfaceid": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Converting VIF {"id": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "address": "fa:16:3e:69:f1:92", "network": {"id": "fc4369de-77c4-4f2f-a73c-d556ca3ff47c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1805761900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56107e2c08004a26a96765ec143a6d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf768a2c5-10", "ovs_interfaceid": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:f1:92,bridge_name='br-int',has_traffic_filtering=True,id=f768a2c5-10b0-4442-9c76-3b2365a15ea1,network=Network(fc4369de-77c4-4f2f-a73c-d556ca3ff47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf768a2c5-10') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG os_vif [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:f1:92,bridge_name='br-int',has_traffic_filtering=True,id=f768a2c5-10b0-4442-9c76-3b2365a15ea1,network=Network(fc4369de-77c4-4f2f-a73c-d556ca3ff47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf768a2c5-10') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf768a2c5-10, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b32eb724-e567-49ba-9c95-da3793d279ea) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:18 user nova-compute[74821]: INFO os_vif [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:f1:92,bridge_name='br-int',has_traffic_filtering=True,id=f768a2c5-10b0-4442-9c76-3b2365a15ea1,network=Network(fc4369de-77c4-4f2f-a73c-d556ca3ff47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf768a2c5-10')
Nov 06 13:32:18 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NqtJyMeh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:32:18 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:32:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa44e63-3fb6-4bf2-bea8-cdeaf7aacefe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:32:18 user nova-compute[74821]: No targets found.
Nov 06 13:32:18 user nova-compute[74821]: iSNS:
Nov 06 13:32:18 user nova-compute[74821]: No targets found.
Nov 06 13:32:18 user nova-compute[74821]: STATIC:
Nov 06 13:32:18 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604
Nov 06 13:32:18 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:32:18 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:32:18 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82
Nov 06 13:32:18 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:32:18 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:32:18 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f
Nov 06 13:32:18 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:32:18 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:32:18 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979
Nov 06 13:32:18 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:32:18 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:32:18 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6
Nov 06 13:32:18 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:32:18 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:32:18 user nova-compute[74821]: FIRMWARE:
Nov 06 13:32:18 user nova-compute[74821]: No targets found.
Nov 06 13:32:18 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:32:18 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:32:18 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6d0c1a-ca8b-4c9b-892a-a9beca00aabe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b139193a-96c9-46b2-be3e-1a4110ad1fe1]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:32:18 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:32:18 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:32:18 user nova-compute[74821]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)
Nov 06 13:32:18 user nova-compute[74821]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)
Nov 06 13:32:18 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:32:18 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:32:18 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:32:18 user nova-compute[74821]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)
Nov 06 13:32:18 user nova-compute[74821]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)
Nov 06 13:32:18 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e583e2560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6'): ({'sde'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Removing single pathed devices sde {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.117s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c10766-fbd2-414f-aa94-8784de55b7c4]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[67025f00-f775-47fe-808a-df44fc1183d9]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Flushing IO for device /dev/sde {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f669573c-6344-46fb-8ea9-11828ae69e60]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[499dd9be-682e-4ae4-883a-e060c080a7f7]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] SCSI volumes sde have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eca257d-56b4-4e49-9e50-140bdd87ff32]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:32:18 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:19 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:19 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[95009c6f-5201-49f2-aa49-0790171c7a2f]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:19 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6, portal: 172.16.0.220,3260]
Nov 06 13:32:19 user nova-compute[74821]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6, portal: 172.16.0.220,3260] successful.
Nov 06 13:32:19 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:32:19 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:19 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:19 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3102b313-9cd7-455b-9070-d7fd0b856430]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:19 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:32:19 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.454s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:32:19 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] <== disconnect_volume: return (454ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:32:19 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:32:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:20 user nova-compute[74821]: DEBUG nova.compute.manager [req-c571a783-bcb3-4337-8500-f3d12b147cf1 req-a3374f59-b0a8-4744-b323-27e24b91151d service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Received event network-vif-plugged-f768a2c5-10b0-4442-9c76-3b2365a15ea1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:32:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c571a783-bcb3-4337-8500-f3d12b147cf1 req-a3374f59-b0a8-4744-b323-27e24b91151d service nova] Acquiring lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:32:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c571a783-bcb3-4337-8500-f3d12b147cf1 req-a3374f59-b0a8-4744-b323-27e24b91151d service nova] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:32:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c571a783-bcb3-4337-8500-f3d12b147cf1 req-a3374f59-b0a8-4744-b323-27e24b91151d service nova] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:32:20 user nova-compute[74821]: DEBUG nova.compute.manager [req-c571a783-bcb3-4337-8500-f3d12b147cf1 req-a3374f59-b0a8-4744-b323-27e24b91151d service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] No waiting events found dispatching network-vif-plugged-f768a2c5-10b0-4442-9c76-3b2365a15ea1 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:32:20 user nova-compute[74821]: WARNING nova.compute.manager [req-c571a783-bcb3-4337-8500-f3d12b147cf1 req-a3374f59-b0a8-4744-b323-27e24b91151d service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Received unexpected event network-vif-plugged-f768a2c5-10b0-4442-9c76-3b2365a15ea1 for instance with vm_state resized and task_state resize_reverting.
Nov 06 13:32:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b714cf84-a000-4eb2-91a1-aa49b0e89687 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:32:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b714cf84-a000-4eb2-91a1-aa49b0e89687 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:32:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-b714cf84-a000-4eb2-91a1-aa49b0e89687 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Going to confirm migration 1 {{(pid=74821) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 06 13:32:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b714cf84-a000-4eb2-91a1-aa49b0e89687 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "refresh_cache-d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:32:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b714cf84-a000-4eb2-91a1-aa49b0e89687 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquired lock "refresh_cache-d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:32:26 user nova-compute[74821]: DEBUG nova.network.neutron [None req-b714cf84-a000-4eb2-91a1-aa49b0e89687 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:32:26 user nova-compute[74821]: DEBUG nova.objects.instance [None req-b714cf84-a000-4eb2-91a1-aa49b0e89687 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lazy-loading 'info_cache' on Instance uuid d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:32:27 user nova-compute[74821]: DEBUG nova.network.neutron [None req-b714cf84-a000-4eb2-91a1-aa49b0e89687 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Updating instance_info_cache with network_info: [{"id": "267248e7-6714-47b4-b1b2-1d94251305da", "address": "fa:16:3e:4e:3f:6c", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267248e7-67", "ovs_interfaceid": "267248e7-6714-47b4-b1b2-1d94251305da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:32:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b714cf84-a000-4eb2-91a1-aa49b0e89687 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Releasing lock "refresh_cache-d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:32:27 user nova-compute[74821]: DEBUG nova.objects.instance [None req-b714cf84-a000-4eb2-91a1-aa49b0e89687 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lazy-loading 'migration_context' on Instance uuid d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:32:27 user nova-compute[74821]: DEBUG nova.objects.base [None req-b714cf84-a000-4eb2-91a1-aa49b0e89687 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Object Instance<d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8> lazy-loaded attributes: info_cache,migration_context {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:32:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b714cf84-a000-4eb2-91a1-aa49b0e89687 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:32:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b714cf84-a000-4eb2-91a1-aa49b0e89687 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:32:27 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-b714cf84-a000-4eb2-91a1-aa49b0e89687 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:32:28 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-b714cf84-a000-4eb2-91a1-aa49b0e89687 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:32:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b714cf84-a000-4eb2-91a1-aa49b0e89687 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.580s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:32:28 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-b714cf84-a000-4eb2-91a1-aa49b0e89687 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Deleted allocation for migration adaac260-5214-4b8e-952e-65a22f39b3da
Nov 06 13:32:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b714cf84-a000-4eb2-91a1-aa49b0e89687 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.688s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:32:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG nova.objects.instance [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lazy-loading 'migration_context' on Instance uuid 2d8da345-f66d-45c2-8ccd-d22fdf79a14d {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG nova.objects.base [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Object Instance<2d8da345-f66d-45c2-8ccd-d22fdf79a14d> lazy-loaded attributes: resources,migration_context {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qwnIjzbZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:32:30 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:32:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:32:30 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:32:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:32:30 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:32:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae15859-a0df-453c-a097-4d3e1d238ca8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:32:30 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b3b6ab-2458-4a19-a021-ac8967f3f2d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9] added
Nov 06 13:32:30 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8eb46d-bed5-4200-be1e-b39efc1d5c59]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7993cda7-9b83-42f0-b9af-77172ebd33d3]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qwnIjzbZ {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qwnIjzbZ" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31e5e10-c6b8-4a0b-aca9-89eb4ea40664]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qwnIjzbZ'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.124s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5924b25-75fc-4072-a050-8d418e4efd2a]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[636ba164-be65-486b-bd1c-e69228fe0821]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:32:30 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:32:30 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:32:30 user nova-compute[74821]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)
Nov 06 13:32:30 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:32:30 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:32:30 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:32:30 user nova-compute[74821]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)
Nov 06 13:32:30 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[069560e8-69ab-4338-8d48-921374450d9b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9, portal: 172.16.0.220,3260]
Nov 06 13:32:30 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9, portal: 172.16.0.220,3260] successful.
Nov 06 13:32:30 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4fbb8c-e7f0-470c-83ee-9306cf23008f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:32:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e937d2-5d08-46a2-9ca6-268962be1ac4]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:32:31 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:32:31 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:32:31 user nova-compute[74821]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)
Nov 06 13:32:31 user nova-compute[74821]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9 (non-flash)
Nov 06 13:32:31 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:32:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:32:31 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:32:31 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:32:31 user nova-compute[74821]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)
Nov 06 13:32:31 user nova-compute[74821]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9 (non-flash)
Nov 06 13:32:31 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:32:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.408s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:32:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:32:31 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:32:31 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:32:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:31 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:32:31 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:32:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf1b12b-cdb4-416d-ac91-e1c31feecc1d]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:31 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:32:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qwnIjzbZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:32:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.585s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:32:31 user nova-compute[74821]: INFO nova.compute.manager [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Swapping old allocation on dict_keys(['a45ec519-15f5-48fe-877b-466db09f8afe']) held by migration f36ec03b-bcd7-43fc-b827-f385033a26f4 for instance
Nov 06 13:32:31 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Overwriting current allocation {'allocations': {'a45ec519-15f5-48fe-877b-466db09f8afe': {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}, 'generation': 51}}, 'project_id': '56107e2c08004a26a96765ec143a6d6f', 'user_id': '88e8b4a7235140488a7b9cd34bd10f85', 'consumer_generation': 1} on consumer 2d8da345-f66d-45c2-8ccd-d22fdf79a14d {{(pid=74821) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 06 13:32:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Acquiring lock "refresh_cache-2d8da345-f66d-45c2-8ccd-d22fdf79a14d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:32:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Acquired lock "refresh_cache-2d8da345-f66d-45c2-8ccd-d22fdf79a14d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:32:31 user nova-compute[74821]: DEBUG nova.network.neutron [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:32:31 user nova-compute[74821]: DEBUG nova.network.neutron [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Updating instance_info_cache with network_info: [{"id": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "address": "fa:16:3e:69:f1:92", "network": {"id": "fc4369de-77c4-4f2f-a73c-d556ca3ff47c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1805761900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56107e2c08004a26a96765ec143a6d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf768a2c5-10", "ovs_interfaceid": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:32:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Releasing lock "refresh_cache-2d8da345-f66d-45c2-8ccd-d22fdf79a14d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:32:31 user nova-compute[74821]: DEBUG os_brick.utils [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:32:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6604acda-3e89-4ec1-904c-6e24f0fd2c8f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da9d627-c2db-4648-b026-eb9b7b4e168f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f363a3-c417-4d6d-ba99-b0c81e556aa3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f97204-9d96-41c5-aa16-f73234edf866]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:32:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:32:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:32:32 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:32:32 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba926b05-e203-42d3-836f-d509b08138b6]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:32:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:32:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:32:32 user nova-compute[74821]: DEBUG os_brick.utils [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:32:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.452s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:32:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] <== connect_volume: return (1454ms) {'type': 'block', 'scsi_wwn': '26463323337613061', 'path': '/dev/sde'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:32:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463323337613061', 'path': '/dev/sde'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:32:32 user nova-compute[74821]: DEBUG nova.objects.instance [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lazy-loading 'flavor' on Instance uuid e80a3f77-8f29-4f18-9707-c9793a124cc6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:32:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 13:32:32 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:32:32 user nova-compute[74821]:   <source dev="/dev/sde"/>
Nov 06 13:32:32 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:32:32 user nova-compute[74821]:   <serial>6a6f7564-9cb9-423c-aae2-5ee36dca41a9</serial>
Nov 06 13:32:32 user nova-compute[74821]: </disk>
Nov 06 13:32:32 user nova-compute[74821]:  {{(pid=74821) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 13:32:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:32:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:32:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] No VIF found with MAC fa:16:3e:57:6c:0b, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:32:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-af143362-289b-437e-bc84-c3817d7702bc tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "e80a3f77-8f29-4f18-9707-c9793a124cc6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.685s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:32:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Acquiring lock "e80a3f77-8f29-4f18-9707-c9793a124cc6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:32:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "e80a3f77-8f29-4f18-9707-c9793a124cc6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:32:34 user nova-compute[74821]: INFO nova.compute.manager [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Detaching volume 6a6f7564-9cb9-423c-aae2-5ee36dca41a9
Nov 06 13:32:34 user nova-compute[74821]: INFO nova.virt.block_device [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Attempting to driver detach volume 6a6f7564-9cb9-423c-aae2-5ee36dca41a9 from mountpoint /dev/vdb
Nov 06 13:32:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Attempting to detach device vdb from instance e80a3f77-8f29-4f18-9707-c9793a124cc6 from the persistent domain config. {{(pid=74821) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 13:32:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:32:34 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:32:34 user nova-compute[74821]:   <source dev="/dev/sde"/>
Nov 06 13:32:34 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:32:34 user nova-compute[74821]:   <serial>6a6f7564-9cb9-423c-aae2-5ee36dca41a9</serial>
Nov 06 13:32:34 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:32:34 user nova-compute[74821]: </disk>
Nov 06 13:32:34 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:32:34 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Successfully detached device vdb from instance e80a3f77-8f29-4f18-9707-c9793a124cc6 from the persistent domain config.
Nov 06 13:32:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e80a3f77-8f29-4f18-9707-c9793a124cc6 from the live domain config. {{(pid=74821) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 13:32:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:32:34 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:32:34 user nova-compute[74821]:   <source dev="/dev/sde"/>
Nov 06 13:32:34 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:32:34 user nova-compute[74821]:   <serial>6a6f7564-9cb9-423c-aae2-5ee36dca41a9</serial>
Nov 06 13:32:34 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:32:34 user nova-compute[74821]: </disk>
Nov 06 13:32:34 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:32:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e80a3f77-8f29-4f18-9707-c9793a124cc6 {{(pid=74821) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 13:32:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:35 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:32:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:39 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:32:42 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:32:42 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:32:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-2d8da345-f66d-45c2-8ccd-d22fdf79a14d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:32:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-2d8da345-f66d-45c2-8ccd-d22fdf79a14d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:32:43 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:32:43 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Updating instance_info_cache with network_info: [{"id": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "address": "fa:16:3e:69:f1:92", "network": {"id": "fc4369de-77c4-4f2f-a73c-d556ca3ff47c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1805761900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56107e2c08004a26a96765ec143a6d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf768a2c5-10", "ovs_interfaceid": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:32:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-2d8da345-f66d-45c2-8ccd-d22fdf79a14d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:32:43 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:32:43 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:32:43 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:32:43 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:43 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:32:43 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:32:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:44 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:32:46 user nova-compute[74821]: DEBUG nova.compute.manager [req-1d9f9308-4eb8-4476-b50b-ad6b752429b2 req-e6b479b8-81da-47aa-acd0-8c7078fef6c1 service nova] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Received event network-changed-8e9606b7-8bbe-47bc-87ac-03dd9f6fe085 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:32:46 user nova-compute[74821]: DEBUG nova.compute.manager [req-1d9f9308-4eb8-4476-b50b-ad6b752429b2 req-e6b479b8-81da-47aa-acd0-8c7078fef6c1 service nova] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Refreshing instance network info cache due to event network-changed-8e9606b7-8bbe-47bc-87ac-03dd9f6fe085. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:32:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1d9f9308-4eb8-4476-b50b-ad6b752429b2 req-e6b479b8-81da-47aa-acd0-8c7078fef6c1 service nova] Acquiring lock "refresh_cache-6f2a94d6-c16f-4f1f-a627-66e0dddc1615" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:32:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1d9f9308-4eb8-4476-b50b-ad6b752429b2 req-e6b479b8-81da-47aa-acd0-8c7078fef6c1 service nova] Acquired lock "refresh_cache-6f2a94d6-c16f-4f1f-a627-66e0dddc1615" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:32:46 user nova-compute[74821]: DEBUG nova.network.neutron [req-1d9f9308-4eb8-4476-b50b-ad6b752429b2 req-e6b479b8-81da-47aa-acd0-8c7078fef6c1 service nova] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Refreshing network info cache for port 8e9606b7-8bbe-47bc-87ac-03dd9f6fe085 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:32:46 user nova-compute[74821]: DEBUG nova.network.neutron [req-1d9f9308-4eb8-4476-b50b-ad6b752429b2 req-e6b479b8-81da-47aa-acd0-8c7078fef6c1 service nova] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Updated VIF entry in instance network info cache for port 8e9606b7-8bbe-47bc-87ac-03dd9f6fe085. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:32:46 user nova-compute[74821]: DEBUG nova.network.neutron [req-1d9f9308-4eb8-4476-b50b-ad6b752429b2 req-e6b479b8-81da-47aa-acd0-8c7078fef6c1 service nova] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Updating instance_info_cache with network_info: [{"id": "8e9606b7-8bbe-47bc-87ac-03dd9f6fe085", "address": "fa:16:3e:61:68:32", "network": {"id": "c4011ab9-7e5a-47da-a1f3-9fe74acc3b8f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1383136864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73b4663a8c224eac879b6c6694396624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9606b7-8b", "ovs_interfaceid": "8e9606b7-8bbe-47bc-87ac-03dd9f6fe085", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:32:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1d9f9308-4eb8-4476-b50b-ad6b752429b2 req-e6b479b8-81da-47aa-acd0-8c7078fef6c1 service nova] Releasing lock "refresh_cache-6f2a94d6-c16f-4f1f-a627-66e0dddc1615" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:32:48 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:49 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:32:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:32:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:32:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:32:49 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:32:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:32:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2a94d6-c16f-4f1f-a627-66e0dddc1615/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2a94d6-c16f-4f1f-a627-66e0dddc1615/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2a94d6-c16f-4f1f-a627-66e0dddc1615/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2a94d6-c16f-4f1f-a627-66e0dddc1615/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:32:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ae6f5e-38a1-4871-8015-c2097f64b33b/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ae6f5e-38a1-4871-8015-c2097f64b33b/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ae6f5e-38a1-4871-8015-c2097f64b33b/disk.rescue --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64ae6f5e-38a1-4871-8015-c2097f64b33b/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:32:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b2673b-023a-46eb-88ea-2fa42c33b173/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b2673b-023a-46eb-88ea-2fa42c33b173/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b2673b-023a-46eb-88ea-2fa42c33b173/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7b2673b-023a-46eb-88ea-2fa42c33b173/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Acquiring lock "6f2a94d6-c16f-4f1f-a627-66e0dddc1615" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:32:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Lock "6f2a94d6-c16f-4f1f-a627-66e0dddc1615" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:32:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:52 user nova-compute[74821]: DEBUG nova.objects.instance [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Lazy-loading 'flavor' on Instance uuid 6f2a94d6-c16f-4f1f-a627-66e0dddc1615 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:32:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Lock "6f2a94d6-c16f-4f1f-a627-66e0dddc1615" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.103s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:32:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e80a3f77-8f29-4f18-9707-c9793a124cc6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Acquiring lock "6f2a94d6-c16f-4f1f-a627-66e0dddc1615" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:32:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Lock "6f2a94d6-c16f-4f1f-a627-66e0dddc1615" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:32:53 user nova-compute[74821]: INFO nova.compute.manager [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Attaching volume a2d2935d-75c1-455a-a440-fa40bf7c1034 to /dev/vdb
Nov 06 13:32:53 user nova-compute[74821]: DEBUG os_brick.utils [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:32:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e80a3f77-8f29-4f18-9707-c9793a124cc6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e80a3f77-8f29-4f18-9707-c9793a124cc6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:53 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8046a25-0983-4058-9ec3-b2075bbfe49a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:53 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c570cb56-6520-4d0d-9b1e-3803fc007134]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:53 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[609df912-cb84-4593-8c8d-db7b3b0f8d7a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:53 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[424cd308-bd54-4a65-a4d4-ef0c6cf58134]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:32:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:32:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:32:53 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:32:53 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[107b9db3-6be8-4800-9ca0-cb5542b156e8]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:32:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:32:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:32:53 user nova-compute[74821]: DEBUG os_brick.utils [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:32:53 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Updating existing volume attachment record: 6e67dc62-8d6f-4c20-9573-248cdd5ad11e {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:32:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e80a3f77-8f29-4f18-9707-c9793a124cc6/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:53 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:32:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:53 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:54 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:32:54 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:32:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=7320MB free_disk=24.68073272705078GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:32:54 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e80a3f77-8f29-4f18-9707-c9793a124cc6 is timed out.
Nov 06 13:32:54 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Successfully detached device vdb from instance e80a3f77-8f29-4f18-9707-c9793a124cc6 from the live domain config.
Nov 06 13:32:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qwnIjzbZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:32:54 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:32:54 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 2de346cb-9858-47b8-a86c-4fde720d6127 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 49c65aca-8392-46ba-8fa3-b47ff2416cb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 496f8213-4b32-4211-a354-e33a4a088848 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 1290bdb3-827f-4365-a4f1-4ae063de780d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 4bc6444e-b55d-4d81-88d1-f4d147255119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 64ae6f5e-38a1-4871-8015-c2097f64b33b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 6121ff1a-d276-485f-85f8-ba451f5b0d37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance e80a3f77-8f29-4f18-9707-c9793a124cc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 6f2a94d6-c16f-4f1f-a627-66e0dddc1615 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 8467fdc8-ec8e-4eda-abbc-b146e58e90c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance f7b2673b-023a-46eb-88ea-2fa42c33b173 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 2d8da345-f66d-45c2-8ccd-d22fdf79a14d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc35f5c8-96aa-4ef0-b27b-dbb393607d77]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:32:54 user nova-compute[74821]: No targets found.
Nov 06 13:32:54 user nova-compute[74821]: iSNS:
Nov 06 13:32:54 user nova-compute[74821]: No targets found.
Nov 06 13:32:54 user nova-compute[74821]: STATIC:
Nov 06 13:32:54 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9
Nov 06 13:32:54 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:32:54 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:32:54 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604
Nov 06 13:32:54 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:32:54 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:32:54 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82
Nov 06 13:32:54 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:32:54 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:32:54 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f
Nov 06 13:32:54 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:32:54 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:32:54 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979
Nov 06 13:32:54 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:32:54 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:32:54 user nova-compute[74821]: FIRMWARE:
Nov 06 13:32:54 user nova-compute[74821]: No targets found.
Nov 06 13:32:54 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:32:54 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:32:54 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ef039d-1f52-4ca3-bbc4-d60b7f93350d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a380ea61-3f76-41db-8ab6-2f1ccd758715]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:32:54 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:32:54 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:32:54 user nova-compute[74821]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)
Nov 06 13:32:54 user nova-compute[74821]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9 (non-flash)
Nov 06 13:32:54 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:32:54 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:32:54 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:32:54 user nova-compute[74821]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)
Nov 06 13:32:54 user nova-compute[74821]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9 (non-flash)
Nov 06 13:32:54 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e40297a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9'): ({'sde'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Removing single pathed devices sde {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bd68c8-262d-4d80-a1c1-8b99c3b46336]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfaf038-aed4-4464-819c-8e3856e6a395]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Flushing IO for device /dev/sde {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7482ce68-236a-4c61-861b-05817a2ac8fd]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:32:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:55 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d5252c-0997-4c77-ac7c-3737731dca90]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:55 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:32:55 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] SCSI volumes sde have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:32:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:32:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:55 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7ff867-facd-465b-bd35-4ca07aca8d48]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:32:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:55 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6b7464-467b-431b-b19b-95f31591e489]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9, portal: 172.16.0.220,3260]
Nov 06 13:32:55 user nova-compute[74821]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9, portal: 172.16.0.220,3260] successful.
Nov 06 13:32:55 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:32:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6f7564-9cb9-423c-aae2-5ee36dca41a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:55 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8934b4db-8c68-40c0-96e5-38e98cf38c3d]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:32:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:32:55 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] <== disconnect_volume: return (364ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:32:55 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:32:55 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:32:55 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:32:55 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:32:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.645s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Starting finish_revert_migration {{(pid=74821) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Start _get_guest_xml network_info=[{"id": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "address": "fa:16:3e:69:f1:92", "network": {"id": "fc4369de-77c4-4f2f-a73c-d556ca3ff47c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1805761900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56107e2c08004a26a96765ec143a6d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf768a2c5-10", "ovs_interfaceid": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NqtJyMeh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '2d8da345-f66d-45c2-8ccd-d22fdf79a14d', 'attached_at': '2023-11-06T13:32:56.000000', 'detached_at': '', 'volume_id': '8fd6df57-5012-419e-86c9-eb8fca3325f6', 'serial': '8fd6df57-5012-419e-86c9-eb8fca3325f6'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '6c68d715-5cda-4544-ba70-057bb85b1fc1', 'volume_type': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:32:56 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:32:56 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:32:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG nova.objects.instance [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2d8da345-f66d-45c2-8ccd-d22fdf79a14d {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NqtJyMeh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:32:56 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:32:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:32:56 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:32:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:32:56 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:32:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e1c518-141b-4ca2-add1-68bf9fb5484d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:32:56 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[642c46a4-285d-4efd-aad2-922da4571b3f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6] added
Nov 06 13:32:56 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a64b29b-5964-45c5-b1bd-6a285227c4ce]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e72a03-1347-46af-90f1-31254571ab4d]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NqtJyMeh {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NqtJyMeh" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a9dee2-4db6-4371-9d83-ac6a81f09164]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NqtJyMeh'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[317997eb-605f-4308-a1d5-d948d3d8dbc8]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f22994-2bcc-4918-9d1e-59616e7f1a13]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:32:56 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:32:56 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:32:56 user nova-compute[74821]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)
Nov 06 13:32:56 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:32:56 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:32:56 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:32:56 user nova-compute[74821]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)
Nov 06 13:32:56 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d008f70-53fe-48a6-bb63-4404e7efbb1c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6, portal: 172.16.0.220,3260]
Nov 06 13:32:56 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6, portal: 172.16.0.220,3260] successful.
Nov 06 13:32:56 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed0b041-bb66-4a37-9fde-f76cc43ab81c]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8ee748-a6ac-42d7-be70-113e6a844aa6]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:32:56 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:32:56 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:32:56 user nova-compute[74821]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)
Nov 06 13:32:56 user nova-compute[74821]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)
Nov 06 13:32:56 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:32:56 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:32:56 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:32:56 user nova-compute[74821]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)
Nov 06 13:32:56 user nova-compute[74821]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)
Nov 06 13:32:56 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6d4e30-6031-4605-9d86-7ceb72313ae6]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:32:56 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NqtJyMeh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:32:57 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:32:57 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23534376361636465', 'path': '/dev/sde'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:32:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534376361636465', 'path': '/dev/sde'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:32:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:26:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-233244178',display_name='tempest-ServerActionsTestOtherB-server-233244178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-233244178',id=30,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuJC1d4ehn860a5pUveloxEygkvx5gY8ln8i6Wkpyz/+95f+bQsPWUnUI4RTUqfdZx4+FPFbRCNSl970GfIGv9UYxW4qb3i2YKmZKus6nAHjmjCWQpj73f7nF5ypuSRew==',key_name='tempest-keypair-821004257',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:31:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='56107e2c08004a26a96765ec143a6d6f',ramdisk_id='',reservation_id='r-l2lbl00l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1724377265',owner_user_name='tempest-ServerActionsTestOtherB-1724377265-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:32:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88e8b4a7235140488a7b9cd34bd10f85',uuid=2d8da345-f66d-45c2-8ccd-d22fdf79a14d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "address": "fa:16:3e:69:f1:92", "network": {"id": "fc4369de-77c4-4f2f-a73c-d556ca3ff47c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1805761900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56107e2c08004a26a96765ec143a6d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf768a2c5-10", "ovs_interfaceid": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:32:57 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Converting VIF {"id": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "address": "fa:16:3e:69:f1:92", "network": {"id": "fc4369de-77c4-4f2f-a73c-d556ca3ff47c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1805761900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56107e2c08004a26a96765ec143a6d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf768a2c5-10", "ovs_interfaceid": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:32:57 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:f1:92,bridge_name='br-int',has_traffic_filtering=True,id=f768a2c5-10b0-4442-9c76-3b2365a15ea1,network=Network(fc4369de-77c4-4f2f-a73c-d556ca3ff47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf768a2c5-10') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:32:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:32:57 user nova-compute[74821]:   <uuid>2d8da345-f66d-45c2-8ccd-d22fdf79a14d</uuid>
Nov 06 13:32:57 user nova-compute[74821]:   <name>instance-0000001e</name>
Nov 06 13:32:57 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:32:57 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:32:57 user nova-compute[74821]:   <metadata>
Nov 06 13:32:57 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:32:57 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:32:57 user nova-compute[74821]:       <nova:name>tempest-ServerActionsTestOtherB-server-233244178</nova:name>
Nov 06 13:32:57 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:32:56</nova:creationTime>
Nov 06 13:32:57 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:32:57 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:32:57 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:32:57 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:32:57 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:32:57 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:32:57 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:32:57 user nova-compute[74821]:       <nova:owner>
Nov 06 13:32:57 user nova-compute[74821]:         <nova:user uuid="88e8b4a7235140488a7b9cd34bd10f85">tempest-ServerActionsTestOtherB-1724377265-project-member</nova:user>
Nov 06 13:32:57 user nova-compute[74821]:         <nova:project uuid="56107e2c08004a26a96765ec143a6d6f">tempest-ServerActionsTestOtherB-1724377265</nova:project>
Nov 06 13:32:57 user nova-compute[74821]:       </nova:owner>
Nov 06 13:32:57 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:32:57 user nova-compute[74821]:       <nova:ports>
Nov 06 13:32:57 user nova-compute[74821]:         <nova:port uuid="f768a2c5-10b0-4442-9c76-3b2365a15ea1">
Nov 06 13:32:57 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 06 13:32:57 user nova-compute[74821]:         </nova:port>
Nov 06 13:32:57 user nova-compute[74821]:       </nova:ports>
Nov 06 13:32:57 user nova-compute[74821]:     </nova:instance>
Nov 06 13:32:57 user nova-compute[74821]:   </metadata>
Nov 06 13:32:57 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:32:57 user nova-compute[74821]:     <system>
Nov 06 13:32:57 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:32:57 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:32:57 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:32:57 user nova-compute[74821]:       <entry name="serial">2d8da345-f66d-45c2-8ccd-d22fdf79a14d</entry>
Nov 06 13:32:57 user nova-compute[74821]:       <entry name="uuid">2d8da345-f66d-45c2-8ccd-d22fdf79a14d</entry>
Nov 06 13:32:57 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:32:57 user nova-compute[74821]:     </system>
Nov 06 13:32:57 user nova-compute[74821]:   </sysinfo>
Nov 06 13:32:57 user nova-compute[74821]:   <os>
Nov 06 13:32:57 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:32:57 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:32:57 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:32:57 user nova-compute[74821]:   </os>
Nov 06 13:32:57 user nova-compute[74821]:   <features>
Nov 06 13:32:57 user nova-compute[74821]:     <acpi/>
Nov 06 13:32:57 user nova-compute[74821]:     <apic/>
Nov 06 13:32:57 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:32:57 user nova-compute[74821]:   </features>
Nov 06 13:32:57 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:32:57 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:32:57 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:32:57 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:32:57 user nova-compute[74821]:   </clock>
Nov 06 13:32:57 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:32:57 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:32:57 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:32:57 user nova-compute[74821]:   </cpu>
Nov 06 13:32:57 user nova-compute[74821]:   <devices>
Nov 06 13:32:57 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:32:57 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:32:57 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk"/>
Nov 06 13:32:57 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:32:57 user nova-compute[74821]:     </disk>
Nov 06 13:32:57 user nova-compute[74821]:     <disk type="block" device="disk">
Nov 06 13:32:57 user nova-compute[74821]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:32:57 user nova-compute[74821]:       <source dev="/dev/sde"/>
Nov 06 13:32:57 user nova-compute[74821]:       <target dev="vdb" bus="virtio"/>
Nov 06 13:32:57 user nova-compute[74821]:       <serial>8fd6df57-5012-419e-86c9-eb8fca3325f6</serial>
Nov 06 13:32:57 user nova-compute[74821]:     </disk>
Nov 06 13:32:57 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:32:57 user nova-compute[74821]:       <mac address="fa:16:3e:69:f1:92"/>
Nov 06 13:32:57 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:32:57 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:32:57 user nova-compute[74821]:       <target dev="tapf768a2c5-10"/>
Nov 06 13:32:57 user nova-compute[74821]:     </interface>
Nov 06 13:32:57 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:32:57 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/console.log" append="off"/>
Nov 06 13:32:57 user nova-compute[74821]:     </serial>
Nov 06 13:32:57 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:32:57 user nova-compute[74821]:     <video>
Nov 06 13:32:57 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:32:57 user nova-compute[74821]:     </video>
Nov 06 13:32:57 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:32:57 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:32:57 user nova-compute[74821]:     </rng>
Nov 06 13:32:57 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:32:57 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:32:57 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:32:57 user nova-compute[74821]:     </memballoon>
Nov 06 13:32:57 user nova-compute[74821]:   </devices>
Nov 06 13:32:57 user nova-compute[74821]: </domain>
Nov 06 13:32:57 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:32:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:26:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-233244178',display_name='tempest-ServerActionsTestOtherB-server-233244178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-233244178',id=30,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuJC1d4ehn860a5pUveloxEygkvx5gY8ln8i6Wkpyz/+95f+bQsPWUnUI4RTUqfdZx4+FPFbRCNSl970GfIGv9UYxW4qb3i2YKmZKus6nAHjmjCWQpj73f7nF5ypuSRew==',key_name='tempest-keypair-821004257',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:31:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='56107e2c08004a26a96765ec143a6d6f',ramdisk_id='',reservation_id='r-l2lbl00l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1724377265',owner_user_name='tempest-ServerActionsTestOtherB-1724377265-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:32:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88e8b4a7235140488a7b9cd34bd10f85',uuid=2d8da345-f66d-45c2-8ccd-d22fdf79a14d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "address": "fa:16:3e:69:f1:92", "network": {"id": "fc4369de-77c4-4f2f-a73c-d556ca3ff47c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1805761900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56107e2c08004a26a96765ec143a6d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf768a2c5-10", "ovs_interfaceid": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:32:57 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Converting VIF {"id": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "address": "fa:16:3e:69:f1:92", "network": {"id": "fc4369de-77c4-4f2f-a73c-d556ca3ff47c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1805761900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56107e2c08004a26a96765ec143a6d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf768a2c5-10", "ovs_interfaceid": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:32:57 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:f1:92,bridge_name='br-int',has_traffic_filtering=True,id=f768a2c5-10b0-4442-9c76-3b2365a15ea1,network=Network(fc4369de-77c4-4f2f-a73c-d556ca3ff47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf768a2c5-10') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:32:57 user nova-compute[74821]: DEBUG os_vif [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:f1:92,bridge_name='br-int',has_traffic_filtering=True,id=f768a2c5-10b0-4442-9c76-3b2365a15ea1,network=Network(fc4369de-77c4-4f2f-a73c-d556ca3ff47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf768a2c5-10') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:32:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:32:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:32:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c3570c2b-e326-5ff2-9a73-a94f5497905f', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:32:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:32:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf768a2c5-10, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:32:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf768a2c5-10, col_values=(('qos', UUID('f5d7ec6d-65eb-4f86-8c3a-0f616d4d38a6')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:32:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf768a2c5-10, col_values=(('external_ids', {'iface-id': 'f768a2c5-10b0-4442-9c76-3b2365a15ea1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:f1:92', 'vm-uuid': '2d8da345-f66d-45c2-8ccd-d22fdf79a14d'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:32:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:32:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:57 user nova-compute[74821]: INFO os_vif [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:f1:92,bridge_name='br-int',has_traffic_filtering=True,id=f768a2c5-10b0-4442-9c76-3b2365a15ea1,network=Network(fc4369de-77c4-4f2f-a73c-d556ca3ff47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf768a2c5-10')
Nov 06 13:32:57 user nova-compute[74821]: DEBUG nova.objects.instance [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lazy-loading 'flavor' on Instance uuid e80a3f77-8f29-4f18-9707-c9793a124cc6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:32:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0820fbdc-6b9a-42ea-8bfa-13634247b01e tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "e80a3f77-8f29-4f18-9707-c9793a124cc6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.728s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:32:58 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:32:58 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:32:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-1b350384-b97f-4a3a-895b-ba4a28b16924 req-833c66e3-5512-4339-94df-33e96b2c27c6 service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Received event network-vif-plugged-f768a2c5-10b0-4442-9c76-3b2365a15ea1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:32:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1b350384-b97f-4a3a-895b-ba4a28b16924 req-833c66e3-5512-4339-94df-33e96b2c27c6 service nova] Acquiring lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:32:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1b350384-b97f-4a3a-895b-ba4a28b16924 req-833c66e3-5512-4339-94df-33e96b2c27c6 service nova] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:32:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1b350384-b97f-4a3a-895b-ba4a28b16924 req-833c66e3-5512-4339-94df-33e96b2c27c6 service nova] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:32:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-1b350384-b97f-4a3a-895b-ba4a28b16924 req-833c66e3-5512-4339-94df-33e96b2c27c6 service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] No waiting events found dispatching network-vif-plugged-f768a2c5-10b0-4442-9c76-3b2365a15ea1 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:32:59 user nova-compute[74821]: WARNING nova.compute.manager [req-1b350384-b97f-4a3a-895b-ba4a28b16924 req-833c66e3-5512-4339-94df-33e96b2c27c6 service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Received unexpected event network-vif-plugged-f768a2c5-10b0-4442-9c76-3b2365a15ea1 for instance with vm_state resized and task_state resize_reverting.
Nov 06 13:32:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:32:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:01 user nova-compute[74821]: DEBUG nova.compute.manager [req-d14aec3d-bcf6-46f4-b22d-0eb1589d49bf req-041c58ee-b567-471f-82e3-986993aa58ab service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Received event network-vif-plugged-f768a2c5-10b0-4442-9c76-3b2365a15ea1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:33:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d14aec3d-bcf6-46f4-b22d-0eb1589d49bf req-041c58ee-b567-471f-82e3-986993aa58ab service nova] Acquiring lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:33:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d14aec3d-bcf6-46f4-b22d-0eb1589d49bf req-041c58ee-b567-471f-82e3-986993aa58ab service nova] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:33:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d14aec3d-bcf6-46f4-b22d-0eb1589d49bf req-041c58ee-b567-471f-82e3-986993aa58ab service nova] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:33:01 user nova-compute[74821]: DEBUG nova.compute.manager [req-d14aec3d-bcf6-46f4-b22d-0eb1589d49bf req-041c58ee-b567-471f-82e3-986993aa58ab service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] No waiting events found dispatching network-vif-plugged-f768a2c5-10b0-4442-9c76-3b2365a15ea1 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:33:01 user nova-compute[74821]: WARNING nova.compute.manager [req-d14aec3d-bcf6-46f4-b22d-0eb1589d49bf req-041c58ee-b567-471f-82e3-986993aa58ab service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Received unexpected event network-vif-plugged-f768a2c5-10b0-4442-9c76-3b2365a15ea1 for instance with vm_state resized and task_state resize_reverting.
Nov 06 13:33:01 user nova-compute[74821]: DEBUG nova.compute.manager [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:33:01 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Instance running successfully.
Nov 06 13:33:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] finish_revert_migration finished successfully. {{(pid=74821) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 06 13:33:01 user nova-compute[74821]: INFO nova.compute.manager [None req-9aa6601e-9d63-411f-a4b3-5d67346541c2 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Updating instance to original state: 'active'
Nov 06 13:33:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:33:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:33:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:33:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:33:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:33:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:16 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:33:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mgwZhHUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:33:16 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:33:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:33:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:33:16 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:33:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:33:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:33:16 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:33:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45a27a7-ace7-4e7a-9480-127c7bbd4020]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:33:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:33:16 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:33:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb022e1-95e2-43f2-8550-bfe61b16125f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:33:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034] added
Nov 06 13:33:16 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:33:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bfe70d-cff4-4217-83c6-74bba23ee701]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:33:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:33:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8110328b-916f-45fa-8984-18089ebd0602]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:33:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:33:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mgwZhHUJ {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mgwZhHUJ" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8f9808-fbe9-435a-adfd-085af926186f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:33:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mgwZhHUJ'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:33:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b03adb-ae75-4051-af00-da5d791f9c75]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:33:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:33:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[35613321-6788-4092-8f81-963869f02ed6]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:33:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:33:16 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:33:16 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:33:16 user nova-compute[74821]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)
Nov 06 13:33:16 user nova-compute[74821]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)
Nov 06 13:33:16 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:33:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:33:16 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:33:16 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:33:16 user nova-compute[74821]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)
Nov 06 13:33:16 user nova-compute[74821]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)
Nov 06 13:33:16 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:33:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[612ed743-07e7-4d68-b38e-6a5882de5fd4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:33:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034, portal: 172.16.0.220,3260]
Nov 06 13:33:17 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034, portal: 172.16.0.220,3260] successful.
Nov 06 13:33:17 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:33:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6005669-c45e-4a18-8111-0c8442798324]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:33:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:33:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0fc273-36cf-439f-b0ed-fe13bade455b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:33:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:33:17 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:33:17 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:33:17 user nova-compute[74821]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)
Nov 06 13:33:17 user nova-compute[74821]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)
Nov 06 13:33:17 user nova-compute[74821]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034 (non-flash)
Nov 06 13:33:17 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:33:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:33:17 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:33:17 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:33:17 user nova-compute[74821]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)
Nov 06 13:33:17 user nova-compute[74821]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)
Nov 06 13:33:17 user nova-compute[74821]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034 (non-flash)
Nov 06 13:33:17 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:33:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:33:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:33:17 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] HCTL ('38', '-', '-', 0) found on session 37 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:33:17 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:33:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e546cdf-7f18-4782-a66e-28859213a389]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:33:17 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Searching for a device in session 37 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:33:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mgwZhHUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:33:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:33:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:33:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:33:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:33:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:33:18 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '26333613738623931', 'path': '/dev/sdg'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:33:18 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333613738623931', 'path': '/dev/sdg'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:33:18 user nova-compute[74821]: DEBUG nova.objects.instance [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Lazy-loading 'flavor' on Instance uuid 6f2a94d6-c16f-4f1f-a627-66e0dddc1615 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:33:18 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 13:33:18 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:33:18 user nova-compute[74821]:   <source dev="/dev/sdg"/>
Nov 06 13:33:18 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:33:18 user nova-compute[74821]:   <serial>a2d2935d-75c1-455a-a440-fa40bf7c1034</serial>
Nov 06 13:33:18 user nova-compute[74821]: </disk>
Nov 06 13:33:18 user nova-compute[74821]:  {{(pid=74821) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 13:33:18 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:33:18 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:33:18 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] No VIF found with MAC fa:16:3e:61:68:32, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:33:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a735e4c0-2231-459f-9534-7111848e1289 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Lock "6f2a94d6-c16f-4f1f-a627-66e0dddc1615" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.919s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:33:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Acquiring lock "6f2a94d6-c16f-4f1f-a627-66e0dddc1615" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:33:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Lock "6f2a94d6-c16f-4f1f-a627-66e0dddc1615" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:33:20 user nova-compute[74821]: INFO nova.compute.manager [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Detaching volume a2d2935d-75c1-455a-a440-fa40bf7c1034
Nov 06 13:33:21 user nova-compute[74821]: INFO nova.virt.block_device [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Attempting to driver detach volume a2d2935d-75c1-455a-a440-fa40bf7c1034 from mountpoint /dev/vdb
Nov 06 13:33:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Attempting to detach device vdb from instance 6f2a94d6-c16f-4f1f-a627-66e0dddc1615 from the persistent domain config. {{(pid=74821) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 13:33:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:33:21 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:33:21 user nova-compute[74821]:   <source dev="/dev/sdg"/>
Nov 06 13:33:21 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:33:21 user nova-compute[74821]:   <serial>a2d2935d-75c1-455a-a440-fa40bf7c1034</serial>
Nov 06 13:33:21 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:33:21 user nova-compute[74821]: </disk>
Nov 06 13:33:21 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:33:21 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Successfully detached device vdb from instance 6f2a94d6-c16f-4f1f-a627-66e0dddc1615 from the persistent domain config.
Nov 06 13:33:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6f2a94d6-c16f-4f1f-a627-66e0dddc1615 from the live domain config. {{(pid=74821) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 13:33:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:33:21 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:33:21 user nova-compute[74821]:   <source dev="/dev/sdg"/>
Nov 06 13:33:21 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:33:21 user nova-compute[74821]:   <serial>a2d2935d-75c1-455a-a440-fa40bf7c1034</serial>
Nov 06 13:33:21 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:33:21 user nova-compute[74821]: </disk>
Nov 06 13:33:21 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:33:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6f2a94d6-c16f-4f1f-a627-66e0dddc1615 {{(pid=74821) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 13:33:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:24 user nova-compute[74821]: DEBUG nova.compute.manager [req-1b2fd1e6-7b82-4679-a9f4-061a6e563701 req-2c0901b0-b7c3-4037-bec9-689cb3782adc service nova] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Received event network-changed-6d137b0d-23f0-478c-a6a9-b4fc955ce4c2 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:33:24 user nova-compute[74821]: DEBUG nova.compute.manager [req-1b2fd1e6-7b82-4679-a9f4-061a6e563701 req-2c0901b0-b7c3-4037-bec9-689cb3782adc service nova] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Refreshing instance network info cache due to event network-changed-6d137b0d-23f0-478c-a6a9-b4fc955ce4c2. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:33:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1b2fd1e6-7b82-4679-a9f4-061a6e563701 req-2c0901b0-b7c3-4037-bec9-689cb3782adc service nova] Acquiring lock "refresh_cache-e80a3f77-8f29-4f18-9707-c9793a124cc6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:33:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1b2fd1e6-7b82-4679-a9f4-061a6e563701 req-2c0901b0-b7c3-4037-bec9-689cb3782adc service nova] Acquired lock "refresh_cache-e80a3f77-8f29-4f18-9707-c9793a124cc6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:33:25 user nova-compute[74821]: DEBUG nova.network.neutron [req-1b2fd1e6-7b82-4679-a9f4-061a6e563701 req-2c0901b0-b7c3-4037-bec9-689cb3782adc service nova] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Refreshing network info cache for port 6d137b0d-23f0-478c-a6a9-b4fc955ce4c2 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:33:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ade2272a-33d0-4988-a163-c24e148e2fd3 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Acquiring lock "e80a3f77-8f29-4f18-9707-c9793a124cc6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:33:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ade2272a-33d0-4988-a163-c24e148e2fd3 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "e80a3f77-8f29-4f18-9707-c9793a124cc6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:33:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ade2272a-33d0-4988-a163-c24e148e2fd3 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Acquiring lock "e80a3f77-8f29-4f18-9707-c9793a124cc6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:33:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ade2272a-33d0-4988-a163-c24e148e2fd3 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "e80a3f77-8f29-4f18-9707-c9793a124cc6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:33:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ade2272a-33d0-4988-a163-c24e148e2fd3 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "e80a3f77-8f29-4f18-9707-c9793a124cc6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:33:25 user nova-compute[74821]: INFO nova.compute.manager [None req-ade2272a-33d0-4988-a163-c24e148e2fd3 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Terminating instance
Nov 06 13:33:25 user nova-compute[74821]: DEBUG nova.compute.manager [None req-ade2272a-33d0-4988-a163-c24e148e2fd3 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:33:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:25 user nova-compute[74821]: DEBUG nova.network.neutron [req-1b2fd1e6-7b82-4679-a9f4-061a6e563701 req-2c0901b0-b7c3-4037-bec9-689cb3782adc service nova] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Updated VIF entry in instance network info cache for port 6d137b0d-23f0-478c-a6a9-b4fc955ce4c2. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:33:25 user nova-compute[74821]: DEBUG nova.network.neutron [req-1b2fd1e6-7b82-4679-a9f4-061a6e563701 req-2c0901b0-b7c3-4037-bec9-689cb3782adc service nova] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Updating instance_info_cache with network_info: [{"id": "6d137b0d-23f0-478c-a6a9-b4fc955ce4c2", "address": "fa:16:3e:57:6c:0b", "network": {"id": "5e673907-9763-4136-845d-b3154200d004", "bridge": "br-int", "label": "tempest-TestStampPattern-539864653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608cf017c43942a4a94982b1d5d4d2b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d137b0d-23", "ovs_interfaceid": "6d137b0d-23f0-478c-a6a9-b4fc955ce4c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:33:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1b2fd1e6-7b82-4679-a9f4-061a6e563701 req-2c0901b0-b7c3-4037-bec9-689cb3782adc service nova] Releasing lock "refresh_cache-e80a3f77-8f29-4f18-9707-c9793a124cc6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:33:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:25 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Instance destroyed successfully.
Nov 06 13:33:25 user nova-compute[74821]: DEBUG nova.objects.instance [None req-ade2272a-33d0-4988-a163-c24e148e2fd3 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lazy-loading 'resources' on Instance uuid e80a3f77-8f29-4f18-9707-c9793a124cc6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:33:25 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-ade2272a-33d0-4988-a163-c24e148e2fd3 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:30:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-524185899',display_name='tempest-TestStampPattern-server-524185899',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-524185899',id=37,image_ref='a6699e17-6b7d-4c7b-a531-ceee845dbcfd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHT6BbspfsGKU4w7+rfCb2XbPvdRdiCIBLtNBrG2m7ivVKQnsl1fkuukzo4FgDo5nmrAQDc2oBOGBF9X5srYArFAUxnzu0ECbQ5DvrtDTtn/zmxbYwAAp1N2mi6fR8VQRQ==',key_name='tempest-TestStampPattern-1150007784',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:30:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='608cf017c43942a4a94982b1d5d4d2b9',ramdisk_id='',reservation_id='r-x5q7mzm8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='4bc6444e-b55d-4d81-88d1-f4d147255119',image_min_disk='1',image_min_ram='0',image_owner_id='608cf017c43942a4a94982b1d5d4d2b9',image_owner_project_name='tempest-TestStampPattern-1706680780',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1706680780-project-member',image_user_id='188b10f8df7848288e07c92dd9a33597',owner_project_name='tempest-TestStampPattern-1706680780',owner_user_name='tempest-TestStampPattern-1706680780-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:30:22Z,user_data=None,user_id='188b10f8df7848288e07c92dd9a33597',uuid=e80a3f77-8f29-4f18-9707-c9793a124cc6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d137b0d-23f0-478c-a6a9-b4fc955ce4c2", "address": "fa:16:3e:57:6c:0b", "network": {"id": "5e673907-9763-4136-845d-b3154200d004", "bridge": "br-int", "label": "tempest-TestStampPattern-539864653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608cf017c43942a4a94982b1d5d4d2b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d137b0d-23", "ovs_interfaceid": "6d137b0d-23f0-478c-a6a9-b4fc955ce4c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:33:25 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-ade2272a-33d0-4988-a163-c24e148e2fd3 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Converting VIF {"id": "6d137b0d-23f0-478c-a6a9-b4fc955ce4c2", "address": "fa:16:3e:57:6c:0b", "network": {"id": "5e673907-9763-4136-845d-b3154200d004", "bridge": "br-int", "label": "tempest-TestStampPattern-539864653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608cf017c43942a4a94982b1d5d4d2b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d137b0d-23", "ovs_interfaceid": "6d137b0d-23f0-478c-a6a9-b4fc955ce4c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:33:25 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-ade2272a-33d0-4988-a163-c24e148e2fd3 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:6c:0b,bridge_name='br-int',has_traffic_filtering=True,id=6d137b0d-23f0-478c-a6a9-b4fc955ce4c2,network=Network(5e673907-9763-4136-845d-b3154200d004),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d137b0d-23') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:33:25 user nova-compute[74821]: DEBUG os_vif [None req-ade2272a-33d0-4988-a163-c24e148e2fd3 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:6c:0b,bridge_name='br-int',has_traffic_filtering=True,id=6d137b0d-23f0-478c-a6a9-b4fc955ce4c2,network=Network(5e673907-9763-4136-845d-b3154200d004),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d137b0d-23') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:33:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d137b0d-23, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:33:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:33:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3e8aa431-a8fc-42f6-8d7d-33cbed947fc6) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:33:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:25 user nova-compute[74821]: INFO os_vif [None req-ade2272a-33d0-4988-a163-c24e148e2fd3 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:6c:0b,bridge_name='br-int',has_traffic_filtering=True,id=6d137b0d-23f0-478c-a6a9-b4fc955ce4c2,network=Network(5e673907-9763-4136-845d-b3154200d004),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d137b0d-23')
Nov 06 13:33:25 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-ade2272a-33d0-4988-a163-c24e148e2fd3 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Deleting instance files /opt/stack/data/nova/instances/e80a3f77-8f29-4f18-9707-c9793a124cc6_del
Nov 06 13:33:25 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-ade2272a-33d0-4988-a163-c24e148e2fd3 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Deletion of /opt/stack/data/nova/instances/e80a3f77-8f29-4f18-9707-c9793a124cc6_del complete
Nov 06 13:33:25 user nova-compute[74821]: INFO nova.compute.manager [None req-ade2272a-33d0-4988-a163-c24e148e2fd3 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 06 13:33:25 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-ade2272a-33d0-4988-a163-c24e148e2fd3 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:33:25 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:33:25 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:33:26 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:33:26 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Took 0.49 seconds to deallocate network for instance.
Nov 06 13:33:26 user nova-compute[74821]: DEBUG nova.compute.manager [req-86a7b5fc-3caa-4cc4-aa7f-0dc499bd7ac5 req-6590ae36-d55e-4b32-9220-4a6009472bf5 service nova] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Received event network-vif-deleted-6d137b0d-23f0-478c-a6a9-b4fc955ce4c2 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:33:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ade2272a-33d0-4988-a163-c24e148e2fd3 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:33:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ade2272a-33d0-4988-a163-c24e148e2fd3 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:33:26 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-ade2272a-33d0-4988-a163-c24e148e2fd3 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:33:26 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-ade2272a-33d0-4988-a163-c24e148e2fd3 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:33:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ade2272a-33d0-4988-a163-c24e148e2fd3 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:33:26 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-ade2272a-33d0-4988-a163-c24e148e2fd3 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Deleted allocations for instance e80a3f77-8f29-4f18-9707-c9793a124cc6
Nov 06 13:33:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-ade2272a-33d0-4988-a163-c24e148e2fd3 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "e80a3f77-8f29-4f18-9707-c9793a124cc6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.901s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:33:27 user nova-compute[74821]: DEBUG nova.compute.manager [req-2405df1d-d191-4bbe-9187-beddc683301f req-01760de4-97e3-43df-b330-eb519fa8df49 service nova] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Received event network-vif-unplugged-6d137b0d-23f0-478c-a6a9-b4fc955ce4c2 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:33:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2405df1d-d191-4bbe-9187-beddc683301f req-01760de4-97e3-43df-b330-eb519fa8df49 service nova] Acquiring lock "e80a3f77-8f29-4f18-9707-c9793a124cc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:33:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2405df1d-d191-4bbe-9187-beddc683301f req-01760de4-97e3-43df-b330-eb519fa8df49 service nova] Lock "e80a3f77-8f29-4f18-9707-c9793a124cc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:33:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2405df1d-d191-4bbe-9187-beddc683301f req-01760de4-97e3-43df-b330-eb519fa8df49 service nova] Lock "e80a3f77-8f29-4f18-9707-c9793a124cc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:33:27 user nova-compute[74821]: DEBUG nova.compute.manager [req-2405df1d-d191-4bbe-9187-beddc683301f req-01760de4-97e3-43df-b330-eb519fa8df49 service nova] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] No waiting events found dispatching network-vif-unplugged-6d137b0d-23f0-478c-a6a9-b4fc955ce4c2 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:33:27 user nova-compute[74821]: WARNING nova.compute.manager [req-2405df1d-d191-4bbe-9187-beddc683301f req-01760de4-97e3-43df-b330-eb519fa8df49 service nova] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Received unexpected event network-vif-unplugged-6d137b0d-23f0-478c-a6a9-b4fc955ce4c2 for instance with vm_state deleted and task_state None.
Nov 06 13:33:27 user nova-compute[74821]: DEBUG nova.compute.manager [req-2405df1d-d191-4bbe-9187-beddc683301f req-01760de4-97e3-43df-b330-eb519fa8df49 service nova] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Received event network-vif-plugged-6d137b0d-23f0-478c-a6a9-b4fc955ce4c2 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:33:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2405df1d-d191-4bbe-9187-beddc683301f req-01760de4-97e3-43df-b330-eb519fa8df49 service nova] Acquiring lock "e80a3f77-8f29-4f18-9707-c9793a124cc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:33:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2405df1d-d191-4bbe-9187-beddc683301f req-01760de4-97e3-43df-b330-eb519fa8df49 service nova] Lock "e80a3f77-8f29-4f18-9707-c9793a124cc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:33:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2405df1d-d191-4bbe-9187-beddc683301f req-01760de4-97e3-43df-b330-eb519fa8df49 service nova] Lock "e80a3f77-8f29-4f18-9707-c9793a124cc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:33:27 user nova-compute[74821]: DEBUG nova.compute.manager [req-2405df1d-d191-4bbe-9187-beddc683301f req-01760de4-97e3-43df-b330-eb519fa8df49 service nova] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] No waiting events found dispatching network-vif-plugged-6d137b0d-23f0-478c-a6a9-b4fc955ce4c2 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:33:27 user nova-compute[74821]: WARNING nova.compute.manager [req-2405df1d-d191-4bbe-9187-beddc683301f req-01760de4-97e3-43df-b330-eb519fa8df49 service nova] [instance: e80a3f77-8f29-4f18-9707-c9793a124cc6] Received unexpected event network-vif-plugged-6d137b0d-23f0-478c-a6a9-b4fc955ce4c2 for instance with vm_state deleted and task_state None.
Nov 06 13:33:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:36 user nova-compute[74821]: INFO nova.compute.manager [None req-2940d417-90bd-449d-98e9-395fd6946b14 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Unrescuing
Nov 06 13:33:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2940d417-90bd-449d-98e9-395fd6946b14 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "refresh_cache-64ae6f5e-38a1-4871-8015-c2097f64b33b" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:33:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2940d417-90bd-449d-98e9-395fd6946b14 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquired lock "refresh_cache-64ae6f5e-38a1-4871-8015-c2097f64b33b" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:33:36 user nova-compute[74821]: DEBUG nova.network.neutron [None req-2940d417-90bd-449d-98e9-395fd6946b14 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:33:36 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:33:37 user nova-compute[74821]: DEBUG nova.network.neutron [None req-2940d417-90bd-449d-98e9-395fd6946b14 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Updating instance_info_cache with network_info: [{"id": "ded8f989-f920-42ed-a158-04455e6abbc1", "address": "fa:16:3e:b2:3e:a6", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8f989-f9", "ovs_interfaceid": "ded8f989-f920-42ed-a158-04455e6abbc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:33:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2940d417-90bd-449d-98e9-395fd6946b14 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Releasing lock "refresh_cache-64ae6f5e-38a1-4871-8015-c2097f64b33b" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:33:37 user nova-compute[74821]: DEBUG nova.objects.instance [None req-2940d417-90bd-449d-98e9-395fd6946b14 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lazy-loading 'flavor' on Instance uuid 64ae6f5e-38a1-4871-8015-c2097f64b33b {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:33:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:37 user nova-compute[74821]: DEBUG nova.compute.manager [req-96d143c6-55de-4c67-9512-c119e496b803 req-ac6e35bf-649d-4485-86ab-abe9a0d1dc3d service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Received event network-vif-unplugged-ded8f989-f920-42ed-a158-04455e6abbc1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:33:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-96d143c6-55de-4c67-9512-c119e496b803 req-ac6e35bf-649d-4485-86ab-abe9a0d1dc3d service nova] Acquiring lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:33:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-96d143c6-55de-4c67-9512-c119e496b803 req-ac6e35bf-649d-4485-86ab-abe9a0d1dc3d service nova] Lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:33:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-96d143c6-55de-4c67-9512-c119e496b803 req-ac6e35bf-649d-4485-86ab-abe9a0d1dc3d service nova] Lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:33:37 user nova-compute[74821]: DEBUG nova.compute.manager [req-96d143c6-55de-4c67-9512-c119e496b803 req-ac6e35bf-649d-4485-86ab-abe9a0d1dc3d service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] No waiting events found dispatching network-vif-unplugged-ded8f989-f920-42ed-a158-04455e6abbc1 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:33:37 user nova-compute[74821]: WARNING nova.compute.manager [req-96d143c6-55de-4c67-9512-c119e496b803 req-ac6e35bf-649d-4485-86ab-abe9a0d1dc3d service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Received unexpected event network-vif-unplugged-ded8f989-f920-42ed-a158-04455e6abbc1 for instance with vm_state rescued and task_state unrescuing.
Nov 06 13:33:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:37 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Instance destroyed successfully.
Nov 06 13:33:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:33:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:33:39 user nova-compute[74821]: DEBUG nova.compute.manager [req-f3a216b7-24b4-42f3-9578-9d95acbb5e72 req-4d5f75fb-e7d2-4a7e-b6af-fab39d6cb5a3 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Received event network-vif-plugged-ded8f989-f920-42ed-a158-04455e6abbc1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:33:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f3a216b7-24b4-42f3-9578-9d95acbb5e72 req-4d5f75fb-e7d2-4a7e-b6af-fab39d6cb5a3 service nova] Acquiring lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:33:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f3a216b7-24b4-42f3-9578-9d95acbb5e72 req-4d5f75fb-e7d2-4a7e-b6af-fab39d6cb5a3 service nova] Lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:33:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f3a216b7-24b4-42f3-9578-9d95acbb5e72 req-4d5f75fb-e7d2-4a7e-b6af-fab39d6cb5a3 service nova] Lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:33:39 user nova-compute[74821]: DEBUG nova.compute.manager [req-f3a216b7-24b4-42f3-9578-9d95acbb5e72 req-4d5f75fb-e7d2-4a7e-b6af-fab39d6cb5a3 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] No waiting events found dispatching network-vif-plugged-ded8f989-f920-42ed-a158-04455e6abbc1 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:33:39 user nova-compute[74821]: WARNING nova.compute.manager [req-f3a216b7-24b4-42f3-9578-9d95acbb5e72 req-4d5f75fb-e7d2-4a7e-b6af-fab39d6cb5a3 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Received unexpected event network-vif-plugged-ded8f989-f920-42ed-a158-04455e6abbc1 for instance with vm_state rescued and task_state unrescuing.
Nov 06 13:33:39 user nova-compute[74821]: DEBUG nova.objects.instance [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lazy-loading 'flavor' on Instance uuid 8467fdc8-ec8e-4eda-abbc-b146e58e90c8 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:33:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.222s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:33:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:33:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:33:39 user nova-compute[74821]: INFO nova.compute.manager [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Attaching volume c298ae62-e2a0-49f4-a980-e7a04a9b6c13 to /dev/vdb
Nov 06 13:33:39 user nova-compute[74821]: DEBUG os_brick.utils [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:33:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:40 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[90da8e06-957d-4758-80b4-05bddbb43669]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:33:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:40 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42533d2-23b0-49c9-923b-fe34f6aefa7a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:33:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:40 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[743e6978-323f-4aa5-8244-5307b0b0b2b9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:33:40 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c611b9aa-1f17-41d6-bbcd-70b0bf942c7f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:33:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:33:40 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:33:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:33:40 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:33:40 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[404a2fba-0f34-488f-ae24-e542a2973f71]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:33:40 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:33:40 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:33:40 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:33:40 user nova-compute[74821]: DEBUG os_brick.utils [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:33:40 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Updating existing volume attachment record: 52b73667-386b-4776-9045-26c49ef16782 {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:33:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:41 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6f2a94d6-c16f-4f1f-a627-66e0dddc1615 is timed out.
Nov 06 13:33:41 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Successfully detached device vdb from instance 6f2a94d6-c16f-4f1f-a627-66e0dddc1615 from the live domain config.
Nov 06 13:33:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mgwZhHUJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:33:41 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:33:41 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG nova.compute.manager [req-808c2d91-0d49-416e-83cf-41c5b30a63d0 req-11926b60-7edf-4a86-a8d8-8ead6e0fd7d4 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Received event network-vif-plugged-ded8f989-f920-42ed-a158-04455e6abbc1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-808c2d91-0d49-416e-83cf-41c5b30a63d0 req-11926b60-7edf-4a86-a8d8-8ead6e0fd7d4 service nova] Acquiring lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-808c2d91-0d49-416e-83cf-41c5b30a63d0 req-11926b60-7edf-4a86-a8d8-8ead6e0fd7d4 service nova] Lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-808c2d91-0d49-416e-83cf-41c5b30a63d0 req-11926b60-7edf-4a86-a8d8-8ead6e0fd7d4 service nova] Lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG nova.compute.manager [req-808c2d91-0d49-416e-83cf-41c5b30a63d0 req-11926b60-7edf-4a86-a8d8-8ead6e0fd7d4 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] No waiting events found dispatching network-vif-plugged-ded8f989-f920-42ed-a158-04455e6abbc1 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:33:41 user nova-compute[74821]: WARNING nova.compute.manager [req-808c2d91-0d49-416e-83cf-41c5b30a63d0 req-11926b60-7edf-4a86-a8d8-8ead6e0fd7d4 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Received unexpected event network-vif-plugged-ded8f989-f920-42ed-a158-04455e6abbc1 for instance with vm_state rescued and task_state unrescuing.
Nov 06 13:33:41 user nova-compute[74821]: DEBUG nova.compute.manager [req-808c2d91-0d49-416e-83cf-41c5b30a63d0 req-11926b60-7edf-4a86-a8d8-8ead6e0fd7d4 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Received event network-vif-plugged-ded8f989-f920-42ed-a158-04455e6abbc1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-808c2d91-0d49-416e-83cf-41c5b30a63d0 req-11926b60-7edf-4a86-a8d8-8ead6e0fd7d4 service nova] Acquiring lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-808c2d91-0d49-416e-83cf-41c5b30a63d0 req-11926b60-7edf-4a86-a8d8-8ead6e0fd7d4 service nova] Lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-808c2d91-0d49-416e-83cf-41c5b30a63d0 req-11926b60-7edf-4a86-a8d8-8ead6e0fd7d4 service nova] Lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG nova.compute.manager [req-808c2d91-0d49-416e-83cf-41c5b30a63d0 req-11926b60-7edf-4a86-a8d8-8ead6e0fd7d4 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] No waiting events found dispatching network-vif-plugged-ded8f989-f920-42ed-a158-04455e6abbc1 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:33:41 user nova-compute[74821]: WARNING nova.compute.manager [req-808c2d91-0d49-416e-83cf-41c5b30a63d0 req-11926b60-7edf-4a86-a8d8-8ead6e0fd7d4 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Received unexpected event network-vif-plugged-ded8f989-f920-42ed-a158-04455e6abbc1 for instance with vm_state rescued and task_state unrescuing.
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb588072-eb1c-4b4f-9e19-5d751218d90a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:33:41 user nova-compute[74821]: No targets found.
Nov 06 13:33:41 user nova-compute[74821]: iSNS:
Nov 06 13:33:41 user nova-compute[74821]: No targets found.
Nov 06 13:33:41 user nova-compute[74821]: STATIC:
Nov 06 13:33:41 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034
Nov 06 13:33:41 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:33:41 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:33:41 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604
Nov 06 13:33:41 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:33:41 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:33:41 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82
Nov 06 13:33:41 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:33:41 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:33:41 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f
Nov 06 13:33:41 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:33:41 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:33:41 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979
Nov 06 13:33:41 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:33:41 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:33:41 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6
Nov 06 13:33:41 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:33:41 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:33:41 user nova-compute[74821]: FIRMWARE:
Nov 06 13:33:41 user nova-compute[74821]: No targets found.
Nov 06 13:33:41 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:33:41 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:33:41 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG nova.compute.manager [None req-2940d417-90bd-449d-98e9-395fd6946b14 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[62581c33-31c8-4662-8f3a-ed920bd7d6ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da8cb5f-3942-4e48-b546-29d4ae8aabf3]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:33:41 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:33:41 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:33:41 user nova-compute[74821]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)
Nov 06 13:33:41 user nova-compute[74821]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)
Nov 06 13:33:41 user nova-compute[74821]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034 (non-flash)
Nov 06 13:33:41 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:33:41 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:33:41 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:33:41 user nova-compute[74821]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)
Nov 06 13:33:41 user nova-compute[74821]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)
Nov 06 13:33:41 user nova-compute[74821]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034 (non-flash)
Nov 06 13:33:41 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e40587d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034'): ({'sdg'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Removing single pathed devices sdg {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9de6bf3-6786-4281-8d3f-644ad4d70321]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f650301-72d7-4b88-b2a1-49490199dacd]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Flushing IO for device /dev/sdg {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b87ba6-117c-4b66-9810-fcf32fdcc822]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1897fd7f-2aef-401e-b960-2371a85ba316]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] SCSI volumes sdg have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bee60a9-ded3-41f7-a2e0-21d0ec3a8b19]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[074c3a9d-0ae6-462a-9f48-4f9496a315ea]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034, portal: 172.16.0.220,3260]
Nov 06 13:33:41 user nova-compute[74821]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034, portal: 172.16.0.220,3260] successful.
Nov 06 13:33:41 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2d2935d-75c1-455a-a440-fa40bf7c1034 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[361f5e55-2330-4616-a388-2ed667cd91f0]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] <== disconnect_volume: return (365ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:33:41 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:33:42 user nova-compute[74821]: DEBUG nova.objects.instance [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Lazy-loading 'flavor' on Instance uuid 6f2a94d6-c16f-4f1f-a627-66e0dddc1615 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:33:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d97f7319-a3d7-4726-8f16-5f6db39358f7 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Lock "6f2a94d6-c16f-4f1f-a627-66e0dddc1615" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.915s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:33:42 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:33:42 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:33:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-4bc6444e-b55d-4d81-88d1-f4d147255119" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:33:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-4bc6444e-b55d-4d81-88d1-f4d147255119" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:33:43 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:33:43 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Updating instance_info_cache with network_info: [{"id": "b317cb51-20ab-4f25-b3de-4c2981a97993", "address": "fa:16:3e:28:c0:6e", "network": {"id": "5e673907-9763-4136-845d-b3154200d004", "bridge": "br-int", "label": "tempest-TestStampPattern-539864653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608cf017c43942a4a94982b1d5d4d2b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb317cb51-20", "ovs_interfaceid": "b317cb51-20ab-4f25-b3de-4c2981a97993", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:33:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-4bc6444e-b55d-4d81-88d1-f4d147255119" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:33:43 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:33:43 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:33:44 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:33:44 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:33:44 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:33:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:45 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:33:46 user nova-compute[74821]: DEBUG nova.compute.manager [req-beacd6f4-e5b2-4009-a39a-451a4b46660d req-12d6a00a-05f1-4226-93ed-1050025d46bb service nova] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Received event network-changed-ca4bd1cf-c2c7-43c3-81db-5cda9a48d593 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:33:46 user nova-compute[74821]: DEBUG nova.compute.manager [req-beacd6f4-e5b2-4009-a39a-451a4b46660d req-12d6a00a-05f1-4226-93ed-1050025d46bb service nova] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Refreshing instance network info cache due to event network-changed-ca4bd1cf-c2c7-43c3-81db-5cda9a48d593. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:33:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-beacd6f4-e5b2-4009-a39a-451a4b46660d req-12d6a00a-05f1-4226-93ed-1050025d46bb service nova] Acquiring lock "refresh_cache-f7b2673b-023a-46eb-88ea-2fa42c33b173" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:33:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-beacd6f4-e5b2-4009-a39a-451a4b46660d req-12d6a00a-05f1-4226-93ed-1050025d46bb service nova] Acquired lock "refresh_cache-f7b2673b-023a-46eb-88ea-2fa42c33b173" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:33:46 user nova-compute[74821]: DEBUG nova.network.neutron [req-beacd6f4-e5b2-4009-a39a-451a4b46660d req-12d6a00a-05f1-4226-93ed-1050025d46bb service nova] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Refreshing network info cache for port ca4bd1cf-c2c7-43c3-81db-5cda9a48d593 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:33:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-bbc22db3-dc69-465b-9948-5159bd33fd33 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "f7b2673b-023a-46eb-88ea-2fa42c33b173" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:33:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-bbc22db3-dc69-465b-9948-5159bd33fd33 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "f7b2673b-023a-46eb-88ea-2fa42c33b173" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:33:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-bbc22db3-dc69-465b-9948-5159bd33fd33 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "f7b2673b-023a-46eb-88ea-2fa42c33b173-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:33:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-bbc22db3-dc69-465b-9948-5159bd33fd33 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "f7b2673b-023a-46eb-88ea-2fa42c33b173-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:33:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-bbc22db3-dc69-465b-9948-5159bd33fd33 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "f7b2673b-023a-46eb-88ea-2fa42c33b173-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:33:46 user nova-compute[74821]: INFO nova.compute.manager [None req-bbc22db3-dc69-465b-9948-5159bd33fd33 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Terminating instance
Nov 06 13:33:46 user nova-compute[74821]: DEBUG nova.compute.manager [None req-bbc22db3-dc69-465b-9948-5159bd33fd33 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:33:46 user nova-compute[74821]: DEBUG nova.network.neutron [req-beacd6f4-e5b2-4009-a39a-451a4b46660d req-12d6a00a-05f1-4226-93ed-1050025d46bb service nova] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Updated VIF entry in instance network info cache for port ca4bd1cf-c2c7-43c3-81db-5cda9a48d593. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:33:46 user nova-compute[74821]: DEBUG nova.network.neutron [req-beacd6f4-e5b2-4009-a39a-451a4b46660d req-12d6a00a-05f1-4226-93ed-1050025d46bb service nova] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Updating instance_info_cache with network_info: [{"id": "ca4bd1cf-c2c7-43c3-81db-5cda9a48d593", "address": "fa:16:3e:a5:1d:46", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4bd1cf-c2", "ovs_interfaceid": "ca4bd1cf-c2c7-43c3-81db-5cda9a48d593", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:33:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-beacd6f4-e5b2-4009-a39a-451a4b46660d req-12d6a00a-05f1-4226-93ed-1050025d46bb service nova] Releasing lock "refresh_cache-f7b2673b-023a-46eb-88ea-2fa42c33b173" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:33:46 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:46 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:47 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Instance destroyed successfully.
Nov 06 13:33:47 user nova-compute[74821]: DEBUG nova.objects.instance [None req-bbc22db3-dc69-465b-9948-5159bd33fd33 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lazy-loading 'resources' on Instance uuid f7b2673b-023a-46eb-88ea-2fa42c33b173 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:33:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-bbc22db3-dc69-465b-9948-5159bd33fd33 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:31:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1814398905',display_name='tempest-AttachVolumeNegativeTest-server-1814398905',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1814398905',id=40,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXSfyFLtJ2SYAUk29F2WDVG8Lp04fJ9oKPLR4VCROb5auH7r7yLMEswsgPSjsulV3Q1gLFmUfc7sI53l90/RlEPvMv5DJO+Swqb9kIKN9Biav3H/PTtO2kDME8kHL468g==',key_name='tempest-keypair-1512070866',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:32:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c6d2ded0b1d4af09f1e05582bcbd3ae',ramdisk_id='',reservation_id='r-e2wcr4vk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1164383705',owner_user_name='tempest-AttachVolumeNegativeTest-1164383705-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:32:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ffddfc972374f6aa7d81288d34690cf',uuid=f7b2673b-023a-46eb-88ea-2fa42c33b173,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca4bd1cf-c2c7-43c3-81db-5cda9a48d593", "address": "fa:16:3e:a5:1d:46", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4bd1cf-c2", "ovs_interfaceid": "ca4bd1cf-c2c7-43c3-81db-5cda9a48d593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:33:47 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-bbc22db3-dc69-465b-9948-5159bd33fd33 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Converting VIF {"id": "ca4bd1cf-c2c7-43c3-81db-5cda9a48d593", "address": "fa:16:3e:a5:1d:46", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4bd1cf-c2", "ovs_interfaceid": "ca4bd1cf-c2c7-43c3-81db-5cda9a48d593", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:33:47 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-bbc22db3-dc69-465b-9948-5159bd33fd33 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:1d:46,bridge_name='br-int',has_traffic_filtering=True,id=ca4bd1cf-c2c7-43c3-81db-5cda9a48d593,network=Network(3e1f6a20-5316-4c49-93a5-deabb70d8608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4bd1cf-c2') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:33:47 user nova-compute[74821]: DEBUG os_vif [None req-bbc22db3-dc69-465b-9948-5159bd33fd33 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:1d:46,bridge_name='br-int',has_traffic_filtering=True,id=ca4bd1cf-c2c7-43c3-81db-5cda9a48d593,network=Network(3e1f6a20-5316-4c49-93a5-deabb70d8608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4bd1cf-c2') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:33:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca4bd1cf-c2, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:33:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a55b6ee8-6886-44e5-92a7-6aa3e4bd9226) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:33:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:33:47 user nova-compute[74821]: INFO os_vif [None req-bbc22db3-dc69-465b-9948-5159bd33fd33 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:1d:46,bridge_name='br-int',has_traffic_filtering=True,id=ca4bd1cf-c2c7-43c3-81db-5cda9a48d593,network=Network(3e1f6a20-5316-4c49-93a5-deabb70d8608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4bd1cf-c2')
Nov 06 13:33:47 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-bbc22db3-dc69-465b-9948-5159bd33fd33 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Deleting instance files /opt/stack/data/nova/instances/f7b2673b-023a-46eb-88ea-2fa42c33b173_del
Nov 06 13:33:47 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-bbc22db3-dc69-465b-9948-5159bd33fd33 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Deletion of /opt/stack/data/nova/instances/f7b2673b-023a-46eb-88ea-2fa42c33b173_del complete
Nov 06 13:33:47 user nova-compute[74821]: INFO nova.compute.manager [None req-bbc22db3-dc69-465b-9948-5159bd33fd33 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 06 13:33:47 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-bbc22db3-dc69-465b-9948-5159bd33fd33 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:33:47 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:33:47 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:33:48 user nova-compute[74821]: DEBUG nova.compute.manager [req-262ff9f2-6c20-4659-8c0d-fb5604bc4521 req-80436f08-16bf-40d4-9f00-e9d075ce6323 service nova] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Received event network-vif-unplugged-ca4bd1cf-c2c7-43c3-81db-5cda9a48d593 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:33:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-262ff9f2-6c20-4659-8c0d-fb5604bc4521 req-80436f08-16bf-40d4-9f00-e9d075ce6323 service nova] Acquiring lock "f7b2673b-023a-46eb-88ea-2fa42c33b173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:33:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-262ff9f2-6c20-4659-8c0d-fb5604bc4521 req-80436f08-16bf-40d4-9f00-e9d075ce6323 service nova] Lock "f7b2673b-023a-46eb-88ea-2fa42c33b173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:33:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-262ff9f2-6c20-4659-8c0d-fb5604bc4521 req-80436f08-16bf-40d4-9f00-e9d075ce6323 service nova] Lock "f7b2673b-023a-46eb-88ea-2fa42c33b173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:33:48 user nova-compute[74821]: DEBUG nova.compute.manager [req-262ff9f2-6c20-4659-8c0d-fb5604bc4521 req-80436f08-16bf-40d4-9f00-e9d075ce6323 service nova] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] No waiting events found dispatching network-vif-unplugged-ca4bd1cf-c2c7-43c3-81db-5cda9a48d593 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:33:48 user nova-compute[74821]: DEBUG nova.compute.manager [req-262ff9f2-6c20-4659-8c0d-fb5604bc4521 req-80436f08-16bf-40d4-9f00-e9d075ce6323 service nova] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Received event network-vif-unplugged-ca4bd1cf-c2c7-43c3-81db-5cda9a48d593 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:33:48 user nova-compute[74821]: DEBUG nova.compute.manager [req-262ff9f2-6c20-4659-8c0d-fb5604bc4521 req-80436f08-16bf-40d4-9f00-e9d075ce6323 service nova] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Received event network-vif-plugged-ca4bd1cf-c2c7-43c3-81db-5cda9a48d593 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:33:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-262ff9f2-6c20-4659-8c0d-fb5604bc4521 req-80436f08-16bf-40d4-9f00-e9d075ce6323 service nova] Acquiring lock "f7b2673b-023a-46eb-88ea-2fa42c33b173-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:33:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-262ff9f2-6c20-4659-8c0d-fb5604bc4521 req-80436f08-16bf-40d4-9f00-e9d075ce6323 service nova] Lock "f7b2673b-023a-46eb-88ea-2fa42c33b173-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:33:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-262ff9f2-6c20-4659-8c0d-fb5604bc4521 req-80436f08-16bf-40d4-9f00-e9d075ce6323 service nova] Lock "f7b2673b-023a-46eb-88ea-2fa42c33b173-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:33:48 user nova-compute[74821]: DEBUG nova.compute.manager [req-262ff9f2-6c20-4659-8c0d-fb5604bc4521 req-80436f08-16bf-40d4-9f00-e9d075ce6323 service nova] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] No waiting events found dispatching network-vif-plugged-ca4bd1cf-c2c7-43c3-81db-5cda9a48d593 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:33:48 user nova-compute[74821]: WARNING nova.compute.manager [req-262ff9f2-6c20-4659-8c0d-fb5604bc4521 req-80436f08-16bf-40d4-9f00-e9d075ce6323 service nova] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Received unexpected event network-vif-plugged-ca4bd1cf-c2c7-43c3-81db-5cda9a48d593 for instance with vm_state active and task_state deleting.
Nov 06 13:33:48 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:33:48 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Took 0.75 seconds to deallocate network for instance.
Nov 06 13:33:48 user nova-compute[74821]: DEBUG nova.compute.manager [req-cb50c2e9-2581-4cca-85e2-6b7fa59ca610 req-5268a385-45ec-4cb5-9974-fd414c601081 service nova] [instance: f7b2673b-023a-46eb-88ea-2fa42c33b173] Received event network-vif-deleted-ca4bd1cf-c2c7-43c3-81db-5cda9a48d593 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:33:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-bbc22db3-dc69-465b-9948-5159bd33fd33 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:33:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-bbc22db3-dc69-465b-9948-5159bd33fd33 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:33:48 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-bbc22db3-dc69-465b-9948-5159bd33fd33 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:33:48 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-bbc22db3-dc69-465b-9948-5159bd33fd33 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:33:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-bbc22db3-dc69-465b-9948-5159bd33fd33 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:33:48 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-bbc22db3-dc69-465b-9948-5159bd33fd33 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Deleted allocations for instance f7b2673b-023a-46eb-88ea-2fa42c33b173
Nov 06 13:33:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-bbc22db3-dc69-465b-9948-5159bd33fd33 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "f7b2673b-023a-46eb-88ea-2fa42c33b173" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.260s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:33:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:50 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:33:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:33:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:33:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:33:50 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:33:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:33:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2a94d6-c16f-4f1f-a627-66e0dddc1615/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2a94d6-c16f-4f1f-a627-66e0dddc1615/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2a94d6-c16f-4f1f-a627-66e0dddc1615/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2a94d6-c16f-4f1f-a627-66e0dddc1615/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:51 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:33:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:33:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:33:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:53 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:33:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:53 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:33:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:33:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:33:54 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:33:54 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:33:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=7537MB free_disk=24.735641479492188GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:33:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:33:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:33:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 2de346cb-9858-47b8-a86c-4fde720d6127 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:33:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 49c65aca-8392-46ba-8fa3-b47ff2416cb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:33:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 496f8213-4b32-4211-a354-e33a4a088848 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:33:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 1290bdb3-827f-4365-a4f1-4ae063de780d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:33:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 4bc6444e-b55d-4d81-88d1-f4d147255119 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:33:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 64ae6f5e-38a1-4871-8015-c2097f64b33b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:33:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 6121ff1a-d276-485f-85f8-ba451f5b0d37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:33:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:33:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 6f2a94d6-c16f-4f1f-a627-66e0dddc1615 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:33:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 8467fdc8-ec8e-4eda-abbc-b146e58e90c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:33:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 2d8da345-f66d-45c2-8ccd-d22fdf79a14d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:33:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:33:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:33:55 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:33:55 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:33:55 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:33:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.543s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:33:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:33:59 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:33:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:03 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:34:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RvCcYpqK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:34:03 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:34:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:34:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:34:03 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:34:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:34:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:34:03 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:34:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:03 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[00608682-ff7c-4581-8877-969ec3314321]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:34:04 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1784fd1-6636-4b6a-9c8c-b767ffb2f6d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13] added
Nov 06 13:34:04 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e23b325-b221-4372-8379-d49ec213e2a0]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6ab2a5-0d71-4016-a117-99a2f355240d]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RvCcYpqK {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RvCcYpqK" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0c95b1-7aab-4de2-9770-ce3b0850fbc6]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RvCcYpqK'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a26ae6-cd23-4b28-a021-48d395fb561b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff6aa10-601a-464b-b16d-db42048fe11c]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:34:04 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:34:04 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:34:04 user nova-compute[74821]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)
Nov 06 13:34:04 user nova-compute[74821]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)
Nov 06 13:34:04 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:34:04 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:34:04 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:34:04 user nova-compute[74821]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)
Nov 06 13:34:04 user nova-compute[74821]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)
Nov 06 13:34:04 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40ed44b-eb7b-4bb1-97b4-23ca77c0d3e3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13, portal: 172.16.0.220,3260]
Nov 06 13:34:04 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13, portal: 172.16.0.220,3260] successful.
Nov 06 13:34:04 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b89063-8c1a-4176-a189-214880053908]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e75bc7-47e7-4e94-b6fc-70793b764932]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:34:04 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:34:04 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:34:04 user nova-compute[74821]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)
Nov 06 13:34:04 user nova-compute[74821]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)
Nov 06 13:34:04 user nova-compute[74821]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 (non-flash)
Nov 06 13:34:04 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:34:04 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:34:04 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:34:04 user nova-compute[74821]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)
Nov 06 13:34:04 user nova-compute[74821]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)
Nov 06 13:34:04 user nova-compute[74821]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 (non-flash)
Nov 06 13:34:04 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] HCTL ('38', '-', '-', 0) found on session 38 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f490df3a-b039-4b8d-a9a8-c8abd3be7721]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Searching for a device in session 38 and hctl ['38', '*', '*', 0] yield: None {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:34:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:05 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Searching for a device in session 38 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:34:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RvCcYpqK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:34:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:34:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '26535633363643863', 'path': '/dev/sdg'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:34:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535633363643863', 'path': '/dev/sdg'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:34:05 user nova-compute[74821]: DEBUG nova.objects.instance [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lazy-loading 'flavor' on Instance uuid 8467fdc8-ec8e-4eda-abbc-b146e58e90c8 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:34:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 13:34:05 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:34:05 user nova-compute[74821]:   <source dev="/dev/sdg"/>
Nov 06 13:34:05 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:34:05 user nova-compute[74821]:   <serial>c298ae62-e2a0-49f4-a980-e7a04a9b6c13</serial>
Nov 06 13:34:05 user nova-compute[74821]: </disk>
Nov 06 13:34:05 user nova-compute[74821]:  {{(pid=74821) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 13:34:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:34:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:34:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] No VIF found with MAC fa:16:3e:7c:2c:c7, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:34:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-912f9a8f-835c-44b1-888f-48389ef2075f tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.976s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:34:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:14 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:17 user nova-compute[74821]: INFO nova.compute.manager [None req-4f4e87e6-05cc-46ca-ba1f-67f15861bdce tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Get console output
Nov 06 13:34:17 user nova-compute[74821]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 06 13:34:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:20 user nova-compute[74821]: DEBUG nova.compute.manager [req-598f0dba-f646-4db7-a680-abc40203240d req-93fd97ad-9413-48b3-8088-f1fcb7cd8fa7 service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Received event network-changed-30866a49-b7d0-458d-87a6-e97d3c533640 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:34:20 user nova-compute[74821]: DEBUG nova.compute.manager [req-598f0dba-f646-4db7-a680-abc40203240d req-93fd97ad-9413-48b3-8088-f1fcb7cd8fa7 service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Refreshing instance network info cache due to event network-changed-30866a49-b7d0-458d-87a6-e97d3c533640. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:34:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-598f0dba-f646-4db7-a680-abc40203240d req-93fd97ad-9413-48b3-8088-f1fcb7cd8fa7 service nova] Acquiring lock "refresh_cache-8467fdc8-ec8e-4eda-abbc-b146e58e90c8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:34:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-598f0dba-f646-4db7-a680-abc40203240d req-93fd97ad-9413-48b3-8088-f1fcb7cd8fa7 service nova] Acquired lock "refresh_cache-8467fdc8-ec8e-4eda-abbc-b146e58e90c8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:34:20 user nova-compute[74821]: DEBUG nova.network.neutron [req-598f0dba-f646-4db7-a680-abc40203240d req-93fd97ad-9413-48b3-8088-f1fcb7cd8fa7 service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Refreshing network info cache for port 30866a49-b7d0-458d-87a6-e97d3c533640 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:34:20 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:21 user nova-compute[74821]: DEBUG nova.network.neutron [req-598f0dba-f646-4db7-a680-abc40203240d req-93fd97ad-9413-48b3-8088-f1fcb7cd8fa7 service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Updated VIF entry in instance network info cache for port 30866a49-b7d0-458d-87a6-e97d3c533640. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:34:21 user nova-compute[74821]: DEBUG nova.network.neutron [req-598f0dba-f646-4db7-a680-abc40203240d req-93fd97ad-9413-48b3-8088-f1fcb7cd8fa7 service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Updating instance_info_cache with network_info: [{"id": "30866a49-b7d0-458d-87a6-e97d3c533640", "address": "fa:16:3e:7c:2c:c7", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30866a49-b7", "ovs_interfaceid": "30866a49-b7d0-458d-87a6-e97d3c533640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:34:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-598f0dba-f646-4db7-a680-abc40203240d req-93fd97ad-9413-48b3-8088-f1fcb7cd8fa7 service nova] Releasing lock "refresh_cache-8467fdc8-ec8e-4eda-abbc-b146e58e90c8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:34:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0d2a7557-346e-4bf1-bd37-4dfbdddb5e5b tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Acquiring lock "6f2a94d6-c16f-4f1f-a627-66e0dddc1615" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:34:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0d2a7557-346e-4bf1-bd37-4dfbdddb5e5b tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Lock "6f2a94d6-c16f-4f1f-a627-66e0dddc1615" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:34:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0d2a7557-346e-4bf1-bd37-4dfbdddb5e5b tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Acquiring lock "6f2a94d6-c16f-4f1f-a627-66e0dddc1615-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:34:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0d2a7557-346e-4bf1-bd37-4dfbdddb5e5b tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Lock "6f2a94d6-c16f-4f1f-a627-66e0dddc1615-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:34:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0d2a7557-346e-4bf1-bd37-4dfbdddb5e5b tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Lock "6f2a94d6-c16f-4f1f-a627-66e0dddc1615-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:34:22 user nova-compute[74821]: INFO nova.compute.manager [None req-0d2a7557-346e-4bf1-bd37-4dfbdddb5e5b tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Terminating instance
Nov 06 13:34:22 user nova-compute[74821]: DEBUG nova.compute.manager [None req-0d2a7557-346e-4bf1-bd37-4dfbdddb5e5b tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:34:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:22 user nova-compute[74821]: DEBUG nova.compute.manager [req-6e25b38e-7e92-4eae-a0b3-6ce2caaaf60e req-9c629c8e-3442-4c17-9d2d-e21aba323f8e service nova] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Received event network-vif-unplugged-8e9606b7-8bbe-47bc-87ac-03dd9f6fe085 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:34:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6e25b38e-7e92-4eae-a0b3-6ce2caaaf60e req-9c629c8e-3442-4c17-9d2d-e21aba323f8e service nova] Acquiring lock "6f2a94d6-c16f-4f1f-a627-66e0dddc1615-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:34:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6e25b38e-7e92-4eae-a0b3-6ce2caaaf60e req-9c629c8e-3442-4c17-9d2d-e21aba323f8e service nova] Lock "6f2a94d6-c16f-4f1f-a627-66e0dddc1615-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:34:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6e25b38e-7e92-4eae-a0b3-6ce2caaaf60e req-9c629c8e-3442-4c17-9d2d-e21aba323f8e service nova] Lock "6f2a94d6-c16f-4f1f-a627-66e0dddc1615-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:34:22 user nova-compute[74821]: DEBUG nova.compute.manager [req-6e25b38e-7e92-4eae-a0b3-6ce2caaaf60e req-9c629c8e-3442-4c17-9d2d-e21aba323f8e service nova] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] No waiting events found dispatching network-vif-unplugged-8e9606b7-8bbe-47bc-87ac-03dd9f6fe085 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:34:22 user nova-compute[74821]: DEBUG nova.compute.manager [req-6e25b38e-7e92-4eae-a0b3-6ce2caaaf60e req-9c629c8e-3442-4c17-9d2d-e21aba323f8e service nova] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Received event network-vif-unplugged-8e9606b7-8bbe-47bc-87ac-03dd9f6fe085 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:34:22 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Instance destroyed successfully.
Nov 06 13:34:22 user nova-compute[74821]: DEBUG nova.objects.instance [None req-0d2a7557-346e-4bf1-bd37-4dfbdddb5e5b tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Lazy-loading 'resources' on Instance uuid 6f2a94d6-c16f-4f1f-a627-66e0dddc1615 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:34:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-0d2a7557-346e-4bf1-bd37-4dfbdddb5e5b tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:30:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1604097736',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1604097736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1604097',id=38,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHR0UbT3l0QsZBv6NXwoSEa+gjEMIzs04Fs9zmLKsHExr3ZjcYzxy4eeY1/41GxzLYiNnG+faltY50eUqgB7I8UMM0OxDyuFw8vHSygWEp5pzmoF1xLoskcpiAMmCyg2hQ==',key_name='tempest-keypair-1757829620',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:31:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73b4663a8c224eac879b6c6694396624',ramdisk_id='',reservation_id='r-xgtdt4m8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1833933965',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:31:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e9ebc4729972430f8840859070fefc37',uuid=6f2a94d6-c16f-4f1f-a627-66e0dddc1615,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e9606b7-8bbe-47bc-87ac-03dd9f6fe085", "address": "fa:16:3e:61:68:32", "network": {"id": "c4011ab9-7e5a-47da-a1f3-9fe74acc3b8f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1383136864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73b4663a8c224eac879b6c6694396624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9606b7-8b", "ovs_interfaceid": "8e9606b7-8bbe-47bc-87ac-03dd9f6fe085", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:34:22 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-0d2a7557-346e-4bf1-bd37-4dfbdddb5e5b tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Converting VIF {"id": "8e9606b7-8bbe-47bc-87ac-03dd9f6fe085", "address": "fa:16:3e:61:68:32", "network": {"id": "c4011ab9-7e5a-47da-a1f3-9fe74acc3b8f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1383136864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73b4663a8c224eac879b6c6694396624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9606b7-8b", "ovs_interfaceid": "8e9606b7-8bbe-47bc-87ac-03dd9f6fe085", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:34:22 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-0d2a7557-346e-4bf1-bd37-4dfbdddb5e5b tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:68:32,bridge_name='br-int',has_traffic_filtering=True,id=8e9606b7-8bbe-47bc-87ac-03dd9f6fe085,network=Network(c4011ab9-7e5a-47da-a1f3-9fe74acc3b8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e9606b7-8b') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:34:22 user nova-compute[74821]: DEBUG os_vif [None req-0d2a7557-346e-4bf1-bd37-4dfbdddb5e5b tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:68:32,bridge_name='br-int',has_traffic_filtering=True,id=8e9606b7-8bbe-47bc-87ac-03dd9f6fe085,network=Network(c4011ab9-7e5a-47da-a1f3-9fe74acc3b8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e9606b7-8b') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:34:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e9606b7-8b, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:34:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:34:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=437dd0cd-ce51-4cd4-9965-347a5f8fe562) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:34:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:23 user nova-compute[74821]: INFO os_vif [None req-0d2a7557-346e-4bf1-bd37-4dfbdddb5e5b tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:68:32,bridge_name='br-int',has_traffic_filtering=True,id=8e9606b7-8bbe-47bc-87ac-03dd9f6fe085,network=Network(c4011ab9-7e5a-47da-a1f3-9fe74acc3b8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e9606b7-8b')
Nov 06 13:34:23 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-0d2a7557-346e-4bf1-bd37-4dfbdddb5e5b tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Deleting instance files /opt/stack/data/nova/instances/6f2a94d6-c16f-4f1f-a627-66e0dddc1615_del
Nov 06 13:34:23 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-0d2a7557-346e-4bf1-bd37-4dfbdddb5e5b tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Deletion of /opt/stack/data/nova/instances/6f2a94d6-c16f-4f1f-a627-66e0dddc1615_del complete
Nov 06 13:34:23 user nova-compute[74821]: INFO nova.compute.manager [None req-0d2a7557-346e-4bf1-bd37-4dfbdddb5e5b tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 06 13:34:23 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-0d2a7557-346e-4bf1-bd37-4dfbdddb5e5b tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:34:23 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:34:23 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:34:23 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:34:23 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Took 0.85 seconds to deallocate network for instance.
Nov 06 13:34:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0d2a7557-346e-4bf1-bd37-4dfbdddb5e5b tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:34:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0d2a7557-346e-4bf1-bd37-4dfbdddb5e5b tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:34:24 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-0d2a7557-346e-4bf1-bd37-4dfbdddb5e5b tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:34:24 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-0d2a7557-346e-4bf1-bd37-4dfbdddb5e5b tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:34:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0d2a7557-346e-4bf1-bd37-4dfbdddb5e5b tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.432s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:34:24 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-0d2a7557-346e-4bf1-bd37-4dfbdddb5e5b tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Deleted allocations for instance 6f2a94d6-c16f-4f1f-a627-66e0dddc1615
Nov 06 13:34:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-0d2a7557-346e-4bf1-bd37-4dfbdddb5e5b tempest-TestServerVolumeAttachScenarioOldVersion-1833933965 tempest-TestServerVolumeAttachScenarioOldVersion-1833933965-project-member] Lock "6f2a94d6-c16f-4f1f-a627-66e0dddc1615" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.521s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:34:24 user nova-compute[74821]: DEBUG nova.compute.manager [req-31c8fbcf-565b-40fa-96d0-89300d7ae96f req-20f8d55e-82e8-4e0c-9092-66e68faa31bf service nova] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Received event network-vif-plugged-8e9606b7-8bbe-47bc-87ac-03dd9f6fe085 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:34:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-31c8fbcf-565b-40fa-96d0-89300d7ae96f req-20f8d55e-82e8-4e0c-9092-66e68faa31bf service nova] Acquiring lock "6f2a94d6-c16f-4f1f-a627-66e0dddc1615-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:34:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-31c8fbcf-565b-40fa-96d0-89300d7ae96f req-20f8d55e-82e8-4e0c-9092-66e68faa31bf service nova] Lock "6f2a94d6-c16f-4f1f-a627-66e0dddc1615-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:34:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-31c8fbcf-565b-40fa-96d0-89300d7ae96f req-20f8d55e-82e8-4e0c-9092-66e68faa31bf service nova] Lock "6f2a94d6-c16f-4f1f-a627-66e0dddc1615-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:34:24 user nova-compute[74821]: DEBUG nova.compute.manager [req-31c8fbcf-565b-40fa-96d0-89300d7ae96f req-20f8d55e-82e8-4e0c-9092-66e68faa31bf service nova] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] No waiting events found dispatching network-vif-plugged-8e9606b7-8bbe-47bc-87ac-03dd9f6fe085 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:34:24 user nova-compute[74821]: WARNING nova.compute.manager [req-31c8fbcf-565b-40fa-96d0-89300d7ae96f req-20f8d55e-82e8-4e0c-9092-66e68faa31bf service nova] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Received unexpected event network-vif-plugged-8e9606b7-8bbe-47bc-87ac-03dd9f6fe085 for instance with vm_state deleted and task_state None.
Nov 06 13:34:24 user nova-compute[74821]: DEBUG nova.compute.manager [req-31c8fbcf-565b-40fa-96d0-89300d7ae96f req-20f8d55e-82e8-4e0c-9092-66e68faa31bf service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Received event network-changed-30866a49-b7d0-458d-87a6-e97d3c533640 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:34:24 user nova-compute[74821]: DEBUG nova.compute.manager [req-31c8fbcf-565b-40fa-96d0-89300d7ae96f req-20f8d55e-82e8-4e0c-9092-66e68faa31bf service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Refreshing instance network info cache due to event network-changed-30866a49-b7d0-458d-87a6-e97d3c533640. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:34:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-31c8fbcf-565b-40fa-96d0-89300d7ae96f req-20f8d55e-82e8-4e0c-9092-66e68faa31bf service nova] Acquiring lock "refresh_cache-8467fdc8-ec8e-4eda-abbc-b146e58e90c8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:34:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-31c8fbcf-565b-40fa-96d0-89300d7ae96f req-20f8d55e-82e8-4e0c-9092-66e68faa31bf service nova] Acquired lock "refresh_cache-8467fdc8-ec8e-4eda-abbc-b146e58e90c8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:34:24 user nova-compute[74821]: DEBUG nova.network.neutron [req-31c8fbcf-565b-40fa-96d0-89300d7ae96f req-20f8d55e-82e8-4e0c-9092-66e68faa31bf service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Refreshing network info cache for port 30866a49-b7d0-458d-87a6-e97d3c533640 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:34:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:25 user nova-compute[74821]: DEBUG nova.network.neutron [req-31c8fbcf-565b-40fa-96d0-89300d7ae96f req-20f8d55e-82e8-4e0c-9092-66e68faa31bf service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Updated VIF entry in instance network info cache for port 30866a49-b7d0-458d-87a6-e97d3c533640. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:34:25 user nova-compute[74821]: DEBUG nova.network.neutron [req-31c8fbcf-565b-40fa-96d0-89300d7ae96f req-20f8d55e-82e8-4e0c-9092-66e68faa31bf service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Updating instance_info_cache with network_info: [{"id": "30866a49-b7d0-458d-87a6-e97d3c533640", "address": "fa:16:3e:7c:2c:c7", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30866a49-b7", "ovs_interfaceid": "30866a49-b7d0-458d-87a6-e97d3c533640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:34:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-31c8fbcf-565b-40fa-96d0-89300d7ae96f req-20f8d55e-82e8-4e0c-9092-66e68faa31bf service nova] Releasing lock "refresh_cache-8467fdc8-ec8e-4eda-abbc-b146e58e90c8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:34:25 user nova-compute[74821]: DEBUG nova.compute.manager [req-31c8fbcf-565b-40fa-96d0-89300d7ae96f req-20f8d55e-82e8-4e0c-9092-66e68faa31bf service nova] [instance: 6f2a94d6-c16f-4f1f-a627-66e0dddc1615] Received event network-vif-deleted-8e9606b7-8bbe-47bc-87ac-03dd9f6fe085 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:34:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:34:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:34:35 user nova-compute[74821]: INFO nova.compute.manager [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Rebooting instance
Nov 06 13:34:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "refresh_cache-8467fdc8-ec8e-4eda-abbc-b146e58e90c8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:34:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquired lock "refresh_cache-8467fdc8-ec8e-4eda-abbc-b146e58e90c8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:34:35 user nova-compute[74821]: DEBUG nova.network.neutron [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:34:36 user nova-compute[74821]: DEBUG nova.network.neutron [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Updating instance_info_cache with network_info: [{"id": "30866a49-b7d0-458d-87a6-e97d3c533640", "address": "fa:16:3e:7c:2c:c7", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30866a49-b7", "ovs_interfaceid": "30866a49-b7d0-458d-87a6-e97d3c533640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:34:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Releasing lock "refresh_cache-8467fdc8-ec8e-4eda-abbc-b146e58e90c8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:34:36 user nova-compute[74821]: DEBUG nova.compute.manager [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:34:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:36 user nova-compute[74821]: DEBUG nova.compute.manager [req-89b7901b-9863-41ac-8e1f-585f46c0c2af req-7c14fe74-d199-4ff3-a9b8-8803d41ff147 service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Received event network-vif-unplugged-30866a49-b7d0-458d-87a6-e97d3c533640 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:34:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-89b7901b-9863-41ac-8e1f-585f46c0c2af req-7c14fe74-d199-4ff3-a9b8-8803d41ff147 service nova] Acquiring lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:34:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-89b7901b-9863-41ac-8e1f-585f46c0c2af req-7c14fe74-d199-4ff3-a9b8-8803d41ff147 service nova] Lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:34:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-89b7901b-9863-41ac-8e1f-585f46c0c2af req-7c14fe74-d199-4ff3-a9b8-8803d41ff147 service nova] Lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:34:36 user nova-compute[74821]: DEBUG nova.compute.manager [req-89b7901b-9863-41ac-8e1f-585f46c0c2af req-7c14fe74-d199-4ff3-a9b8-8803d41ff147 service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] No waiting events found dispatching network-vif-unplugged-30866a49-b7d0-458d-87a6-e97d3c533640 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:34:36 user nova-compute[74821]: WARNING nova.compute.manager [req-89b7901b-9863-41ac-8e1f-585f46c0c2af req-7c14fe74-d199-4ff3-a9b8-8803d41ff147 service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Received unexpected event network-vif-unplugged-30866a49-b7d0-458d-87a6-e97d3c533640 for instance with vm_state active and task_state reboot_started_hard.
Nov 06 13:34:37 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Instance destroyed successfully.
Nov 06 13:34:37 user nova-compute[74821]: DEBUG nova.objects.instance [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lazy-loading 'resources' on Instance uuid 8467fdc8-ec8e-4eda-abbc-b146e58e90c8 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:31:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1664915128',display_name='tempest-TestMinimumBasicScenario-server-1664915128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1664915128',id=39,image_ref='149fc74a-1ade-4b08-9498-88510804c090',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPC/WyWwJ1mdb7Q1HCFQa68dEwI0XyfAWMaXm4AvxqK0uA59dwuMN3WSFpUeeufZrkTJoJN71RO50MRXJvZqvtDVtE16HLEjQ928R5bTilrQQ7UOiHqmsqTXF4fpZzdNYA==',key_name='tempest-TestMinimumBasicScenario-2075493504',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:31:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2772db4aac63412fb8cfe945c89f7156',ramdisk_id='',reservation_id='r-dh6uy30j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='149fc74a-1ade-4b08-9498-88510804c090',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1779731878',owner_user_name='tempest-TestMinimumBasicScenario-1779731878-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:34:36Z,user_data=None,user_id='19e457098f3242979db3fc25390965a4',uuid=8467fdc8-ec8e-4eda-abbc-b146e58e90c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30866a49-b7d0-458d-87a6-e97d3c533640", "address": "fa:16:3e:7c:2c:c7", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30866a49-b7", "ovs_interfaceid": "30866a49-b7d0-458d-87a6-e97d3c533640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Converting VIF {"id": "30866a49-b7d0-458d-87a6-e97d3c533640", "address": "fa:16:3e:7c:2c:c7", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30866a49-b7", "ovs_interfaceid": "30866a49-b7d0-458d-87a6-e97d3c533640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:2c:c7,bridge_name='br-int',has_traffic_filtering=True,id=30866a49-b7d0-458d-87a6-e97d3c533640,network=Network(57870f63-b015-4453-ae32-18f642d7c4b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30866a49-b7') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG os_vif [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:2c:c7,bridge_name='br-int',has_traffic_filtering=True,id=30866a49-b7d0-458d-87a6-e97d3c533640,network=Network(57870f63-b015-4453-ae32-18f642d7c4b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30866a49-b7') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30866a49-b7, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6bf209af-8e19-4fcb-9abe-df46a0850b08) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:37 user nova-compute[74821]: INFO os_vif [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:2c:c7,bridge_name='br-int',has_traffic_filtering=True,id=30866a49-b7d0-458d-87a6-e97d3c533640,network=Network(57870f63-b015-4453-ae32-18f642d7c4b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30866a49-b7')
Nov 06 13:34:37 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RvCcYpqK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:34:37 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:34:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[406434de-36e5-4649-afab-cda09a69b790]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:34:37 user nova-compute[74821]: No targets found.
Nov 06 13:34:37 user nova-compute[74821]: iSNS:
Nov 06 13:34:37 user nova-compute[74821]: No targets found.
Nov 06 13:34:37 user nova-compute[74821]: STATIC:
Nov 06 13:34:37 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604
Nov 06 13:34:37 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:34:37 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:34:37 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82
Nov 06 13:34:37 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:34:37 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:34:37 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13
Nov 06 13:34:37 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:34:37 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:34:37 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f
Nov 06 13:34:37 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:34:37 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:34:37 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979
Nov 06 13:34:37 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:34:37 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:34:37 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6
Nov 06 13:34:37 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:34:37 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:34:37 user nova-compute[74821]: FIRMWARE:
Nov 06 13:34:37 user nova-compute[74821]: No targets found.
Nov 06 13:34:37 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:34:37 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:34:37 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30a4c2b-1f1c-4e93-aa66-c6a7dba384a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0211c78b-b2a8-4453-83f5-d7fec73336a3]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:34:37 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:34:37 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:34:37 user nova-compute[74821]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)
Nov 06 13:34:37 user nova-compute[74821]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)
Nov 06 13:34:37 user nova-compute[74821]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 (non-flash)
Nov 06 13:34:37 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:34:37 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:34:37 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:34:37 user nova-compute[74821]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)
Nov 06 13:34:37 user nova-compute[74821]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)
Nov 06 13:34:37 user nova-compute[74821]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 (non-flash)
Nov 06 13:34:37 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e50331000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13'): ({'sdg'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Removing single pathed devices sdg {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1bf2cc-cfb6-4f07-aa40-d3a6b4f270ac]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfdd425-4fdd-44b0-96ed-1a305d7fd5fc]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Flushing IO for device /dev/sdg {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca67eba9-6f7e-436f-b9f9-7acd7f06188d]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.048s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[72694d10-6ea2-423c-bc51-479e81f9fb82]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] SCSI volumes sdg have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fb4e26-b599-458a-8a14-8f88a8c5ee3f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b8319f-84ec-4f7d-8274-af48a3089ad1]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13, portal: 172.16.0.220,3260]
Nov 06 13:34:37 user nova-compute[74821]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13, portal: 172.16.0.220,3260] successful.
Nov 06 13:34:37 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b20683-2dce-4c6d-8137-585fb5587754]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] <== disconnect_volume: return (342ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Start _get_guest_xml network_info=[{"id": "30866a49-b7d0-458d-87a6-e97d3c533640", "address": "fa:16:3e:7c:2c:c7", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30866a49-b7", "ovs_interfaceid": "30866a49-b7d0-458d-87a6-e97d3c533640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=149fc74a-1ade-4b08-9498-88510804c090,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '149fc74a-1ade-4b08-9498-88510804c090'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RvCcYpqK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '8467fdc8-ec8e-4eda-abbc-b146e58e90c8', 'attached_at': '', 'detached_at': '', 'volume_id': 'c298ae62-e2a0-49f4-a980-e7a04a9b6c13', 'serial': 'c298ae62-e2a0-49f4-a980-e7a04a9b6c13'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '52b73667-386b-4776-9045-26c49ef16782', 'volume_type': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:34:37 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:34:37 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:34:37 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=149fc74a-1ade-4b08-9498-88510804c090,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG nova.objects.instance [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8467fdc8-ec8e-4eda-abbc-b146e58e90c8 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG nova.objects.base [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Object Instance<8467fdc8-ec8e-4eda-abbc-b146e58e90c8> lazy-loaded attributes: resources,vcpu_model {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RvCcYpqK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:34:37 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:34:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:34:37 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:34:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:34:37 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[680dae0c-364d-44e2-9f93-f964bbb6d304]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:34:37 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[592f52a3-95ce-46ef-b079-b12ef2a62699]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13] added
Nov 06 13:34:37 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5a63c7-148b-4402-84b8-57816242242d]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0806a0e4-5b87-46b4-b368-4351d7e61b1a]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RvCcYpqK {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RvCcYpqK" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5919f906-0aeb-4367-8d80-4a7b9134c0ba]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RvCcYpqK'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c36435f-f960-4121-b9fb-d4756049f546]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87a8447-9e16-4897-ba36-6d45c74b1e43]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:34:37 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:34:37 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:34:37 user nova-compute[74821]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)
Nov 06 13:34:37 user nova-compute[74821]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)
Nov 06 13:34:37 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:34:37 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:34:37 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:34:37 user nova-compute[74821]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)
Nov 06 13:34:37 user nova-compute[74821]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)
Nov 06 13:34:37 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[040b9c78-3df7-4ea8-aac2-2f79a249545c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13, portal: 172.16.0.220,3260]
Nov 06 13:34:37 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13, portal: 172.16.0.220,3260] successful.
Nov 06 13:34:37 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd7688b-a0cd-423d-9a83-278570628c50]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:34:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:38 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[978109ec-0346-428e-be61-3ce252ce69bb]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:38 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:34:38 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:34:38 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:34:38 user nova-compute[74821]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)
Nov 06 13:34:38 user nova-compute[74821]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)
Nov 06 13:34:38 user nova-compute[74821]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 (non-flash)
Nov 06 13:34:38 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:34:38 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:34:38 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:34:38 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:34:38 user nova-compute[74821]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)
Nov 06 13:34:38 user nova-compute[74821]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)
Nov 06 13:34:38 user nova-compute[74821]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 (non-flash)
Nov 06 13:34:38 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:34:38 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:34:38 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:34:38 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] HCTL ('38', '-', '-', 0) found on session 39 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:34:38 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:34:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:38 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[963fe7fc-971f-4f69-bf44-b12f7e09bb25]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:38 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Searching for a device in session 39 and hctl ['38', '*', '*', 0] yield: None {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:34:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "6121ff1a-d276-485f-85f8-ba451f5b0d37" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:34:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "6121ff1a-d276-485f-85f8-ba451f5b0d37" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:34:38 user nova-compute[74821]: INFO nova.compute.manager [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Detaching volume 379ea2b9-c5af-4652-a630-572a70b50b82
Nov 06 13:34:38 user nova-compute[74821]: INFO nova.virt.block_device [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Attempting to driver detach volume 379ea2b9-c5af-4652-a630-572a70b50b82 from mountpoint /dev/vdb
Nov 06 13:34:38 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Attempting to detach device vdb from instance 6121ff1a-d276-485f-85f8-ba451f5b0d37 from the persistent domain config. {{(pid=74821) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 13:34:38 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:34:38 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:34:38 user nova-compute[74821]:   <source dev="/dev/sdf"/>
Nov 06 13:34:38 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:34:38 user nova-compute[74821]:   <serial>379ea2b9-c5af-4652-a630-572a70b50b82</serial>
Nov 06 13:34:38 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:34:38 user nova-compute[74821]: </disk>
Nov 06 13:34:38 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:34:38 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Successfully detached device vdb from instance 6121ff1a-d276-485f-85f8-ba451f5b0d37 from the persistent domain config.
Nov 06 13:34:38 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6121ff1a-d276-485f-85f8-ba451f5b0d37 from the live domain config. {{(pid=74821) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 13:34:38 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:34:38 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:34:38 user nova-compute[74821]:   <source dev="/dev/sdf"/>
Nov 06 13:34:38 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:34:38 user nova-compute[74821]:   <serial>379ea2b9-c5af-4652-a630-572a70b50b82</serial>
Nov 06 13:34:38 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:34:38 user nova-compute[74821]: </disk>
Nov 06 13:34:38 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:34:38 user nova-compute[74821]: DEBUG nova.compute.manager [req-57256ff5-4e3c-4fc5-9190-2741031a3f0c req-6f0bd5b3-74fb-4888-b0b0-05de600430e6 service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Received event network-vif-plugged-30866a49-b7d0-458d-87a6-e97d3c533640 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:34:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-57256ff5-4e3c-4fc5-9190-2741031a3f0c req-6f0bd5b3-74fb-4888-b0b0-05de600430e6 service nova] Acquiring lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:34:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-57256ff5-4e3c-4fc5-9190-2741031a3f0c req-6f0bd5b3-74fb-4888-b0b0-05de600430e6 service nova] Lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:34:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-57256ff5-4e3c-4fc5-9190-2741031a3f0c req-6f0bd5b3-74fb-4888-b0b0-05de600430e6 service nova] Lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:34:38 user nova-compute[74821]: DEBUG nova.compute.manager [req-57256ff5-4e3c-4fc5-9190-2741031a3f0c req-6f0bd5b3-74fb-4888-b0b0-05de600430e6 service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] No waiting events found dispatching network-vif-plugged-30866a49-b7d0-458d-87a6-e97d3c533640 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:34:38 user nova-compute[74821]: WARNING nova.compute.manager [req-57256ff5-4e3c-4fc5-9190-2741031a3f0c req-6f0bd5b3-74fb-4888-b0b0-05de600430e6 service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Received unexpected event network-vif-plugged-30866a49-b7d0-458d-87a6-e97d3c533640 for instance with vm_state active and task_state reboot_started_hard.
Nov 06 13:34:38 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6121ff1a-d276-485f-85f8-ba451f5b0d37 {{(pid=74821) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Searching for a device in session 39 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RvCcYpqK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '26535633363643863', 'path': '/dev/sdg'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535633363643863', 'path': '/dev/sdg'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:31:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1664915128',display_name='tempest-TestMinimumBasicScenario-server-1664915128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1664915128',id=39,image_ref='149fc74a-1ade-4b08-9498-88510804c090',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPC/WyWwJ1mdb7Q1HCFQa68dEwI0XyfAWMaXm4AvxqK0uA59dwuMN3WSFpUeeufZrkTJoJN71RO50MRXJvZqvtDVtE16HLEjQ928R5bTilrQQ7UOiHqmsqTXF4fpZzdNYA==',key_name='tempest-TestMinimumBasicScenario-2075493504',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:31:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2772db4aac63412fb8cfe945c89f7156',ramdisk_id='',reservation_id='r-dh6uy30j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='149fc74a-1ade-4b08-9498-88510804c090',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1779731878',owner_user_name='tempest-TestMinimumBasicScenario-1779731878-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:34:36Z,user_data=None,user_id='19e457098f3242979db3fc25390965a4',uuid=8467fdc8-ec8e-4eda-abbc-b146e58e90c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30866a49-b7d0-458d-87a6-e97d3c533640", "address": "fa:16:3e:7c:2c:c7", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30866a49-b7", "ovs_interfaceid": "30866a49-b7d0-458d-87a6-e97d3c533640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Converting VIF {"id": "30866a49-b7d0-458d-87a6-e97d3c533640", "address": "fa:16:3e:7c:2c:c7", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30866a49-b7", "ovs_interfaceid": "30866a49-b7d0-458d-87a6-e97d3c533640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:2c:c7,bridge_name='br-int',has_traffic_filtering=True,id=30866a49-b7d0-458d-87a6-e97d3c533640,network=Network(57870f63-b015-4453-ae32-18f642d7c4b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30866a49-b7') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG nova.objects.instance [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lazy-loading 'pci_devices' on Instance uuid 8467fdc8-ec8e-4eda-abbc-b146e58e90c8 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG nova.objects.base [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Object Instance<8467fdc8-ec8e-4eda-abbc-b146e58e90c8> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:34:39 user nova-compute[74821]:   <uuid>8467fdc8-ec8e-4eda-abbc-b146e58e90c8</uuid>
Nov 06 13:34:39 user nova-compute[74821]:   <name>instance-00000027</name>
Nov 06 13:34:39 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:34:39 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:34:39 user nova-compute[74821]:   <metadata>
Nov 06 13:34:39 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:34:39 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:34:39 user nova-compute[74821]:       <nova:name>tempest-TestMinimumBasicScenario-server-1664915128</nova:name>
Nov 06 13:34:39 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:34:37</nova:creationTime>
Nov 06 13:34:39 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:34:39 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:34:39 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:34:39 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:34:39 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:34:39 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:34:39 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:34:39 user nova-compute[74821]:       <nova:owner>
Nov 06 13:34:39 user nova-compute[74821]:         <nova:user uuid="19e457098f3242979db3fc25390965a4">tempest-TestMinimumBasicScenario-1779731878-project-member</nova:user>
Nov 06 13:34:39 user nova-compute[74821]:         <nova:project uuid="2772db4aac63412fb8cfe945c89f7156">tempest-TestMinimumBasicScenario-1779731878</nova:project>
Nov 06 13:34:39 user nova-compute[74821]:       </nova:owner>
Nov 06 13:34:39 user nova-compute[74821]:       <nova:root type="image" uuid="149fc74a-1ade-4b08-9498-88510804c090"/>
Nov 06 13:34:39 user nova-compute[74821]:       <nova:ports>
Nov 06 13:34:39 user nova-compute[74821]:         <nova:port uuid="30866a49-b7d0-458d-87a6-e97d3c533640">
Nov 06 13:34:39 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 06 13:34:39 user nova-compute[74821]:         </nova:port>
Nov 06 13:34:39 user nova-compute[74821]:       </nova:ports>
Nov 06 13:34:39 user nova-compute[74821]:     </nova:instance>
Nov 06 13:34:39 user nova-compute[74821]:   </metadata>
Nov 06 13:34:39 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:34:39 user nova-compute[74821]:     <system>
Nov 06 13:34:39 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:34:39 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:34:39 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:34:39 user nova-compute[74821]:       <entry name="serial">8467fdc8-ec8e-4eda-abbc-b146e58e90c8</entry>
Nov 06 13:34:39 user nova-compute[74821]:       <entry name="uuid">8467fdc8-ec8e-4eda-abbc-b146e58e90c8</entry>
Nov 06 13:34:39 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:34:39 user nova-compute[74821]:     </system>
Nov 06 13:34:39 user nova-compute[74821]:   </sysinfo>
Nov 06 13:34:39 user nova-compute[74821]:   <os>
Nov 06 13:34:39 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:34:39 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:34:39 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:34:39 user nova-compute[74821]:   </os>
Nov 06 13:34:39 user nova-compute[74821]:   <features>
Nov 06 13:34:39 user nova-compute[74821]:     <acpi/>
Nov 06 13:34:39 user nova-compute[74821]:     <apic/>
Nov 06 13:34:39 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:34:39 user nova-compute[74821]:   </features>
Nov 06 13:34:39 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:34:39 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:34:39 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:34:39 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:34:39 user nova-compute[74821]:   </clock>
Nov 06 13:34:39 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:34:39 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:34:39 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:34:39 user nova-compute[74821]:   </cpu>
Nov 06 13:34:39 user nova-compute[74821]:   <devices>
Nov 06 13:34:39 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:34:39 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:34:39 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk"/>
Nov 06 13:34:39 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:34:39 user nova-compute[74821]:     </disk>
Nov 06 13:34:39 user nova-compute[74821]:     <disk type="block" device="disk">
Nov 06 13:34:39 user nova-compute[74821]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:34:39 user nova-compute[74821]:       <source dev="/dev/sdg"/>
Nov 06 13:34:39 user nova-compute[74821]:       <target dev="vdb" bus="virtio"/>
Nov 06 13:34:39 user nova-compute[74821]:       <serial>c298ae62-e2a0-49f4-a980-e7a04a9b6c13</serial>
Nov 06 13:34:39 user nova-compute[74821]:     </disk>
Nov 06 13:34:39 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:34:39 user nova-compute[74821]:       <mac address="fa:16:3e:7c:2c:c7"/>
Nov 06 13:34:39 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:34:39 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:34:39 user nova-compute[74821]:       <target dev="tap30866a49-b7"/>
Nov 06 13:34:39 user nova-compute[74821]:     </interface>
Nov 06 13:34:39 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:34:39 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/console.log" append="off"/>
Nov 06 13:34:39 user nova-compute[74821]:     </serial>
Nov 06 13:34:39 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:34:39 user nova-compute[74821]:     <video>
Nov 06 13:34:39 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:34:39 user nova-compute[74821]:     </video>
Nov 06 13:34:39 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:34:39 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:34:39 user nova-compute[74821]:     </rng>
Nov 06 13:34:39 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:34:39 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:34:39 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:34:39 user nova-compute[74821]:     </memballoon>
Nov 06 13:34:39 user nova-compute[74821]:   </devices>
Nov 06 13:34:39 user nova-compute[74821]: </domain>
Nov 06 13:34:39 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG nova.objects.instance [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8467fdc8-ec8e-4eda-abbc-b146e58e90c8 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG nova.objects.base [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Object Instance<8467fdc8-ec8e-4eda-abbc-b146e58e90c8> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2168b23d5cf1db6819fd7454256e109af9aabb92 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2168b23d5cf1db6819fd7454256e109af9aabb92 --force-share --output=json" returned: 0 in 0.175s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG nova.compute.manager [req-47922bdd-e820-4022-a73e-b81b40023fab req-e9ca0c33-7fa1-4084-926b-f2eae9c5ea43 service nova] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Received event network-changed-b317cb51-20ab-4f25-b3de-4c2981a97993 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG nova.compute.manager [req-47922bdd-e820-4022-a73e-b81b40023fab req-e9ca0c33-7fa1-4084-926b-f2eae9c5ea43 service nova] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Refreshing instance network info cache due to event network-changed-b317cb51-20ab-4f25-b3de-4c2981a97993. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-47922bdd-e820-4022-a73e-b81b40023fab req-e9ca0c33-7fa1-4084-926b-f2eae9c5ea43 service nova] Acquiring lock "refresh_cache-4bc6444e-b55d-4d81-88d1-f4d147255119" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-47922bdd-e820-4022-a73e-b81b40023fab req-e9ca0c33-7fa1-4084-926b-f2eae9c5ea43 service nova] Acquired lock "refresh_cache-4bc6444e-b55d-4d81-88d1-f4d147255119" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG nova.network.neutron [req-47922bdd-e820-4022-a73e-b81b40023fab req-e9ca0c33-7fa1-4084-926b-f2eae9c5ea43 service nova] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Refreshing network info cache for port b317cb51-20ab-4f25-b3de-4c2981a97993 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Cannot resize image /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG nova.objects.instance [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lazy-loading 'migration_context' on Instance uuid 8467fdc8-ec8e-4eda-abbc-b146e58e90c8 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG nova.objects.base [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Object Instance<8467fdc8-ec8e-4eda-abbc-b146e58e90c8> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:31:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1664915128',display_name='tempest-TestMinimumBasicScenario-server-1664915128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1664915128',id=39,image_ref='149fc74a-1ade-4b08-9498-88510804c090',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPC/WyWwJ1mdb7Q1HCFQa68dEwI0XyfAWMaXm4AvxqK0uA59dwuMN3WSFpUeeufZrkTJoJN71RO50MRXJvZqvtDVtE16HLEjQ928R5bTilrQQ7UOiHqmsqTXF4fpZzdNYA==',key_name='tempest-TestMinimumBasicScenario-2075493504',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:31:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='2772db4aac63412fb8cfe945c89f7156',ramdisk_id='',reservation_id='r-dh6uy30j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='149fc74a-1ade-4b08-9498-88510804c090',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1779731878',owner_user_name='tempest-TestMinimumBasicScenario-1779731878-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:34:36Z,user_data=None,user_id='19e457098f3242979db3fc25390965a4',uuid=8467fdc8-ec8e-4eda-abbc-b146e58e90c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30866a49-b7d0-458d-87a6-e97d3c533640", "address": "fa:16:3e:7c:2c:c7", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30866a49-b7", "ovs_interfaceid": "30866a49-b7d0-458d-87a6-e97d3c533640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Converting VIF {"id": "30866a49-b7d0-458d-87a6-e97d3c533640", "address": "fa:16:3e:7c:2c:c7", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30866a49-b7", "ovs_interfaceid": "30866a49-b7d0-458d-87a6-e97d3c533640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:2c:c7,bridge_name='br-int',has_traffic_filtering=True,id=30866a49-b7d0-458d-87a6-e97d3c533640,network=Network(57870f63-b015-4453-ae32-18f642d7c4b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30866a49-b7') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG os_vif [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:2c:c7,bridge_name='br-int',has_traffic_filtering=True,id=30866a49-b7d0-458d-87a6-e97d3c533640,network=Network(57870f63-b015-4453-ae32-18f642d7c4b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30866a49-b7') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '02eb8c5b-6ecc-50be-9708-8eaf4a2109bf', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3f6692fe-a275-476e-bd51-e7ca57101752 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Acquiring lock "4bc6444e-b55d-4d81-88d1-f4d147255119" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3f6692fe-a275-476e-bd51-e7ca57101752 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "4bc6444e-b55d-4d81-88d1-f4d147255119" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3f6692fe-a275-476e-bd51-e7ca57101752 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Acquiring lock "4bc6444e-b55d-4d81-88d1-f4d147255119-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3f6692fe-a275-476e-bd51-e7ca57101752 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "4bc6444e-b55d-4d81-88d1-f4d147255119-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3f6692fe-a275-476e-bd51-e7ca57101752 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "4bc6444e-b55d-4d81-88d1-f4d147255119-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:34:39 user nova-compute[74821]: INFO nova.compute.manager [None req-3f6692fe-a275-476e-bd51-e7ca57101752 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Terminating instance
Nov 06 13:34:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG nova.compute.manager [None req-3f6692fe-a275-476e-bd51-e7ca57101752 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30866a49-b7, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap30866a49-b7, col_values=(('qos', UUID('2cf0bac5-8dc3-4708-b4df-5d02fb69e5e6')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap30866a49-b7, col_values=(('external_ids', {'iface-id': '30866a49-b7d0-458d-87a6-e97d3c533640', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:2c:c7', 'vm-uuid': '8467fdc8-ec8e-4eda-abbc-b146e58e90c8'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:39 user nova-compute[74821]: INFO os_vif [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:2c:c7,bridge_name='br-int',has_traffic_filtering=True,id=30866a49-b7d0-458d-87a6-e97d3c533640,network=Network(57870f63-b015-4453-ae32-18f642d7c4b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30866a49-b7')
Nov 06 13:34:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:40 user nova-compute[74821]: DEBUG nova.network.neutron [req-47922bdd-e820-4022-a73e-b81b40023fab req-e9ca0c33-7fa1-4084-926b-f2eae9c5ea43 service nova] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Updated VIF entry in instance network info cache for port b317cb51-20ab-4f25-b3de-4c2981a97993. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:34:40 user nova-compute[74821]: DEBUG nova.network.neutron [req-47922bdd-e820-4022-a73e-b81b40023fab req-e9ca0c33-7fa1-4084-926b-f2eae9c5ea43 service nova] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Updating instance_info_cache with network_info: [{"id": "b317cb51-20ab-4f25-b3de-4c2981a97993", "address": "fa:16:3e:28:c0:6e", "network": {"id": "5e673907-9763-4136-845d-b3154200d004", "bridge": "br-int", "label": "tempest-TestStampPattern-539864653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608cf017c43942a4a94982b1d5d4d2b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb317cb51-20", "ovs_interfaceid": "b317cb51-20ab-4f25-b3de-4c2981a97993", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:34:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-47922bdd-e820-4022-a73e-b81b40023fab req-e9ca0c33-7fa1-4084-926b-f2eae9c5ea43 service nova] Releasing lock "refresh_cache-4bc6444e-b55d-4d81-88d1-f4d147255119" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:34:41 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Instance destroyed successfully.
Nov 06 13:34:41 user nova-compute[74821]: DEBUG nova.objects.instance [None req-3f6692fe-a275-476e-bd51-e7ca57101752 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lazy-loading 'resources' on Instance uuid 4bc6444e-b55d-4d81-88d1-f4d147255119 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-3f6692fe-a275-476e-bd51-e7ca57101752 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:26:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-123752075',display_name='tempest-TestStampPattern-server-123752075',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-123752075',id=31,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHT6BbspfsGKU4w7+rfCb2XbPvdRdiCIBLtNBrG2m7ivVKQnsl1fkuukzo4FgDo5nmrAQDc2oBOGBF9X5srYArFAUxnzu0ECbQ5DvrtDTtn/zmxbYwAAp1N2mi6fR8VQRQ==',key_name='tempest-TestStampPattern-1150007784',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:26:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='608cf017c43942a4a94982b1d5d4d2b9',ramdisk_id='',reservation_id='r-f8sf1s9g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1706680780',owner_user_name='tempest-TestStampPattern-1706680780-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:30:07Z,user_data=None,user_id='188b10f8df7848288e07c92dd9a33597',uuid=4bc6444e-b55d-4d81-88d1-f4d147255119,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b317cb51-20ab-4f25-b3de-4c2981a97993", "address": "fa:16:3e:28:c0:6e", "network": {"id": "5e673907-9763-4136-845d-b3154200d004", "bridge": "br-int", "label": "tempest-TestStampPattern-539864653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608cf017c43942a4a94982b1d5d4d2b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb317cb51-20", "ovs_interfaceid": "b317cb51-20ab-4f25-b3de-4c2981a97993", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-3f6692fe-a275-476e-bd51-e7ca57101752 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Converting VIF {"id": "b317cb51-20ab-4f25-b3de-4c2981a97993", "address": "fa:16:3e:28:c0:6e", "network": {"id": "5e673907-9763-4136-845d-b3154200d004", "bridge": "br-int", "label": "tempest-TestStampPattern-539864653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "608cf017c43942a4a94982b1d5d4d2b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb317cb51-20", "ovs_interfaceid": "b317cb51-20ab-4f25-b3de-4c2981a97993", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-3f6692fe-a275-476e-bd51-e7ca57101752 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:c0:6e,bridge_name='br-int',has_traffic_filtering=True,id=b317cb51-20ab-4f25-b3de-4c2981a97993,network=Network(5e673907-9763-4136-845d-b3154200d004),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb317cb51-20') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG os_vif [None req-3f6692fe-a275-476e-bd51-e7ca57101752 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:c0:6e,bridge_name='br-int',has_traffic_filtering=True,id=b317cb51-20ab-4f25-b3de-4c2981a97993,network=Network(5e673907-9763-4136-845d-b3154200d004),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb317cb51-20') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb317cb51-20, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ae559ee2-87fc-48dd-a1db-4d45b141e8fa) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:41 user nova-compute[74821]: INFO os_vif [None req-3f6692fe-a275-476e-bd51-e7ca57101752 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:c0:6e,bridge_name='br-int',has_traffic_filtering=True,id=b317cb51-20ab-4f25-b3de-4c2981a97993,network=Network(5e673907-9763-4136-845d-b3154200d004),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb317cb51-20')
Nov 06 13:34:41 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-3f6692fe-a275-476e-bd51-e7ca57101752 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Deleting instance files /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119_del
Nov 06 13:34:41 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-3f6692fe-a275-476e-bd51-e7ca57101752 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Deletion of /opt/stack/data/nova/instances/4bc6444e-b55d-4d81-88d1-f4d147255119_del complete
Nov 06 13:34:41 user nova-compute[74821]: INFO nova.compute.manager [None req-3f6692fe-a275-476e-bd51-e7ca57101752 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Took 1.45 seconds to destroy the instance on the hypervisor.
Nov 06 13:34:41 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-3f6692fe-a275-476e-bd51-e7ca57101752 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:34:41 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Took 0.46 seconds to deallocate network for instance.
Nov 06 13:34:41 user nova-compute[74821]: DEBUG nova.compute.manager [req-6669735a-756b-4b82-a58b-f2e27c7c31d6 req-bad7e1ce-4a73-43d4-ac96-c06f84018767 service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Received event network-vif-plugged-30866a49-b7d0-458d-87a6-e97d3c533640 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6669735a-756b-4b82-a58b-f2e27c7c31d6 req-bad7e1ce-4a73-43d4-ac96-c06f84018767 service nova] Acquiring lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6669735a-756b-4b82-a58b-f2e27c7c31d6 req-bad7e1ce-4a73-43d4-ac96-c06f84018767 service nova] Lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6669735a-756b-4b82-a58b-f2e27c7c31d6 req-bad7e1ce-4a73-43d4-ac96-c06f84018767 service nova] Lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG nova.compute.manager [req-6669735a-756b-4b82-a58b-f2e27c7c31d6 req-bad7e1ce-4a73-43d4-ac96-c06f84018767 service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] No waiting events found dispatching network-vif-plugged-30866a49-b7d0-458d-87a6-e97d3c533640 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:34:41 user nova-compute[74821]: WARNING nova.compute.manager [req-6669735a-756b-4b82-a58b-f2e27c7c31d6 req-bad7e1ce-4a73-43d4-ac96-c06f84018767 service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Received unexpected event network-vif-plugged-30866a49-b7d0-458d-87a6-e97d3c533640 for instance with vm_state active and task_state reboot_started_hard.
Nov 06 13:34:41 user nova-compute[74821]: DEBUG nova.compute.manager [req-4e8464ce-6f89-4885-a41a-5e1184cf741f req-02fcde22-1927-4557-babf-8335a0611c3b service nova] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Received event network-vif-deleted-b317cb51-20ab-4f25-b3de-4c2981a97993 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG nova.compute.manager [req-4b38ae0e-445d-4b14-bcf5-e2fdf20e2230 req-a412930d-eafc-4d40-825f-a0a4934e26d7 service nova] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Received event network-vif-unplugged-b317cb51-20ab-4f25-b3de-4c2981a97993 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4b38ae0e-445d-4b14-bcf5-e2fdf20e2230 req-a412930d-eafc-4d40-825f-a0a4934e26d7 service nova] Acquiring lock "4bc6444e-b55d-4d81-88d1-f4d147255119-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4b38ae0e-445d-4b14-bcf5-e2fdf20e2230 req-a412930d-eafc-4d40-825f-a0a4934e26d7 service nova] Lock "4bc6444e-b55d-4d81-88d1-f4d147255119-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4b38ae0e-445d-4b14-bcf5-e2fdf20e2230 req-a412930d-eafc-4d40-825f-a0a4934e26d7 service nova] Lock "4bc6444e-b55d-4d81-88d1-f4d147255119-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG nova.compute.manager [req-4b38ae0e-445d-4b14-bcf5-e2fdf20e2230 req-a412930d-eafc-4d40-825f-a0a4934e26d7 service nova] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] No waiting events found dispatching network-vif-unplugged-b317cb51-20ab-4f25-b3de-4c2981a97993 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG nova.compute.manager [req-4b38ae0e-445d-4b14-bcf5-e2fdf20e2230 req-a412930d-eafc-4d40-825f-a0a4934e26d7 service nova] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Received event network-vif-unplugged-b317cb51-20ab-4f25-b3de-4c2981a97993 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG nova.compute.manager [req-4b38ae0e-445d-4b14-bcf5-e2fdf20e2230 req-a412930d-eafc-4d40-825f-a0a4934e26d7 service nova] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Received event network-vif-plugged-b317cb51-20ab-4f25-b3de-4c2981a97993 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4b38ae0e-445d-4b14-bcf5-e2fdf20e2230 req-a412930d-eafc-4d40-825f-a0a4934e26d7 service nova] Acquiring lock "4bc6444e-b55d-4d81-88d1-f4d147255119-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4b38ae0e-445d-4b14-bcf5-e2fdf20e2230 req-a412930d-eafc-4d40-825f-a0a4934e26d7 service nova] Lock "4bc6444e-b55d-4d81-88d1-f4d147255119-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-4b38ae0e-445d-4b14-bcf5-e2fdf20e2230 req-a412930d-eafc-4d40-825f-a0a4934e26d7 service nova] Lock "4bc6444e-b55d-4d81-88d1-f4d147255119-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG nova.compute.manager [req-4b38ae0e-445d-4b14-bcf5-e2fdf20e2230 req-a412930d-eafc-4d40-825f-a0a4934e26d7 service nova] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] No waiting events found dispatching network-vif-plugged-b317cb51-20ab-4f25-b3de-4c2981a97993 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:34:41 user nova-compute[74821]: WARNING nova.compute.manager [req-4b38ae0e-445d-4b14-bcf5-e2fdf20e2230 req-a412930d-eafc-4d40-825f-a0a4934e26d7 service nova] [instance: 4bc6444e-b55d-4d81-88d1-f4d147255119] Received unexpected event network-vif-plugged-b317cb51-20ab-4f25-b3de-4c2981a97993 for instance with vm_state active and task_state deleting.
Nov 06 13:34:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3f6692fe-a275-476e-bd51-e7ca57101752 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3f6692fe-a275-476e-bd51-e7ca57101752 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:34:41 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:34:42 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-3f6692fe-a275-476e-bd51-e7ca57101752 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:34:42 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-3f6692fe-a275-476e-bd51-e7ca57101752 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:34:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3f6692fe-a275-476e-bd51-e7ca57101752 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:34:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:42 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-3f6692fe-a275-476e-bd51-e7ca57101752 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Deleted allocations for instance 4bc6444e-b55d-4d81-88d1-f4d147255119
Nov 06 13:34:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3f6692fe-a275-476e-bd51-e7ca57101752 tempest-TestStampPattern-1706680780 tempest-TestStampPattern-1706680780-project-member] Lock "4bc6444e-b55d-4d81-88d1-f4d147255119" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.452s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:34:42 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:34:42 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:34:43 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Didn't find any instances for network info cache update. {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 13:34:43 user nova-compute[74821]: DEBUG nova.compute.manager [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:34:43 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Instance rebooted successfully.
Nov 06 13:34:43 user nova-compute[74821]: DEBUG nova.compute.manager [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:34:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-98a3ce23-f32f-47e6-aafc-4ad58fc5524e tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.194s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:34:43 user nova-compute[74821]: DEBUG nova.compute.manager [req-95bf9c78-4de7-4399-b3ad-740cf827dbb8 req-dee7cc34-1d7d-4fd5-a067-3e45dea5dcfe service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Received event network-vif-plugged-30866a49-b7d0-458d-87a6-e97d3c533640 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:34:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-95bf9c78-4de7-4399-b3ad-740cf827dbb8 req-dee7cc34-1d7d-4fd5-a067-3e45dea5dcfe service nova] Acquiring lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:34:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-95bf9c78-4de7-4399-b3ad-740cf827dbb8 req-dee7cc34-1d7d-4fd5-a067-3e45dea5dcfe service nova] Lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:34:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-95bf9c78-4de7-4399-b3ad-740cf827dbb8 req-dee7cc34-1d7d-4fd5-a067-3e45dea5dcfe service nova] Lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:34:43 user nova-compute[74821]: DEBUG nova.compute.manager [req-95bf9c78-4de7-4399-b3ad-740cf827dbb8 req-dee7cc34-1d7d-4fd5-a067-3e45dea5dcfe service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] No waiting events found dispatching network-vif-plugged-30866a49-b7d0-458d-87a6-e97d3c533640 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:34:43 user nova-compute[74821]: WARNING nova.compute.manager [req-95bf9c78-4de7-4399-b3ad-740cf827dbb8 req-dee7cc34-1d7d-4fd5-a067-3e45dea5dcfe service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Received unexpected event network-vif-plugged-30866a49-b7d0-458d-87a6-e97d3c533640 for instance with vm_state active and task_state None.
Nov 06 13:34:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:44 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:34:46 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:46 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:34:46 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:34:46 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:34:46 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:34:50 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:34:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:34:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:34:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:34:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:34:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:34:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:51 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:34:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:34:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:34:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:34:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:53 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:34:53 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:34:53 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:34:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=7787MB free_disk=24.86983871459961GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:34:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:34:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:34:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 2de346cb-9858-47b8-a86c-4fde720d6127 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:34:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 49c65aca-8392-46ba-8fa3-b47ff2416cb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:34:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 496f8213-4b32-4211-a354-e33a4a088848 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:34:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 1290bdb3-827f-4365-a4f1-4ae063de780d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:34:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 64ae6f5e-38a1-4871-8015-c2097f64b33b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:34:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 6121ff1a-d276-485f-85f8-ba451f5b0d37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:34:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:34:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 8467fdc8-ec8e-4eda-abbc-b146e58e90c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:34:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 2d8da345-f66d-45c2-8ccd-d22fdf79a14d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:34:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:34:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:34:54 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:34:54 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:34:54 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:34:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.485s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:34:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:34:56 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:34:56 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:34:58 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6121ff1a-d276-485f-85f8-ba451f5b0d37 is timed out.
Nov 06 13:34:58 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Successfully detached device vdb from instance 6121ff1a-d276-485f-85f8-ba451f5b0d37 from the live domain config.
Nov 06 13:34:58 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:34:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bKeMCAXj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:34:58 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:34:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:34:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:34:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:58 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ce0ed4-c0a5-434a-9369-37fe6c189945]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e10353f5-8ba3-4fee-ae99-ec94ce235bb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:34:58 user nova-compute[74821]: No targets found.
Nov 06 13:34:58 user nova-compute[74821]: iSNS:
Nov 06 13:34:58 user nova-compute[74821]: No targets found.
Nov 06 13:34:58 user nova-compute[74821]: STATIC:
Nov 06 13:34:58 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604
Nov 06 13:34:58 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:34:58 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:34:58 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82
Nov 06 13:34:58 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:34:58 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:34:58 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13
Nov 06 13:34:58 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:34:58 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:34:58 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f
Nov 06 13:34:58 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:34:58 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:34:58 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979
Nov 06 13:34:58 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:34:58 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:34:58 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6
Nov 06 13:34:58 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:34:58 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:34:58 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:e10353f5-8ba3-4fee-ae99-ec94ce235bb6
Nov 06 13:34:58 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:34:58 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:34:58 user nova-compute[74821]: FIRMWARE:
Nov 06 13:34:58 user nova-compute[74821]: No targets found.
Nov 06 13:34:58 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:34:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:34:58 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:34:58 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:34:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:34:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:58 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[26035539-5d9f-42b3-a1e2-f90eb57a33c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e10353f5-8ba3-4fee-ae99-ec94ce235bb6\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:58 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e020bfb3-0a54-4a86-850e-6b6e97ab4cae]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e10353f5-8ba3-4fee-ae99-ec94ce235bb6 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:34:58 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:34:58 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:34:58 user nova-compute[74821]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)
Nov 06 13:34:58 user nova-compute[74821]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)
Nov 06 13:34:58 user nova-compute[74821]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 (non-flash)
Nov 06 13:34:58 user nova-compute[74821]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e10353f5-8ba3-4fee-ae99-ec94ce235bb6 (non-flash)
Nov 06 13:34:58 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:34:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:34:58 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:34:58 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:34:58 user nova-compute[74821]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 (non-flash)
Nov 06 13:34:58 user nova-compute[74821]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)
Nov 06 13:34:58 user nova-compute[74821]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 (non-flash)
Nov 06 13:34:58 user nova-compute[74821]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e10353f5-8ba3-4fee-ae99-ec94ce235bb6 (non-flash)
Nov 06 13:34:58 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:34:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e404d8c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82'): ({'sdf'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:34:58 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Removing single pathed devices sdf {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:34:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:58 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa1af7d-e0a6-471d-b35f-a207070dc93d]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:58 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba2f28e-dc84-4d5f-a95b-b44a02269165]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:58 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Flushing IO for device /dev/sdf {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:34:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:58 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de1814d-7ce4-4053-aa86-43b045c4536e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:58 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:34:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.054s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:58 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f91de6-fd03-4916-b420-623f26b77f32]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:58 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:34:58 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] SCSI volumes sdf have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:34:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:34:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:59 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:59 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[479280e2-0c9f-407d-843a-b392309bba0d]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:59 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:34:59 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:59 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:59 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[39957094-4b4a-4ee7-b5c1-975776bcbb83]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:59 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82, portal: 172.16.0.220,3260]
Nov 06 13:34:59 user nova-compute[74821]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82, portal: 172.16.0.220,3260] successful.
Nov 06 13:34:59 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:34:59 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:34:59 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379ea2b9-c5af-4652-a630-572a70b50b82 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:34:59 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea704a8-2482-455c-ae21-a97f0ed8e677]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:34:59 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:34:59 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:34:59 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] <== disconnect_volume: return (361ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:34:59 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:34:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:00 user nova-compute[74821]: DEBUG nova.objects.instance [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lazy-loading 'flavor' on Instance uuid 6121ff1a-d276-485f-85f8-ba451f5b0d37 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:35:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e8c9548a-0809-45cb-857c-8f84a7099834 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "6121ff1a-d276-485f-85f8-ba451f5b0d37" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.961s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:35:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:06 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Acquiring lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:35:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:35:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Acquiring lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:35:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:35:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:35:08 user nova-compute[74821]: INFO nova.compute.manager [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Terminating instance
Nov 06 13:35:08 user nova-compute[74821]: DEBUG nova.compute.manager [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:35:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:08 user nova-compute[74821]: DEBUG nova.compute.manager [req-6e8eed8a-2cfe-44ec-b378-f7456d28c367 req-3976115e-8971-4eb1-a6f9-eca97c56cb2a service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Received event network-vif-unplugged-f768a2c5-10b0-4442-9c76-3b2365a15ea1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:35:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6e8eed8a-2cfe-44ec-b378-f7456d28c367 req-3976115e-8971-4eb1-a6f9-eca97c56cb2a service nova] Acquiring lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:35:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6e8eed8a-2cfe-44ec-b378-f7456d28c367 req-3976115e-8971-4eb1-a6f9-eca97c56cb2a service nova] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:35:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6e8eed8a-2cfe-44ec-b378-f7456d28c367 req-3976115e-8971-4eb1-a6f9-eca97c56cb2a service nova] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:35:08 user nova-compute[74821]: DEBUG nova.compute.manager [req-6e8eed8a-2cfe-44ec-b378-f7456d28c367 req-3976115e-8971-4eb1-a6f9-eca97c56cb2a service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] No waiting events found dispatching network-vif-unplugged-f768a2c5-10b0-4442-9c76-3b2365a15ea1 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:35:08 user nova-compute[74821]: DEBUG nova.compute.manager [req-6e8eed8a-2cfe-44ec-b378-f7456d28c367 req-3976115e-8971-4eb1-a6f9-eca97c56cb2a service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Received event network-vif-unplugged-f768a2c5-10b0-4442-9c76-3b2365a15ea1 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:35:09 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Instance destroyed successfully.
Nov 06 13:35:09 user nova-compute[74821]: DEBUG nova.objects.instance [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lazy-loading 'resources' on Instance uuid 2d8da345-f66d-45c2-8ccd-d22fdf79a14d {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:26:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-233244178',display_name='tempest-ServerActionsTestOtherB-server-233244178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-233244178',id=30,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMuJC1d4ehn860a5pUveloxEygkvx5gY8ln8i6Wkpyz/+95f+bQsPWUnUI4RTUqfdZx4+FPFbRCNSl970GfIGv9UYxW4qb3i2YKmZKus6nAHjmjCWQpj73f7nF5ypuSRew==',key_name='tempest-keypair-821004257',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:33:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56107e2c08004a26a96765ec143a6d6f',ramdisk_id='',reservation_id='r-l2lbl00l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1724377265',owner_user_name='tempest-ServerActionsTestOtherB-1724377265-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:33:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88e8b4a7235140488a7b9cd34bd10f85',uuid=2d8da345-f66d-45c2-8ccd-d22fdf79a14d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "address": "fa:16:3e:69:f1:92", "network": {"id": "fc4369de-77c4-4f2f-a73c-d556ca3ff47c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1805761900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56107e2c08004a26a96765ec143a6d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf768a2c5-10", "ovs_interfaceid": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Converting VIF {"id": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "address": "fa:16:3e:69:f1:92", "network": {"id": "fc4369de-77c4-4f2f-a73c-d556ca3ff47c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1805761900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56107e2c08004a26a96765ec143a6d6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf768a2c5-10", "ovs_interfaceid": "f768a2c5-10b0-4442-9c76-3b2365a15ea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:f1:92,bridge_name='br-int',has_traffic_filtering=True,id=f768a2c5-10b0-4442-9c76-3b2365a15ea1,network=Network(fc4369de-77c4-4f2f-a73c-d556ca3ff47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf768a2c5-10') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG os_vif [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:f1:92,bridge_name='br-int',has_traffic_filtering=True,id=f768a2c5-10b0-4442-9c76-3b2365a15ea1,network=Network(fc4369de-77c4-4f2f-a73c-d556ca3ff47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf768a2c5-10') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf768a2c5-10, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f5d7ec6d-65eb-4f86-8c3a-0f616d4d38a6) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:35:09 user nova-compute[74821]: INFO os_vif [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:f1:92,bridge_name='br-int',has_traffic_filtering=True,id=f768a2c5-10b0-4442-9c76-3b2365a15ea1,network=Network(fc4369de-77c4-4f2f-a73c-d556ca3ff47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf768a2c5-10')
Nov 06 13:35:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NqtJyMeh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:35:09 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:35:09 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e0f883-1f89-4fa7-8886-56ee8ed71246]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e10353f5-8ba3-4fee-ae99-ec94ce235bb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:35:09 user nova-compute[74821]: No targets found.
Nov 06 13:35:09 user nova-compute[74821]: iSNS:
Nov 06 13:35:09 user nova-compute[74821]: No targets found.
Nov 06 13:35:09 user nova-compute[74821]: STATIC:
Nov 06 13:35:09 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604
Nov 06 13:35:09 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:35:09 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:35:09 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13
Nov 06 13:35:09 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:35:09 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:35:09 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f
Nov 06 13:35:09 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:35:09 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:35:09 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979
Nov 06 13:35:09 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:35:09 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:35:09 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6
Nov 06 13:35:09 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:35:09 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:35:09 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:e10353f5-8ba3-4fee-ae99-ec94ce235bb6
Nov 06 13:35:09 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:35:09 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:35:09 user nova-compute[74821]: FIRMWARE:
Nov 06 13:35:09 user nova-compute[74821]: No targets found.
Nov 06 13:35:09 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:35:09 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:35:09 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc22befc-b981-437a-9f16-1a4097a86d32]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e10353f5-8ba3-4fee-ae99-ec94ce235bb6\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d33ca4e-1472-4157-935c-e91c9cfd4aff]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e10353f5-8ba3-4fee-ae99-ec94ce235bb6 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:35:09 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:35:09 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:35:09 user nova-compute[74821]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)
Nov 06 13:35:09 user nova-compute[74821]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 (non-flash)
Nov 06 13:35:09 user nova-compute[74821]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e10353f5-8ba3-4fee-ae99-ec94ce235bb6 (non-flash)
Nov 06 13:35:09 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:35:09 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:35:09 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:35:09 user nova-compute[74821]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 (non-flash)
Nov 06 13:35:09 user nova-compute[74821]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 (non-flash)
Nov 06 13:35:09 user nova-compute[74821]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e10353f5-8ba3-4fee-ae99-ec94ce235bb6 (non-flash)
Nov 06 13:35:09 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e40497880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6'): ({'sde'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Removing single pathed devices sde {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[550dabeb-c7a9-48ba-b533-8e246883257c]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c966b08-da04-4b37-a41e-fadd727e7965]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Flushing IO for device /dev/sde {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed10f98f-6938-4606-808e-3a3507443fe8]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[733e0803-a8ab-48c6-8174-bd56fd9fcdc0]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] SCSI volumes sde have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdcae641-6ef7-4d79-bee2-73c3d986589e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[46dd43ed-7e10-45a8-bf9f-06493dae9555]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6, portal: 172.16.0.220,3260]
Nov 06 13:35:09 user nova-compute[74821]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6, portal: 172.16.0.220,3260] successful.
Nov 06 13:35:09 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd6df57-5012-419e-86c9-eb8fca3325f6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7c4ff6-3038-403b-9823-03b5508d106a]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] <== disconnect_volume: return (335ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:35:09 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Deleting instance files /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d_del
Nov 06 13:35:09 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Deletion of /opt/stack/data/nova/instances/2d8da345-f66d-45c2-8ccd-d22fdf79a14d_del complete
Nov 06 13:35:09 user nova-compute[74821]: INFO nova.compute.manager [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 06 13:35:09 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:35:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:10 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:35:10 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Took 1.00 seconds to deallocate network for instance.
Nov 06 13:35:10 user nova-compute[74821]: DEBUG nova.compute.manager [req-ecfab129-3ef9-4714-be60-7ddc87673203 req-43413e85-fee7-4737-95e2-743059ee152b service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Received event network-vif-deleted-f768a2c5-10b0-4442-9c76-3b2365a15ea1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:35:10 user nova-compute[74821]: DEBUG nova.compute.manager [req-05be8814-53d2-4ff6-bdfb-847d9cfb9a56 req-868e4f29-b0ed-4945-837f-55e770563675 service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Received event network-vif-plugged-f768a2c5-10b0-4442-9c76-3b2365a15ea1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:35:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-05be8814-53d2-4ff6-bdfb-847d9cfb9a56 req-868e4f29-b0ed-4945-837f-55e770563675 service nova] Acquiring lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:35:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-05be8814-53d2-4ff6-bdfb-847d9cfb9a56 req-868e4f29-b0ed-4945-837f-55e770563675 service nova] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:35:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-05be8814-53d2-4ff6-bdfb-847d9cfb9a56 req-868e4f29-b0ed-4945-837f-55e770563675 service nova] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:35:10 user nova-compute[74821]: DEBUG nova.compute.manager [req-05be8814-53d2-4ff6-bdfb-847d9cfb9a56 req-868e4f29-b0ed-4945-837f-55e770563675 service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] No waiting events found dispatching network-vif-plugged-f768a2c5-10b0-4442-9c76-3b2365a15ea1 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:35:10 user nova-compute[74821]: WARNING nova.compute.manager [req-05be8814-53d2-4ff6-bdfb-847d9cfb9a56 req-868e4f29-b0ed-4945-837f-55e770563675 service nova] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Received unexpected event network-vif-plugged-f768a2c5-10b0-4442-9c76-3b2365a15ea1 for instance with vm_state active and task_state deleting.
Nov 06 13:35:11 user nova-compute[74821]: INFO nova.compute.manager [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] [instance: 2d8da345-f66d-45c2-8ccd-d22fdf79a14d] Took 0.90 seconds to detach 1 volumes for instance.
Nov 06 13:35:11 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:35:11 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:35:11 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:35:11 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:35:11 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:35:11 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Deleted allocations for instance 2d8da345-f66d-45c2-8ccd-d22fdf79a14d
Nov 06 13:35:11 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1497640c-c8fb-44d2-acd7-69b031f8b1e1 tempest-ServerActionsTestOtherB-1724377265 tempest-ServerActionsTestOtherB-1724377265-project-member] Lock "2d8da345-f66d-45c2-8ccd-d22fdf79a14d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.587s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:35:14 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:14 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:35:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:35:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:35:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:35:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.003s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:35:18 user nova-compute[74821]: INFO nova.compute.manager [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Terminating instance
Nov 06 13:35:18 user nova-compute[74821]: DEBUG nova.compute.manager [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:35:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG nova.compute.manager [req-8c99bd1d-e95d-474d-b2f3-276729e3e5f4 req-b6751437-497f-498c-b8cd-4044436c672e service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Received event network-vif-unplugged-267248e7-6714-47b4-b1b2-1d94251305da {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8c99bd1d-e95d-474d-b2f3-276729e3e5f4 req-b6751437-497f-498c-b8cd-4044436c672e service nova] Acquiring lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8c99bd1d-e95d-474d-b2f3-276729e3e5f4 req-b6751437-497f-498c-b8cd-4044436c672e service nova] Lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8c99bd1d-e95d-474d-b2f3-276729e3e5f4 req-b6751437-497f-498c-b8cd-4044436c672e service nova] Lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG nova.compute.manager [req-8c99bd1d-e95d-474d-b2f3-276729e3e5f4 req-b6751437-497f-498c-b8cd-4044436c672e service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] No waiting events found dispatching network-vif-unplugged-267248e7-6714-47b4-b1b2-1d94251305da {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG nova.compute.manager [req-8c99bd1d-e95d-474d-b2f3-276729e3e5f4 req-b6751437-497f-498c-b8cd-4044436c672e service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Received event network-vif-unplugged-267248e7-6714-47b4-b1b2-1d94251305da for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:19 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Instance destroyed successfully.
Nov 06 13:35:19 user nova-compute[74821]: DEBUG nova.objects.instance [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lazy-loading 'resources' on Instance uuid d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:27:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-337626543',display_name='tempest-ServerActionsTestOtherA-server-337626543',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-337626543',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4JiUWhVtBLaIMVWmdaDGfPw0zGPPsGUpSPMYouFUdE8U/JVhpnD9HPYPDsmw237Zq0kahTjlP/cerosJ2tVPbLsi+XC2cHQjqtX7zMb9rwN9mSYsloUtu1O3SiQuCuOw==',key_name='tempest-keypair-1142367632',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:30:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77233758870b4fdfbb7ca76829f0f82e',ramdisk_id='',reservation_id='r-ddppkv09',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1986828412',owner_user_name='tempest-ServerActionsTestOtherA-1986828412-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:32:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0620d1928d8d434fbe0bc1cdb31a2a89',uuid=d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "267248e7-6714-47b4-b1b2-1d94251305da", "address": "fa:16:3e:4e:3f:6c", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267248e7-67", "ovs_interfaceid": "267248e7-6714-47b4-b1b2-1d94251305da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Converting VIF {"id": "267248e7-6714-47b4-b1b2-1d94251305da", "address": "fa:16:3e:4e:3f:6c", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267248e7-67", "ovs_interfaceid": "267248e7-6714-47b4-b1b2-1d94251305da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:3f:6c,bridge_name='br-int',has_traffic_filtering=True,id=267248e7-6714-47b4-b1b2-1d94251305da,network=Network(a3838abe-b3bb-4878-9d5d-eb80a8cf60a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267248e7-67') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG os_vif [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:3f:6c,bridge_name='br-int',has_traffic_filtering=True,id=267248e7-6714-47b4-b1b2-1d94251305da,network=Network(a3838abe-b3bb-4878-9d5d-eb80a8cf60a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267248e7-67') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap267248e7-67, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ceeec57-61e8-445d-879f-bb53fcedb621) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:35:19 user nova-compute[74821]: INFO os_vif [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:3f:6c,bridge_name='br-int',has_traffic_filtering=True,id=267248e7-6714-47b4-b1b2-1d94251305da,network=Network(a3838abe-b3bb-4878-9d5d-eb80a8cf60a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267248e7-67')
Nov 06 13:35:19 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BrHLNeiI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:35:19 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:35:19 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2b2e20-a3d1-465d-9b84-4f06e66c6f3b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04e94a8f-d536-437b-b8a5-2d36b7b439e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e10353f5-8ba3-4fee-ae99-ec94ce235bb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:35:19 user nova-compute[74821]: No targets found.
Nov 06 13:35:19 user nova-compute[74821]: iSNS:
Nov 06 13:35:19 user nova-compute[74821]: No targets found.
Nov 06 13:35:19 user nova-compute[74821]: STATIC:
Nov 06 13:35:19 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604
Nov 06 13:35:19 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:35:19 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:35:19 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13
Nov 06 13:35:19 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:35:19 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:35:19 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f
Nov 06 13:35:19 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:35:19 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:35:19 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979
Nov 06 13:35:19 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:35:19 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:35:19 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:04e94a8f-d536-437b-b8a5-2d36b7b439e6
Nov 06 13:35:19 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:35:19 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:35:19 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:e10353f5-8ba3-4fee-ae99-ec94ce235bb6
Nov 06 13:35:19 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:35:19 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:35:19 user nova-compute[74821]: FIRMWARE:
Nov 06 13:35:19 user nova-compute[74821]: No targets found.
Nov 06 13:35:19 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:35:19 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:35:19 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2247888-231c-4a38-9988-aad5878979c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04e94a8f-d536-437b-b8a5-2d36b7b439e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e10353f5-8ba3-4fee-ae99-ec94ce235bb6\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[344a5dc6-8067-451a-9945-2e20f3e40207]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e10353f5-8ba3-4fee-ae99-ec94ce235bb6 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e94a8f-d536-437b-b8a5-2d36b7b439e6 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:35:19 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:35:19 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:35:19 user nova-compute[74821]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 (non-flash)
Nov 06 13:35:19 user nova-compute[74821]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e10353f5-8ba3-4fee-ae99-ec94ce235bb6 (non-flash)
Nov 06 13:35:19 user nova-compute[74821]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e94a8f-d536-437b-b8a5-2d36b7b439e6 (non-flash)
Nov 06 13:35:19 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:35:19 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:35:19 user nova-compute[74821]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 (non-flash)
Nov 06 13:35:19 user nova-compute[74821]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 (non-flash)
Nov 06 13:35:19 user nova-compute[74821]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e10353f5-8ba3-4fee-ae99-ec94ce235bb6 (non-flash)
Nov 06 13:35:19 user nova-compute[74821]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e94a8f-d536-437b-b8a5-2d36b7b439e6 (non-flash)
Nov 06 13:35:19 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e5b661630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604'): ({'sdc'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Removing single pathed devices sdc {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[984fd6aa-df63-4466-8315-3c84ac6a0610]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3907b07b-9404-4556-8b9f-c0bcc889eb5e]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Flushing IO for device /dev/sdc {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[02762778-733c-4741-b337-e4613b35f4d7]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.064s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[27394f88-9149-43ad-a0a8-cda0271f58f4]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] SCSI volumes sdc have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c344e685-de70-48e3-9a0e-523398deabbd]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:35:19 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:20 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:20 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c26075-217c-4d8c-bf15-4ce349c1bdeb]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:35:20 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604, portal: 172.16.0.220,3260]
Nov 06 13:35:20 user nova-compute[74821]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604, portal: 172.16.0.220,3260] successful.
Nov 06 13:35:20 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:35:20 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:20 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:20 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[684f6995-ae29-4d4b-9a24-c95e377f7eea]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:35:20 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:35:20 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.412s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:35:20 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] <== disconnect_volume: return (413ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:35:20 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:35:20 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Deleting instance files /opt/stack/data/nova/instances/d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8_del
Nov 06 13:35:20 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Deletion of /opt/stack/data/nova/instances/d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8_del complete
Nov 06 13:35:20 user nova-compute[74821]: INFO nova.compute.manager [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Took 1.62 seconds to destroy the instance on the hypervisor.
Nov 06 13:35:20 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:35:20 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:35:20 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:35:21 user nova-compute[74821]: DEBUG nova.compute.manager [req-9b1894e7-8606-4f89-a29f-c5b8a4e25d11 req-e9bbe535-e94a-439a-937c-9bdba7318ed3 service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Received event network-vif-plugged-267248e7-6714-47b4-b1b2-1d94251305da {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:35:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-9b1894e7-8606-4f89-a29f-c5b8a4e25d11 req-e9bbe535-e94a-439a-937c-9bdba7318ed3 service nova] Acquiring lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:35:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-9b1894e7-8606-4f89-a29f-c5b8a4e25d11 req-e9bbe535-e94a-439a-937c-9bdba7318ed3 service nova] Lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:35:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-9b1894e7-8606-4f89-a29f-c5b8a4e25d11 req-e9bbe535-e94a-439a-937c-9bdba7318ed3 service nova] Lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:35:21 user nova-compute[74821]: DEBUG nova.compute.manager [req-9b1894e7-8606-4f89-a29f-c5b8a4e25d11 req-e9bbe535-e94a-439a-937c-9bdba7318ed3 service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] No waiting events found dispatching network-vif-plugged-267248e7-6714-47b4-b1b2-1d94251305da {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:35:21 user nova-compute[74821]: WARNING nova.compute.manager [req-9b1894e7-8606-4f89-a29f-c5b8a4e25d11 req-e9bbe535-e94a-439a-937c-9bdba7318ed3 service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Received unexpected event network-vif-plugged-267248e7-6714-47b4-b1b2-1d94251305da for instance with vm_state active and task_state deleting.
Nov 06 13:35:21 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:35:21 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Took 1.50 seconds to deallocate network for instance.
Nov 06 13:35:21 user nova-compute[74821]: DEBUG nova.compute.manager [req-1b20e171-8a71-4c92-9960-f0635cd4f2d4 req-abbfec16-dbdf-4fab-83bd-2b249918b818 service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Received event network-vif-deleted-267248e7-6714-47b4-b1b2-1d94251305da {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:35:21 user nova-compute[74821]: INFO nova.compute.manager [req-1b20e171-8a71-4c92-9960-f0635cd4f2d4 req-abbfec16-dbdf-4fab-83bd-2b249918b818 service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Neutron deleted interface 267248e7-6714-47b4-b1b2-1d94251305da; detaching it from the instance and deleting it from the info cache
Nov 06 13:35:21 user nova-compute[74821]: DEBUG nova.network.neutron [req-1b20e171-8a71-4c92-9960-f0635cd4f2d4 req-abbfec16-dbdf-4fab-83bd-2b249918b818 service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:35:21 user nova-compute[74821]: DEBUG nova.compute.manager [req-1b20e171-8a71-4c92-9960-f0635cd4f2d4 req-abbfec16-dbdf-4fab-83bd-2b249918b818 service nova] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Detach interface failed, port_id=267248e7-6714-47b4-b1b2-1d94251305da, reason: Instance d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8 could not be found. {{(pid=74821) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 13:35:22 user nova-compute[74821]: INFO nova.compute.manager [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Took 1.07 seconds to detach 1 volumes for instance.
Nov 06 13:35:22 user nova-compute[74821]: DEBUG nova.compute.manager [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8] Deleting volume: 546db5ab-eb3b-46e2-a7e2-bf7fb31d6604 {{(pid=74821) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 06 13:35:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:35:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:35:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:23 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:35:23 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:35:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:35:23 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Deleted allocations for instance d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8
Nov 06 13:35:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-111981b5-5670-4967-84e2-2ecc8408cc82 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "d508c34d-fd65-41b5-be8e-e7d5e3e0c1a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.813s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:35:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "64ae6f5e-38a1-4871-8015-c2097f64b33b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:35:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "64ae6f5e-38a1-4871-8015-c2097f64b33b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:35:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:35:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:35:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:35:27 user nova-compute[74821]: INFO nova.compute.manager [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Terminating instance
Nov 06 13:35:27 user nova-compute[74821]: DEBUG nova.compute.manager [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:35:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG nova.compute.manager [req-5563f17c-903e-4844-97ca-bf8b1e19a785 req-9f307e50-3114-4f05-a314-5bfcd0142fc1 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Received event network-vif-unplugged-ded8f989-f920-42ed-a158-04455e6abbc1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5563f17c-903e-4844-97ca-bf8b1e19a785 req-9f307e50-3114-4f05-a314-5bfcd0142fc1 service nova] Acquiring lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5563f17c-903e-4844-97ca-bf8b1e19a785 req-9f307e50-3114-4f05-a314-5bfcd0142fc1 service nova] Lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5563f17c-903e-4844-97ca-bf8b1e19a785 req-9f307e50-3114-4f05-a314-5bfcd0142fc1 service nova] Lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG nova.compute.manager [req-5563f17c-903e-4844-97ca-bf8b1e19a785 req-9f307e50-3114-4f05-a314-5bfcd0142fc1 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] No waiting events found dispatching network-vif-unplugged-ded8f989-f920-42ed-a158-04455e6abbc1 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG nova.compute.manager [req-5563f17c-903e-4844-97ca-bf8b1e19a785 req-9f307e50-3114-4f05-a314-5bfcd0142fc1 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Received event network-vif-unplugged-ded8f989-f920-42ed-a158-04455e6abbc1 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:35:28 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Instance destroyed successfully.
Nov 06 13:35:28 user nova-compute[74821]: DEBUG nova.objects.instance [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lazy-loading 'resources' on Instance uuid 64ae6f5e-38a1-4871-8015-c2097f64b33b {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:28:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1606742164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1606742164',id=35,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:31:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f745a322931e4150b12d139bfb17b94c',ramdisk_id='',reservation_id='r-lvxyahl7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1064633830',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:33:42Z,user_data=None,user_id='133932d1063241078d84731624e89216',uuid=64ae6f5e-38a1-4871-8015-c2097f64b33b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ded8f989-f920-42ed-a158-04455e6abbc1", "address": "fa:16:3e:b2:3e:a6", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8f989-f9", "ovs_interfaceid": "ded8f989-f920-42ed-a158-04455e6abbc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Converting VIF {"id": "ded8f989-f920-42ed-a158-04455e6abbc1", "address": "fa:16:3e:b2:3e:a6", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapded8f989-f9", "ovs_interfaceid": "ded8f989-f920-42ed-a158-04455e6abbc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:3e:a6,bridge_name='br-int',has_traffic_filtering=True,id=ded8f989-f920-42ed-a158-04455e6abbc1,network=Network(354bf335-0cac-46d9-acb8-5095411f5db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapded8f989-f9') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG os_vif [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:3e:a6,bridge_name='br-int',has_traffic_filtering=True,id=ded8f989-f920-42ed-a158-04455e6abbc1,network=Network(354bf335-0cac-46d9-acb8-5095411f5db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapded8f989-f9') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapded8f989-f9, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c3174155-cc5a-47f5-ac17-361b9df87e49) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:28 user nova-compute[74821]: INFO os_vif [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:3e:a6,bridge_name='br-int',has_traffic_filtering=True,id=ded8f989-f920-42ed-a158-04455e6abbc1,network=Network(354bf335-0cac-46d9-acb8-5095411f5db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapded8f989-f9')
Nov 06 13:35:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fc30c605-6f1f-4e15-97f9-bafcb1feacb2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "6121ff1a-d276-485f-85f8-ba451f5b0d37" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fc30c605-6f1f-4e15-97f9-bafcb1feacb2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "6121ff1a-d276-485f-85f8-ba451f5b0d37" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fc30c605-6f1f-4e15-97f9-bafcb1feacb2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "6121ff1a-d276-485f-85f8-ba451f5b0d37-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fc30c605-6f1f-4e15-97f9-bafcb1feacb2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "6121ff1a-d276-485f-85f8-ba451f5b0d37-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fc30c605-6f1f-4e15-97f9-bafcb1feacb2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "6121ff1a-d276-485f-85f8-ba451f5b0d37-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:35:28 user nova-compute[74821]: INFO nova.compute.manager [None req-fc30c605-6f1f-4e15-97f9-bafcb1feacb2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Terminating instance
Nov 06 13:35:28 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IBghSkKa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:35:28 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:35:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG nova.compute.manager [None req-fc30c605-6f1f-4e15-97f9-bafcb1feacb2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c52100-240b-41e0-92d3-9493e3bcfa25]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04e94a8f-d536-437b-b8a5-2d36b7b439e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:35:28 user nova-compute[74821]: No targets found.
Nov 06 13:35:28 user nova-compute[74821]: iSNS:
Nov 06 13:35:28 user nova-compute[74821]: No targets found.
Nov 06 13:35:28 user nova-compute[74821]: STATIC:
Nov 06 13:35:28 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13
Nov 06 13:35:28 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:35:28 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:35:28 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f
Nov 06 13:35:28 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:35:28 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:35:28 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979
Nov 06 13:35:28 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:35:28 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:35:28 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:04e94a8f-d536-437b-b8a5-2d36b7b439e6
Nov 06 13:35:28 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:35:28 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:35:28 user nova-compute[74821]: FIRMWARE:
Nov 06 13:35:28 user nova-compute[74821]: No targets found.
Nov 06 13:35:28 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:35:28 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:35:28 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.036s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43a97c5-c0a9-4015-b21c-6bfdfb64ee39]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04e94a8f-d536-437b-b8a5-2d36b7b439e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[444622c7-3a4a-41ba-9182-b6ab9adb0e63]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e94a8f-d536-437b-b8a5-2d36b7b439e6 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:35:28 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:35:28 user nova-compute[74821]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 (non-flash)
Nov 06 13:35:28 user nova-compute[74821]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e94a8f-d536-437b-b8a5-2d36b7b439e6 (non-flash)
Nov 06 13:35:28 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:35:28 user nova-compute[74821]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f (non-flash)
Nov 06 13:35:28 user nova-compute[74821]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 (non-flash)
Nov 06 13:35:28 user nova-compute[74821]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e94a8f-d536-437b-b8a5-2d36b7b439e6 (non-flash)
Nov 06 13:35:28 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e40495240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f'): ({'sdb'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Removing single pathed devices sdb {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e079a046-605f-4203-9ea3-c3bcc9c8ff99]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1775a11-bbd0-48c1-b6ce-42a561aabd29]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Flushing IO for device /dev/sdb {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4884d154-dc70-476e-8e70-b321a01bf732]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.075s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87ad55b-c1a2-43be-bfb8-41bd681260c3]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] SCSI volumes sdb have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.044s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c201e5f8-2f16-439a-b200-83e1769c4e61]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:35:28 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:29 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9566db21-1b6e-444a-8ed9-05287109f9bc]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:35:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f, portal: 172.16.0.220,3260]
Nov 06 13:35:29 user nova-compute[74821]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f, portal: 172.16.0.220,3260] successful.
Nov 06 13:35:29 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:35:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b57743d-26b7-4805-a133-483e5e3cd42f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:29 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2f197d-283a-4e1b-8895-538f7e283d95]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:35:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:35:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.468s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:35:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] <== disconnect_volume: return (469ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:35:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:35:29 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Deleting instance files /opt/stack/data/nova/instances/64ae6f5e-38a1-4871-8015-c2097f64b33b_del
Nov 06 13:35:29 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Deletion of /opt/stack/data/nova/instances/64ae6f5e-38a1-4871-8015-c2097f64b33b_del complete
Nov 06 13:35:29 user nova-compute[74821]: INFO nova.compute.manager [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Took 1.58 seconds to destroy the instance on the hypervisor.
Nov 06 13:35:29 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:35:29 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:35:29 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:35:29 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Instance destroyed successfully.
Nov 06 13:35:29 user nova-compute[74821]: DEBUG nova.objects.instance [None req-fc30c605-6f1f-4e15-97f9-bafcb1feacb2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lazy-loading 'resources' on Instance uuid 6121ff1a-d276-485f-85f8-ba451f5b0d37 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:35:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-fc30c605-6f1f-4e15-97f9-bafcb1feacb2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:29:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2087931296',display_name='tempest-AttachVolumeNegativeTest-server-2087931296',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2087931296',id=36,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmsSR8TIyHUzEK03UhVYLH5ozOK0p2Bhy8aEAmRYbwaWJ1pAdh/bw2U0J6nBvLB/M32+u9uklEhQXh52xGgKD+vMOYmQxu+w0wzIVLazbWeIniQQBoEPHs8hoPMiZoBbA==',key_name='tempest-keypair-469241646',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:29:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c6d2ded0b1d4af09f1e05582bcbd3ae',ramdisk_id='',reservation_id='r-3vnkd5x2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1164383705',owner_user_name='tempest-AttachVolumeNegativeTest-1164383705-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:29:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ffddfc972374f6aa7d81288d34690cf',uuid=6121ff1a-d276-485f-85f8-ba451f5b0d37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e1f285c-2014-4b04-a4c3-83ccc1d695fd", "address": "fa:16:3e:9c:4f:f3", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e1f285c-20", "ovs_interfaceid": "1e1f285c-2014-4b04-a4c3-83ccc1d695fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:35:29 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-fc30c605-6f1f-4e15-97f9-bafcb1feacb2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Converting VIF {"id": "1e1f285c-2014-4b04-a4c3-83ccc1d695fd", "address": "fa:16:3e:9c:4f:f3", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e1f285c-20", "ovs_interfaceid": "1e1f285c-2014-4b04-a4c3-83ccc1d695fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:35:29 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-fc30c605-6f1f-4e15-97f9-bafcb1feacb2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:4f:f3,bridge_name='br-int',has_traffic_filtering=True,id=1e1f285c-2014-4b04-a4c3-83ccc1d695fd,network=Network(3e1f6a20-5316-4c49-93a5-deabb70d8608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e1f285c-20') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:35:29 user nova-compute[74821]: DEBUG os_vif [None req-fc30c605-6f1f-4e15-97f9-bafcb1feacb2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:4f:f3,bridge_name='br-int',has_traffic_filtering=True,id=1e1f285c-2014-4b04-a4c3-83ccc1d695fd,network=Network(3e1f6a20-5316-4c49-93a5-deabb70d8608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e1f285c-20') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:35:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e1f285c-20, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:35:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:35:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=067900f3-d238-4592-bade-72c67ebc7073) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:35:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:35:29 user nova-compute[74821]: INFO os_vif [None req-fc30c605-6f1f-4e15-97f9-bafcb1feacb2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:4f:f3,bridge_name='br-int',has_traffic_filtering=True,id=1e1f285c-2014-4b04-a4c3-83ccc1d695fd,network=Network(3e1f6a20-5316-4c49-93a5-deabb70d8608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e1f285c-20')
Nov 06 13:35:29 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-fc30c605-6f1f-4e15-97f9-bafcb1feacb2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Deleting instance files /opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37_del
Nov 06 13:35:29 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-fc30c605-6f1f-4e15-97f9-bafcb1feacb2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Deletion of /opt/stack/data/nova/instances/6121ff1a-d276-485f-85f8-ba451f5b0d37_del complete
Nov 06 13:35:29 user nova-compute[74821]: INFO nova.compute.manager [None req-fc30c605-6f1f-4e15-97f9-bafcb1feacb2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 06 13:35:29 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-fc30c605-6f1f-4e15-97f9-bafcb1feacb2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:35:29 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:35:29 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:35:29 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:35:29 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Took 0.66 seconds to deallocate network for instance.
Nov 06 13:35:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:30 user nova-compute[74821]: DEBUG nova.compute.manager [req-833c358d-e516-40f8-bce6-ab50b5e04b6a req-82e51fc3-e230-49d2-a5c0-3bb8bef83291 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Received event network-vif-plugged-ded8f989-f920-42ed-a158-04455e6abbc1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:35:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-833c358d-e516-40f8-bce6-ab50b5e04b6a req-82e51fc3-e230-49d2-a5c0-3bb8bef83291 service nova] Acquiring lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:35:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-833c358d-e516-40f8-bce6-ab50b5e04b6a req-82e51fc3-e230-49d2-a5c0-3bb8bef83291 service nova] Lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:35:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-833c358d-e516-40f8-bce6-ab50b5e04b6a req-82e51fc3-e230-49d2-a5c0-3bb8bef83291 service nova] Lock "64ae6f5e-38a1-4871-8015-c2097f64b33b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:35:30 user nova-compute[74821]: DEBUG nova.compute.manager [req-833c358d-e516-40f8-bce6-ab50b5e04b6a req-82e51fc3-e230-49d2-a5c0-3bb8bef83291 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] No waiting events found dispatching network-vif-plugged-ded8f989-f920-42ed-a158-04455e6abbc1 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:35:30 user nova-compute[74821]: WARNING nova.compute.manager [req-833c358d-e516-40f8-bce6-ab50b5e04b6a req-82e51fc3-e230-49d2-a5c0-3bb8bef83291 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Received unexpected event network-vif-plugged-ded8f989-f920-42ed-a158-04455e6abbc1 for instance with vm_state active and task_state deleting.
Nov 06 13:35:30 user nova-compute[74821]: DEBUG nova.compute.manager [req-833c358d-e516-40f8-bce6-ab50b5e04b6a req-82e51fc3-e230-49d2-a5c0-3bb8bef83291 service nova] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Received event network-vif-unplugged-1e1f285c-2014-4b04-a4c3-83ccc1d695fd {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:35:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-833c358d-e516-40f8-bce6-ab50b5e04b6a req-82e51fc3-e230-49d2-a5c0-3bb8bef83291 service nova] Acquiring lock "6121ff1a-d276-485f-85f8-ba451f5b0d37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:35:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-833c358d-e516-40f8-bce6-ab50b5e04b6a req-82e51fc3-e230-49d2-a5c0-3bb8bef83291 service nova] Lock "6121ff1a-d276-485f-85f8-ba451f5b0d37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:35:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-833c358d-e516-40f8-bce6-ab50b5e04b6a req-82e51fc3-e230-49d2-a5c0-3bb8bef83291 service nova] Lock "6121ff1a-d276-485f-85f8-ba451f5b0d37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:35:30 user nova-compute[74821]: DEBUG nova.compute.manager [req-833c358d-e516-40f8-bce6-ab50b5e04b6a req-82e51fc3-e230-49d2-a5c0-3bb8bef83291 service nova] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] No waiting events found dispatching network-vif-unplugged-1e1f285c-2014-4b04-a4c3-83ccc1d695fd {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:35:30 user nova-compute[74821]: DEBUG nova.compute.manager [req-833c358d-e516-40f8-bce6-ab50b5e04b6a req-82e51fc3-e230-49d2-a5c0-3bb8bef83291 service nova] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Received event network-vif-unplugged-1e1f285c-2014-4b04-a4c3-83ccc1d695fd for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:35:30 user nova-compute[74821]: DEBUG nova.compute.manager [req-833c358d-e516-40f8-bce6-ab50b5e04b6a req-82e51fc3-e230-49d2-a5c0-3bb8bef83291 service nova] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Received event network-vif-plugged-1e1f285c-2014-4b04-a4c3-83ccc1d695fd {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:35:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-833c358d-e516-40f8-bce6-ab50b5e04b6a req-82e51fc3-e230-49d2-a5c0-3bb8bef83291 service nova] Acquiring lock "6121ff1a-d276-485f-85f8-ba451f5b0d37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:35:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-833c358d-e516-40f8-bce6-ab50b5e04b6a req-82e51fc3-e230-49d2-a5c0-3bb8bef83291 service nova] Lock "6121ff1a-d276-485f-85f8-ba451f5b0d37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:35:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-833c358d-e516-40f8-bce6-ab50b5e04b6a req-82e51fc3-e230-49d2-a5c0-3bb8bef83291 service nova] Lock "6121ff1a-d276-485f-85f8-ba451f5b0d37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:35:30 user nova-compute[74821]: DEBUG nova.compute.manager [req-833c358d-e516-40f8-bce6-ab50b5e04b6a req-82e51fc3-e230-49d2-a5c0-3bb8bef83291 service nova] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] No waiting events found dispatching network-vif-plugged-1e1f285c-2014-4b04-a4c3-83ccc1d695fd {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:35:30 user nova-compute[74821]: WARNING nova.compute.manager [req-833c358d-e516-40f8-bce6-ab50b5e04b6a req-82e51fc3-e230-49d2-a5c0-3bb8bef83291 service nova] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Received unexpected event network-vif-plugged-1e1f285c-2014-4b04-a4c3-83ccc1d695fd for instance with vm_state active and task_state deleting.
Nov 06 13:35:30 user nova-compute[74821]: DEBUG nova.compute.manager [req-833c358d-e516-40f8-bce6-ab50b5e04b6a req-82e51fc3-e230-49d2-a5c0-3bb8bef83291 service nova] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Received event network-vif-deleted-ded8f989-f920-42ed-a158-04455e6abbc1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:35:30 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:35:30 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Took 0.98 seconds to deallocate network for instance.
Nov 06 13:35:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fc30c605-6f1f-4e15-97f9-bafcb1feacb2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:35:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fc30c605-6f1f-4e15-97f9-bafcb1feacb2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:35:30 user nova-compute[74821]: INFO nova.compute.manager [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 64ae6f5e-38a1-4871-8015-c2097f64b33b] Took 1.10 seconds to detach 1 volumes for instance.
Nov 06 13:35:30 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-fc30c605-6f1f-4e15-97f9-bafcb1feacb2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:35:30 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-fc30c605-6f1f-4e15-97f9-bafcb1feacb2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:35:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:35:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fc30c605-6f1f-4e15-97f9-bafcb1feacb2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:35:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.024s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:35:31 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-fc30c605-6f1f-4e15-97f9-bafcb1feacb2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Deleted allocations for instance 6121ff1a-d276-485f-85f8-ba451f5b0d37
Nov 06 13:35:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fc30c605-6f1f-4e15-97f9-bafcb1feacb2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "6121ff1a-d276-485f-85f8-ba451f5b0d37" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.578s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:35:31 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:35:31 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:35:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:35:31 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Deleted allocations for instance 64ae6f5e-38a1-4871-8015-c2097f64b33b
Nov 06 13:35:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a69c2558-0dba-4983-8c5d-7425bd3bc312 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "64ae6f5e-38a1-4871-8015-c2097f64b33b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.899s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:35:32 user nova-compute[74821]: DEBUG nova.compute.manager [req-d0b27ace-cc1c-4b07-8f6e-518a14d01be1 req-61beb55c-c585-4342-b30d-17512030193c service nova] [instance: 6121ff1a-d276-485f-85f8-ba451f5b0d37] Received event network-vif-deleted-1e1f285c-2014-4b04-a4c3-83ccc1d695fd {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:35:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:39 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:35:42 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:35:42 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:35:42 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Rebuilding the list of instances to heal {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 13:35:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-2de346cb-9858-47b8-a86c-4fde720d6127" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:35:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-2de346cb-9858-47b8-a86c-4fde720d6127" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:35:43 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:35:43 user nova-compute[74821]: DEBUG nova.objects.instance [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lazy-loading 'info_cache' on Instance uuid 2de346cb-9858-47b8-a86c-4fde720d6127 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:35:43 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Updating instance_info_cache with network_info: [{"id": "364b4308-8730-4b11-90a1-48ea6ab3de60", "address": "fa:16:3e:48:8d:c6", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b4308-87", "ovs_interfaceid": "364b4308-8730-4b11-90a1-48ea6ab3de60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:35:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-2de346cb-9858-47b8-a86c-4fde720d6127" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:35:43 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:35:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:44 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:35:44 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:35:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:46 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:35:46 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:35:47 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:35:47 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:35:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:50 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:35:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:35:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:35:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:35:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:35:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:35:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:35:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:35:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:35:53 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:35:53 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:35:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=8427MB free_disk=24.913326263427734GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:35:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:35:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:35:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 2de346cb-9858-47b8-a86c-4fde720d6127 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:35:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 49c65aca-8392-46ba-8fa3-b47ff2416cb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:35:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 496f8213-4b32-4211-a354-e33a4a088848 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:35:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 1290bdb3-827f-4365-a4f1-4ae063de780d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:35:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 8467fdc8-ec8e-4eda-abbc-b146e58e90c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:35:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:35:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:35:53 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:35:53 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:35:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:35:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.336s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:35:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:35:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:00 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:36:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:06 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "9e433454-d767-45fc-b45d-a1d39ee62bd6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:36:06 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "9e433454-d767-45fc-b45d-a1d39ee62bd6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:36:06 user nova-compute[74821]: DEBUG nova.compute.manager [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:36:06 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:36:06 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:36:06 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:36:06 user nova-compute[74821]: INFO nova.compute.claims [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Claim successful on node user
Nov 06 13:36:06 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:36:06 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:36:06 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.305s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:36:06 user nova-compute[74821]: DEBUG nova.compute.manager [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:36:06 user nova-compute[74821]: DEBUG nova.compute.manager [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:36:06 user nova-compute[74821]: DEBUG nova.network.neutron [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:36:06 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:36:06 user nova-compute[74821]: DEBUG nova.compute.manager [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:36:06 user nova-compute[74821]: DEBUG nova.policy [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3bb6a168d90a4795a72b8ac69eeadcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e811a3a30417a8dc6ccad03f2f8e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:36:06 user nova-compute[74821]: INFO nova.virt.block_device [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Booting with volume snapshot 7da59760-d71c-4c74-ba01-3c041608f882 at /dev/vda
Nov 06 13:36:08 user nova-compute[74821]: DEBUG nova.network.neutron [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Successfully created port: 83625d0a-3bdb-41a2-8694-e65a9e0aaea1 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:36:08 user nova-compute[74821]: DEBUG nova.network.neutron [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Successfully updated port: 83625d0a-3bdb-41a2-8694-e65a9e0aaea1 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:36:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "refresh_cache-9e433454-d767-45fc-b45d-a1d39ee62bd6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:36:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquired lock "refresh_cache-9e433454-d767-45fc-b45d-a1d39ee62bd6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:36:08 user nova-compute[74821]: DEBUG nova.network.neutron [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:36:08 user nova-compute[74821]: DEBUG nova.compute.manager [req-f7414b8e-ed2a-4569-926a-4d253a54b2d4 req-fb21669d-4475-4554-bc05-9f806c70f91c service nova] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Received event network-changed-83625d0a-3bdb-41a2-8694-e65a9e0aaea1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:36:08 user nova-compute[74821]: DEBUG nova.compute.manager [req-f7414b8e-ed2a-4569-926a-4d253a54b2d4 req-fb21669d-4475-4554-bc05-9f806c70f91c service nova] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Refreshing instance network info cache due to event network-changed-83625d0a-3bdb-41a2-8694-e65a9e0aaea1. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:36:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f7414b8e-ed2a-4569-926a-4d253a54b2d4 req-fb21669d-4475-4554-bc05-9f806c70f91c service nova] Acquiring lock "refresh_cache-9e433454-d767-45fc-b45d-a1d39ee62bd6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:36:08 user nova-compute[74821]: DEBUG nova.network.neutron [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:36:09 user nova-compute[74821]: DEBUG nova.network.neutron [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Updating instance_info_cache with network_info: [{"id": "83625d0a-3bdb-41a2-8694-e65a9e0aaea1", "address": "fa:16:3e:23:4a:24", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83625d0a-3b", "ovs_interfaceid": "83625d0a-3bdb-41a2-8694-e65a9e0aaea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:36:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Releasing lock "refresh_cache-9e433454-d767-45fc-b45d-a1d39ee62bd6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:36:09 user nova-compute[74821]: DEBUG nova.compute.manager [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Instance network_info: |[{"id": "83625d0a-3bdb-41a2-8694-e65a9e0aaea1", "address": "fa:16:3e:23:4a:24", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83625d0a-3b", "ovs_interfaceid": "83625d0a-3bdb-41a2-8694-e65a9e0aaea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:36:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f7414b8e-ed2a-4569-926a-4d253a54b2d4 req-fb21669d-4475-4554-bc05-9f806c70f91c service nova] Acquired lock "refresh_cache-9e433454-d767-45fc-b45d-a1d39ee62bd6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:36:09 user nova-compute[74821]: DEBUG nova.network.neutron [req-f7414b8e-ed2a-4569-926a-4d253a54b2d4 req-fb21669d-4475-4554-bc05-9f806c70f91c service nova] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Refreshing network info cache for port 83625d0a-3bdb-41a2-8694-e65a9e0aaea1 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:36:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:09 user nova-compute[74821]: DEBUG nova.network.neutron [req-f7414b8e-ed2a-4569-926a-4d253a54b2d4 req-fb21669d-4475-4554-bc05-9f806c70f91c service nova] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Updated VIF entry in instance network info cache for port 83625d0a-3bdb-41a2-8694-e65a9e0aaea1. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:36:09 user nova-compute[74821]: DEBUG nova.network.neutron [req-f7414b8e-ed2a-4569-926a-4d253a54b2d4 req-fb21669d-4475-4554-bc05-9f806c70f91c service nova] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Updating instance_info_cache with network_info: [{"id": "83625d0a-3bdb-41a2-8694-e65a9e0aaea1", "address": "fa:16:3e:23:4a:24", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83625d0a-3b", "ovs_interfaceid": "83625d0a-3bdb-41a2-8694-e65a9e0aaea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:36:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f7414b8e-ed2a-4569-926a-4d253a54b2d4 req-fb21669d-4475-4554-bc05-9f806c70f91c service nova] Releasing lock "refresh_cache-9e433454-d767-45fc-b45d-a1d39ee62bd6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:36:12 user nova-compute[74821]: DEBUG os_brick.utils [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:36:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:36:12 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee2e6b9-c76e-444b-8950-2e142b0273fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:36:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:36:12 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4d3cb4-0d5b-4935-bee6-a3fec9952469]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:36:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:36:12 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed314e9e-43e0-4d4b-8768-ea13df1dca3c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:36:12 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb28568-013b-4134-b41b-5635d8d198bb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:36:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:36:12 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:36:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:36:12 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:36:12 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[05859f88-9120-4ff2-ad28-6c897a419a12]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:36:12 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:36:12 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:36:12 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:36:12 user nova-compute[74821]: DEBUG os_brick.utils [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:36:12 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Updating existing volume attachment record: 3fb73d57-ad86-4f37-beb9-867f790cc288 {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:36:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:14 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d2934159-4236-4bba-bdcc-be2c4817cdd5 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "1290bdb3-827f-4365-a4f1-4ae063de780d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:36:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d2934159-4236-4bba-bdcc-be2c4817cdd5 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "1290bdb3-827f-4365-a4f1-4ae063de780d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:36:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d2934159-4236-4bba-bdcc-be2c4817cdd5 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "1290bdb3-827f-4365-a4f1-4ae063de780d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:36:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d2934159-4236-4bba-bdcc-be2c4817cdd5 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "1290bdb3-827f-4365-a4f1-4ae063de780d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:36:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d2934159-4236-4bba-bdcc-be2c4817cdd5 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "1290bdb3-827f-4365-a4f1-4ae063de780d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:36:18 user nova-compute[74821]: INFO nova.compute.manager [None req-d2934159-4236-4bba-bdcc-be2c4817cdd5 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Terminating instance
Nov 06 13:36:18 user nova-compute[74821]: DEBUG nova.compute.manager [None req-d2934159-4236-4bba-bdcc-be2c4817cdd5 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:36:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:19 user nova-compute[74821]: DEBUG nova.compute.manager [req-9beb6abc-0980-4a04-9a7f-c3f760702ca3 req-4674ddce-4b52-4871-9e91-27ed9f3184ec service nova] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Received event network-vif-unplugged-289e941f-a075-4d4c-804a-7fe3d666037c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:36:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-9beb6abc-0980-4a04-9a7f-c3f760702ca3 req-4674ddce-4b52-4871-9e91-27ed9f3184ec service nova] Acquiring lock "1290bdb3-827f-4365-a4f1-4ae063de780d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:36:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-9beb6abc-0980-4a04-9a7f-c3f760702ca3 req-4674ddce-4b52-4871-9e91-27ed9f3184ec service nova] Lock "1290bdb3-827f-4365-a4f1-4ae063de780d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:36:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-9beb6abc-0980-4a04-9a7f-c3f760702ca3 req-4674ddce-4b52-4871-9e91-27ed9f3184ec service nova] Lock "1290bdb3-827f-4365-a4f1-4ae063de780d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:36:19 user nova-compute[74821]: DEBUG nova.compute.manager [req-9beb6abc-0980-4a04-9a7f-c3f760702ca3 req-4674ddce-4b52-4871-9e91-27ed9f3184ec service nova] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] No waiting events found dispatching network-vif-unplugged-289e941f-a075-4d4c-804a-7fe3d666037c {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:36:19 user nova-compute[74821]: DEBUG nova.compute.manager [req-9beb6abc-0980-4a04-9a7f-c3f760702ca3 req-4674ddce-4b52-4871-9e91-27ed9f3184ec service nova] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Received event network-vif-unplugged-289e941f-a075-4d4c-804a-7fe3d666037c for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:36:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:19 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Instance destroyed successfully.
Nov 06 13:36:19 user nova-compute[74821]: DEBUG nova.objects.instance [None req-d2934159-4236-4bba-bdcc-be2c4817cdd5 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lazy-loading 'resources' on Instance uuid 1290bdb3-827f-4365-a4f1-4ae063de780d {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:36:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:19 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-d2934159-4236-4bba-bdcc-be2c4817cdd5 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:25:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1082951085',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1082951085',id=28,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:25:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f745a322931e4150b12d139bfb17b94c',ramdisk_id='',reservation_id='r-taz4lj5q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1064633830',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:27:11Z,user_data=None,user_id='133932d1063241078d84731624e89216',uuid=1290bdb3-827f-4365-a4f1-4ae063de780d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "289e941f-a075-4d4c-804a-7fe3d666037c", "address": "fa:16:3e:be:ab:5c", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap289e941f-a0", "ovs_interfaceid": "289e941f-a075-4d4c-804a-7fe3d666037c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:36:19 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-d2934159-4236-4bba-bdcc-be2c4817cdd5 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Converting VIF {"id": "289e941f-a075-4d4c-804a-7fe3d666037c", "address": "fa:16:3e:be:ab:5c", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap289e941f-a0", "ovs_interfaceid": "289e941f-a075-4d4c-804a-7fe3d666037c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:36:19 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-d2934159-4236-4bba-bdcc-be2c4817cdd5 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:ab:5c,bridge_name='br-int',has_traffic_filtering=True,id=289e941f-a075-4d4c-804a-7fe3d666037c,network=Network(354bf335-0cac-46d9-acb8-5095411f5db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap289e941f-a0') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:36:19 user nova-compute[74821]: DEBUG os_vif [None req-d2934159-4236-4bba-bdcc-be2c4817cdd5 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:ab:5c,bridge_name='br-int',has_traffic_filtering=True,id=289e941f-a075-4d4c-804a-7fe3d666037c,network=Network(354bf335-0cac-46d9-acb8-5095411f5db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap289e941f-a0') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:36:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap289e941f-a0, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:36:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:36:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=246a633a-fc7a-4b4b-bfbd-31d6440b4323) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:36:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:36:19 user nova-compute[74821]: INFO os_vif [None req-d2934159-4236-4bba-bdcc-be2c4817cdd5 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:ab:5c,bridge_name='br-int',has_traffic_filtering=True,id=289e941f-a075-4d4c-804a-7fe3d666037c,network=Network(354bf335-0cac-46d9-acb8-5095411f5db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap289e941f-a0')
Nov 06 13:36:19 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-d2934159-4236-4bba-bdcc-be2c4817cdd5 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Deleting instance files /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d_del
Nov 06 13:36:19 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-d2934159-4236-4bba-bdcc-be2c4817cdd5 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Deletion of /opt/stack/data/nova/instances/1290bdb3-827f-4365-a4f1-4ae063de780d_del complete
Nov 06 13:36:19 user nova-compute[74821]: INFO nova.compute.manager [None req-d2934159-4236-4bba-bdcc-be2c4817cdd5 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 06 13:36:19 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-d2934159-4236-4bba-bdcc-be2c4817cdd5 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:36:19 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:36:19 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:36:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:20 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:20 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:36:20 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Took 0.61 seconds to deallocate network for instance.
Nov 06 13:36:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d2934159-4236-4bba-bdcc-be2c4817cdd5 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:36:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d2934159-4236-4bba-bdcc-be2c4817cdd5 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:36:20 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-d2934159-4236-4bba-bdcc-be2c4817cdd5 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:36:20 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-d2934159-4236-4bba-bdcc-be2c4817cdd5 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:36:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d2934159-4236-4bba-bdcc-be2c4817cdd5 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.386s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:36:20 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-d2934159-4236-4bba-bdcc-be2c4817cdd5 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Deleted allocations for instance 1290bdb3-827f-4365-a4f1-4ae063de780d
Nov 06 13:36:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d2934159-4236-4bba-bdcc-be2c4817cdd5 tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "1290bdb3-827f-4365-a4f1-4ae063de780d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.334s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:36:21 user nova-compute[74821]: DEBUG nova.compute.manager [req-f4ef1c6d-2654-4289-92a8-1bff01f735d8 req-df61fc02-3e5a-4ca4-a678-09bda1d757ba service nova] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Received event network-vif-plugged-289e941f-a075-4d4c-804a-7fe3d666037c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:36:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f4ef1c6d-2654-4289-92a8-1bff01f735d8 req-df61fc02-3e5a-4ca4-a678-09bda1d757ba service nova] Acquiring lock "1290bdb3-827f-4365-a4f1-4ae063de780d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:36:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f4ef1c6d-2654-4289-92a8-1bff01f735d8 req-df61fc02-3e5a-4ca4-a678-09bda1d757ba service nova] Lock "1290bdb3-827f-4365-a4f1-4ae063de780d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:36:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f4ef1c6d-2654-4289-92a8-1bff01f735d8 req-df61fc02-3e5a-4ca4-a678-09bda1d757ba service nova] Lock "1290bdb3-827f-4365-a4f1-4ae063de780d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:36:21 user nova-compute[74821]: DEBUG nova.compute.manager [req-f4ef1c6d-2654-4289-92a8-1bff01f735d8 req-df61fc02-3e5a-4ca4-a678-09bda1d757ba service nova] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] No waiting events found dispatching network-vif-plugged-289e941f-a075-4d4c-804a-7fe3d666037c {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:36:21 user nova-compute[74821]: WARNING nova.compute.manager [req-f4ef1c6d-2654-4289-92a8-1bff01f735d8 req-df61fc02-3e5a-4ca4-a678-09bda1d757ba service nova] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Received unexpected event network-vif-plugged-289e941f-a075-4d4c-804a-7fe3d666037c for instance with vm_state deleted and task_state None.
Nov 06 13:36:21 user nova-compute[74821]: DEBUG nova.compute.manager [req-f4ef1c6d-2654-4289-92a8-1bff01f735d8 req-df61fc02-3e5a-4ca4-a678-09bda1d757ba service nova] [instance: 1290bdb3-827f-4365-a4f1-4ae063de780d] Received event network-vif-deleted-289e941f-a075-4d4c-804a-7fe3d666037c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:36:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d846ad16-e320-44ef-a091-5ab762cba089 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "2de346cb-9858-47b8-a86c-4fde720d6127" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:36:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d846ad16-e320-44ef-a091-5ab762cba089 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "2de346cb-9858-47b8-a86c-4fde720d6127" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:36:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d846ad16-e320-44ef-a091-5ab762cba089 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "2de346cb-9858-47b8-a86c-4fde720d6127-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:36:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d846ad16-e320-44ef-a091-5ab762cba089 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "2de346cb-9858-47b8-a86c-4fde720d6127-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:36:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d846ad16-e320-44ef-a091-5ab762cba089 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "2de346cb-9858-47b8-a86c-4fde720d6127-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:36:22 user nova-compute[74821]: INFO nova.compute.manager [None req-d846ad16-e320-44ef-a091-5ab762cba089 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Terminating instance
Nov 06 13:36:22 user nova-compute[74821]: DEBUG nova.compute.manager [None req-d846ad16-e320-44ef-a091-5ab762cba089 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:36:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:22 user nova-compute[74821]: DEBUG nova.compute.manager [req-b6ecafa2-afb1-4df3-881f-0f0291942f55 req-7d5d2d7e-8073-41bf-89a0-c592b35ef220 service nova] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Received event network-vif-unplugged-364b4308-8730-4b11-90a1-48ea6ab3de60 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:36:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b6ecafa2-afb1-4df3-881f-0f0291942f55 req-7d5d2d7e-8073-41bf-89a0-c592b35ef220 service nova] Acquiring lock "2de346cb-9858-47b8-a86c-4fde720d6127-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:36:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b6ecafa2-afb1-4df3-881f-0f0291942f55 req-7d5d2d7e-8073-41bf-89a0-c592b35ef220 service nova] Lock "2de346cb-9858-47b8-a86c-4fde720d6127-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:36:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b6ecafa2-afb1-4df3-881f-0f0291942f55 req-7d5d2d7e-8073-41bf-89a0-c592b35ef220 service nova] Lock "2de346cb-9858-47b8-a86c-4fde720d6127-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:36:22 user nova-compute[74821]: DEBUG nova.compute.manager [req-b6ecafa2-afb1-4df3-881f-0f0291942f55 req-7d5d2d7e-8073-41bf-89a0-c592b35ef220 service nova] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] No waiting events found dispatching network-vif-unplugged-364b4308-8730-4b11-90a1-48ea6ab3de60 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:36:22 user nova-compute[74821]: DEBUG nova.compute.manager [req-b6ecafa2-afb1-4df3-881f-0f0291942f55 req-7d5d2d7e-8073-41bf-89a0-c592b35ef220 service nova] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Received event network-vif-unplugged-364b4308-8730-4b11-90a1-48ea6ab3de60 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:36:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "2e10922b-fa67-46a7-895b-3f40a40bf23d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:36:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "2e10922b-fa67-46a7-895b-3f40a40bf23d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:36:23 user nova-compute[74821]: DEBUG nova.compute.manager [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:36:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:36:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:36:23 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:36:23 user nova-compute[74821]: INFO nova.compute.claims [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Claim successful on node user
Nov 06 13:36:23 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Instance destroyed successfully.
Nov 06 13:36:23 user nova-compute[74821]: DEBUG nova.objects.instance [None req-d846ad16-e320-44ef-a091-5ab762cba089 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lazy-loading 'resources' on Instance uuid 2de346cb-9858-47b8-a86c-4fde720d6127 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:36:23 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-d846ad16-e320-44ef-a091-5ab762cba089 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:15:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1598854789',display_name='tempest-ServerActionsTestOtherA-server-1598854789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1598854789',id=14,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4JiUWhVtBLaIMVWmdaDGfPw0zGPPsGUpSPMYouFUdE8U/JVhpnD9HPYPDsmw237Zq0kahTjlP/cerosJ2tVPbLsi+XC2cHQjqtX7zMb9rwN9mSYsloUtu1O3SiQuCuOw==',key_name='tempest-keypair-1142367632',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:16:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77233758870b4fdfbb7ca76829f0f82e',ramdisk_id='',reservation_id='r-78h1l50t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1986828412',owner_user_name='tempest-ServerActionsTestOtherA-1986828412-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:16:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0620d1928d8d434fbe0bc1cdb31a2a89',uuid=2de346cb-9858-47b8-a86c-4fde720d6127,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "364b4308-8730-4b11-90a1-48ea6ab3de60", "address": "fa:16:3e:48:8d:c6", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b4308-87", "ovs_interfaceid": "364b4308-8730-4b11-90a1-48ea6ab3de60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:36:23 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-d846ad16-e320-44ef-a091-5ab762cba089 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Converting VIF {"id": "364b4308-8730-4b11-90a1-48ea6ab3de60", "address": "fa:16:3e:48:8d:c6", "network": {"id": "a3838abe-b3bb-4878-9d5d-eb80a8cf60a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-161494849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77233758870b4fdfbb7ca76829f0f82e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b4308-87", "ovs_interfaceid": "364b4308-8730-4b11-90a1-48ea6ab3de60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:36:23 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-d846ad16-e320-44ef-a091-5ab762cba089 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:8d:c6,bridge_name='br-int',has_traffic_filtering=True,id=364b4308-8730-4b11-90a1-48ea6ab3de60,network=Network(a3838abe-b3bb-4878-9d5d-eb80a8cf60a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap364b4308-87') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:36:23 user nova-compute[74821]: DEBUG os_vif [None req-d846ad16-e320-44ef-a091-5ab762cba089 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:8d:c6,bridge_name='br-int',has_traffic_filtering=True,id=364b4308-8730-4b11-90a1-48ea6ab3de60,network=Network(a3838abe-b3bb-4878-9d5d-eb80a8cf60a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap364b4308-87') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:36:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap364b4308-87, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:36:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:36:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c6fdf81c-c61e-4348-931f-402a8cb9a874) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:36:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:36:23 user nova-compute[74821]: INFO os_vif [None req-d846ad16-e320-44ef-a091-5ab762cba089 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:8d:c6,bridge_name='br-int',has_traffic_filtering=True,id=364b4308-8730-4b11-90a1-48ea6ab3de60,network=Network(a3838abe-b3bb-4878-9d5d-eb80a8cf60a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap364b4308-87')
Nov 06 13:36:23 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-d846ad16-e320-44ef-a091-5ab762cba089 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Deleting instance files /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127_del
Nov 06 13:36:23 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-d846ad16-e320-44ef-a091-5ab762cba089 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Deletion of /opt/stack/data/nova/instances/2de346cb-9858-47b8-a86c-4fde720d6127_del complete
Nov 06 13:36:23 user nova-compute[74821]: INFO nova.compute.manager [None req-d846ad16-e320-44ef-a091-5ab762cba089 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 06 13:36:23 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-d846ad16-e320-44ef-a091-5ab762cba089 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:36:23 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:36:23 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:36:23 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:36:23 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:36:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.353s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:36:23 user nova-compute[74821]: DEBUG nova.compute.manager [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:36:23 user nova-compute[74821]: DEBUG nova.compute.manager [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:36:23 user nova-compute[74821]: DEBUG nova.network.neutron [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:36:23 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:36:23 user nova-compute[74821]: DEBUG nova.compute.manager [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:36:23 user nova-compute[74821]: DEBUG nova.compute.manager [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:36:23 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:36:23 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Creating image(s)
Nov 06 13:36:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e10922b-fa67-46a7-895b-3f40a40bf23d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:36:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "/opt/stack/data/nova/instances/2e10922b-fa67-46a7-895b-3f40a40bf23d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:36:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "/opt/stack/data/nova/instances/2e10922b-fa67-46a7-895b-3f40a40bf23d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:36:23 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:23 user nova-compute[74821]: DEBUG nova.policy [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5ffddfc972374f6aa7d81288d34690cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6d2ded0b1d4af09f1e05582bcbd3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:36:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.205s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:36:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:36:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:36:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.198s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:36:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/2e10922b-fa67-46a7-895b-3f40a40bf23d/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:24 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:36:24 user nova-compute[74821]: DEBUG nova.compute.manager [req-ae66c403-eac6-4bd4-a408-c97ad4db6ddd req-8caa7123-bcd8-4253-bf95-42b76a1217d3 service nova] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Received event network-vif-deleted-364b4308-8730-4b11-90a1-48ea6ab3de60 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:36:24 user nova-compute[74821]: INFO nova.compute.manager [req-ae66c403-eac6-4bd4-a408-c97ad4db6ddd req-8caa7123-bcd8-4253-bf95-42b76a1217d3 service nova] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Neutron deleted interface 364b4308-8730-4b11-90a1-48ea6ab3de60; detaching it from the instance and deleting it from the info cache
Nov 06 13:36:24 user nova-compute[74821]: DEBUG nova.network.neutron [req-ae66c403-eac6-4bd4-a408-c97ad4db6ddd req-8caa7123-bcd8-4253-bf95-42b76a1217d3 service nova] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:36:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/2e10922b-fa67-46a7-895b-3f40a40bf23d/disk 1073741824" returned: 0 in 0.072s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:36:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:36:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:24 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Took 0.99 seconds to deallocate network for instance.
Nov 06 13:36:24 user nova-compute[74821]: DEBUG nova.compute.manager [req-ae66c403-eac6-4bd4-a408-c97ad4db6ddd req-8caa7123-bcd8-4253-bf95-42b76a1217d3 service nova] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Detach interface failed, port_id=364b4308-8730-4b11-90a1-48ea6ab3de60, reason: Instance 2de346cb-9858-47b8-a86c-4fde720d6127 could not be found. {{(pid=74821) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 13:36:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d846ad16-e320-44ef-a091-5ab762cba089 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:36:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d846ad16-e320-44ef-a091-5ab762cba089 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:36:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.184s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:36:24 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e10922b-fa67-46a7-895b-3f40a40bf23d/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:36:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e10922b-fa67-46a7-895b-3f40a40bf23d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e10922b-fa67-46a7-895b-3f40a40bf23d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:36:24 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Cannot resize image /opt/stack/data/nova/instances/2e10922b-fa67-46a7-895b-3f40a40bf23d/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:36:24 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:36:24 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Ensure instance console log exists: /opt/stack/data/nova/instances/2e10922b-fa67-46a7-895b-3f40a40bf23d/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:36:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:36:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:36:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:36:24 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-d846ad16-e320-44ef-a091-5ab762cba089 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:36:24 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-d846ad16-e320-44ef-a091-5ab762cba089 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:36:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d846ad16-e320-44ef-a091-5ab762cba089 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:36:24 user nova-compute[74821]: DEBUG nova.network.neutron [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Successfully created port: 8f5441a4-a58c-4219-863d-8130491f403b {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:36:24 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-d846ad16-e320-44ef-a091-5ab762cba089 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Deleted allocations for instance 2de346cb-9858-47b8-a86c-4fde720d6127
Nov 06 13:36:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d846ad16-e320-44ef-a091-5ab762cba089 tempest-ServerActionsTestOtherA-1986828412 tempest-ServerActionsTestOtherA-1986828412-project-member] Lock "2de346cb-9858-47b8-a86c-4fde720d6127" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.611s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:36:24 user nova-compute[74821]: DEBUG nova.compute.manager [req-c8bb54c9-48ec-48f6-89e5-fc6952205e61 req-a0b4d8c5-8c7c-47c4-8837-aec8e4c1718f service nova] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Received event network-vif-plugged-364b4308-8730-4b11-90a1-48ea6ab3de60 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:36:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c8bb54c9-48ec-48f6-89e5-fc6952205e61 req-a0b4d8c5-8c7c-47c4-8837-aec8e4c1718f service nova] Acquiring lock "2de346cb-9858-47b8-a86c-4fde720d6127-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:36:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c8bb54c9-48ec-48f6-89e5-fc6952205e61 req-a0b4d8c5-8c7c-47c4-8837-aec8e4c1718f service nova] Lock "2de346cb-9858-47b8-a86c-4fde720d6127-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:36:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c8bb54c9-48ec-48f6-89e5-fc6952205e61 req-a0b4d8c5-8c7c-47c4-8837-aec8e4c1718f service nova] Lock "2de346cb-9858-47b8-a86c-4fde720d6127-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:36:24 user nova-compute[74821]: DEBUG nova.compute.manager [req-c8bb54c9-48ec-48f6-89e5-fc6952205e61 req-a0b4d8c5-8c7c-47c4-8837-aec8e4c1718f service nova] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] No waiting events found dispatching network-vif-plugged-364b4308-8730-4b11-90a1-48ea6ab3de60 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:36:24 user nova-compute[74821]: WARNING nova.compute.manager [req-c8bb54c9-48ec-48f6-89e5-fc6952205e61 req-a0b4d8c5-8c7c-47c4-8837-aec8e4c1718f service nova] [instance: 2de346cb-9858-47b8-a86c-4fde720d6127] Received unexpected event network-vif-plugged-364b4308-8730-4b11-90a1-48ea6ab3de60 for instance with vm_state deleted and task_state None.
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.network.neutron [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Successfully updated port: 8f5441a4-a58c-4219-863d-8130491f403b {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "refresh_cache-2e10922b-fa67-46a7-895b-3f40a40bf23d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquired lock "refresh_cache-2e10922b-fa67-46a7-895b-3f40a40bf23d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.network.neutron [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.network.neutron [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.compute.manager [req-aac00592-dfb5-45de-bfdc-6afa50785a2e req-f7d29ff0-e7ea-4b98-b60c-e5f7d5eee518 service nova] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Received event network-changed-8f5441a4-a58c-4219-863d-8130491f403b {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.compute.manager [req-aac00592-dfb5-45de-bfdc-6afa50785a2e req-f7d29ff0-e7ea-4b98-b60c-e5f7d5eee518 service nova] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Refreshing instance network info cache due to event network-changed-8f5441a4-a58c-4219-863d-8130491f403b. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-aac00592-dfb5-45de-bfdc-6afa50785a2e req-f7d29ff0-e7ea-4b98-b60c-e5f7d5eee518 service nova] Acquiring lock "refresh_cache-2e10922b-fa67-46a7-895b-3f40a40bf23d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.network.neutron [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Updating instance_info_cache with network_info: [{"id": "8f5441a4-a58c-4219-863d-8130491f403b", "address": "fa:16:3e:9d:bc:6f", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f5441a4-a5", "ovs_interfaceid": "8f5441a4-a58c-4219-863d-8130491f403b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Releasing lock "refresh_cache-2e10922b-fa67-46a7-895b-3f40a40bf23d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Instance network_info: |[{"id": "8f5441a4-a58c-4219-863d-8130491f403b", "address": "fa:16:3e:9d:bc:6f", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f5441a4-a5", "ovs_interfaceid": "8f5441a4-a58c-4219-863d-8130491f403b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-aac00592-dfb5-45de-bfdc-6afa50785a2e req-f7d29ff0-e7ea-4b98-b60c-e5f7d5eee518 service nova] Acquired lock "refresh_cache-2e10922b-fa67-46a7-895b-3f40a40bf23d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.network.neutron [req-aac00592-dfb5-45de-bfdc-6afa50785a2e req-f7d29ff0-e7ea-4b98-b60c-e5f7d5eee518 service nova] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Refreshing network info cache for port 8f5441a4-a58c-4219-863d-8130491f403b {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Start _get_guest_xml network_info=[{"id": "8f5441a4-a58c-4219-863d-8130491f403b", "address": "fa:16:3e:9d:bc:6f", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f5441a4-a5", "ovs_interfaceid": "8f5441a4-a58c-4219-863d-8130491f403b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:36:26 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:36:26 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:36:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2020946681',display_name='tempest-AttachVolumeNegativeTest-server-2020946681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2020946681',id=42,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZJjBw2TFtMYdIk8jRkD2eHhoqvtH+yc4HejhRw1RpK8+1oQ8a9aL4WGrwjddk3kjtNeUyuUirH/H2gwpUawcUrEAVxbGwu48jIpyitaOVpoHO7wfUTbe1H4xR0QVGPeg==',key_name='tempest-keypair-1358561599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c6d2ded0b1d4af09f1e05582bcbd3ae',ramdisk_id='',reservation_id='r-v8qyv8yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1164383705',owner_user_name='tempest-AttachVolumeNegativeTest-1164383705-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:36:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ffddfc972374f6aa7d81288d34690cf',uuid=2e10922b-fa67-46a7-895b-3f40a40bf23d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f5441a4-a58c-4219-863d-8130491f403b", "address": "fa:16:3e:9d:bc:6f", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f5441a4-a5", "ovs_interfaceid": "8f5441a4-a58c-4219-863d-8130491f403b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Converting VIF {"id": "8f5441a4-a58c-4219-863d-8130491f403b", "address": "fa:16:3e:9d:bc:6f", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f5441a4-a5", "ovs_interfaceid": "8f5441a4-a58c-4219-863d-8130491f403b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:bc:6f,bridge_name='br-int',has_traffic_filtering=True,id=8f5441a4-a58c-4219-863d-8130491f403b,network=Network(3e1f6a20-5316-4c49-93a5-deabb70d8608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f5441a4-a5') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.objects.instance [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e10922b-fa67-46a7-895b-3f40a40bf23d {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:36:26 user nova-compute[74821]:   <uuid>2e10922b-fa67-46a7-895b-3f40a40bf23d</uuid>
Nov 06 13:36:26 user nova-compute[74821]:   <name>instance-0000002a</name>
Nov 06 13:36:26 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:36:26 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:36:26 user nova-compute[74821]:   <metadata>
Nov 06 13:36:26 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:36:26 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:36:26 user nova-compute[74821]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2020946681</nova:name>
Nov 06 13:36:26 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:36:26</nova:creationTime>
Nov 06 13:36:26 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:36:26 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:36:26 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:36:26 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:36:26 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:36:26 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:36:26 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:36:26 user nova-compute[74821]:       <nova:owner>
Nov 06 13:36:26 user nova-compute[74821]:         <nova:user uuid="5ffddfc972374f6aa7d81288d34690cf">tempest-AttachVolumeNegativeTest-1164383705-project-member</nova:user>
Nov 06 13:36:26 user nova-compute[74821]:         <nova:project uuid="4c6d2ded0b1d4af09f1e05582bcbd3ae">tempest-AttachVolumeNegativeTest-1164383705</nova:project>
Nov 06 13:36:26 user nova-compute[74821]:       </nova:owner>
Nov 06 13:36:26 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:36:26 user nova-compute[74821]:       <nova:ports>
Nov 06 13:36:26 user nova-compute[74821]:         <nova:port uuid="8f5441a4-a58c-4219-863d-8130491f403b">
Nov 06 13:36:26 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 13:36:26 user nova-compute[74821]:         </nova:port>
Nov 06 13:36:26 user nova-compute[74821]:       </nova:ports>
Nov 06 13:36:26 user nova-compute[74821]:     </nova:instance>
Nov 06 13:36:26 user nova-compute[74821]:   </metadata>
Nov 06 13:36:26 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:36:26 user nova-compute[74821]:     <system>
Nov 06 13:36:26 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:36:26 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:36:26 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:36:26 user nova-compute[74821]:       <entry name="serial">2e10922b-fa67-46a7-895b-3f40a40bf23d</entry>
Nov 06 13:36:26 user nova-compute[74821]:       <entry name="uuid">2e10922b-fa67-46a7-895b-3f40a40bf23d</entry>
Nov 06 13:36:26 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:36:26 user nova-compute[74821]:     </system>
Nov 06 13:36:26 user nova-compute[74821]:   </sysinfo>
Nov 06 13:36:26 user nova-compute[74821]:   <os>
Nov 06 13:36:26 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:36:26 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:36:26 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:36:26 user nova-compute[74821]:   </os>
Nov 06 13:36:26 user nova-compute[74821]:   <features>
Nov 06 13:36:26 user nova-compute[74821]:     <acpi/>
Nov 06 13:36:26 user nova-compute[74821]:     <apic/>
Nov 06 13:36:26 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:36:26 user nova-compute[74821]:   </features>
Nov 06 13:36:26 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:36:26 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:36:26 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:36:26 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:36:26 user nova-compute[74821]:   </clock>
Nov 06 13:36:26 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:36:26 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:36:26 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:36:26 user nova-compute[74821]:   </cpu>
Nov 06 13:36:26 user nova-compute[74821]:   <devices>
Nov 06 13:36:26 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:36:26 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:36:26 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/2e10922b-fa67-46a7-895b-3f40a40bf23d/disk"/>
Nov 06 13:36:26 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:36:26 user nova-compute[74821]:     </disk>
Nov 06 13:36:26 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:36:26 user nova-compute[74821]:       <mac address="fa:16:3e:9d:bc:6f"/>
Nov 06 13:36:26 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:36:26 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:36:26 user nova-compute[74821]:       <target dev="tap8f5441a4-a5"/>
Nov 06 13:36:26 user nova-compute[74821]:     </interface>
Nov 06 13:36:26 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:36:26 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/2e10922b-fa67-46a7-895b-3f40a40bf23d/console.log" append="off"/>
Nov 06 13:36:26 user nova-compute[74821]:     </serial>
Nov 06 13:36:26 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:36:26 user nova-compute[74821]:     <video>
Nov 06 13:36:26 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:36:26 user nova-compute[74821]:     </video>
Nov 06 13:36:26 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:36:26 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:36:26 user nova-compute[74821]:     </rng>
Nov 06 13:36:26 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:36:26 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:36:26 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:36:26 user nova-compute[74821]:     </memballoon>
Nov 06 13:36:26 user nova-compute[74821]:   </devices>
Nov 06 13:36:26 user nova-compute[74821]: </domain>
Nov 06 13:36:26 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:36:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2020946681',display_name='tempest-AttachVolumeNegativeTest-server-2020946681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2020946681',id=42,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZJjBw2TFtMYdIk8jRkD2eHhoqvtH+yc4HejhRw1RpK8+1oQ8a9aL4WGrwjddk3kjtNeUyuUirH/H2gwpUawcUrEAVxbGwu48jIpyitaOVpoHO7wfUTbe1H4xR0QVGPeg==',key_name='tempest-keypair-1358561599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c6d2ded0b1d4af09f1e05582bcbd3ae',ramdisk_id='',reservation_id='r-v8qyv8yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1164383705',owner_user_name='tempest-AttachVolumeNegativeTest-1164383705-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:36:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ffddfc972374f6aa7d81288d34690cf',uuid=2e10922b-fa67-46a7-895b-3f40a40bf23d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f5441a4-a58c-4219-863d-8130491f403b", "address": "fa:16:3e:9d:bc:6f", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f5441a4-a5", "ovs_interfaceid": "8f5441a4-a58c-4219-863d-8130491f403b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Converting VIF {"id": "8f5441a4-a58c-4219-863d-8130491f403b", "address": "fa:16:3e:9d:bc:6f", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f5441a4-a5", "ovs_interfaceid": "8f5441a4-a58c-4219-863d-8130491f403b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:bc:6f,bridge_name='br-int',has_traffic_filtering=True,id=8f5441a4-a58c-4219-863d-8130491f403b,network=Network(3e1f6a20-5316-4c49-93a5-deabb70d8608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f5441a4-a5') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG os_vif [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:bc:6f,bridge_name='br-int',has_traffic_filtering=True,id=8f5441a4-a58c-4219-863d-8130491f403b,network=Network(3e1f6a20-5316-4c49-93a5-deabb70d8608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f5441a4-a5') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '01920883-b4cb-5471-834b-b816022d77f7', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f5441a4-a5, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f5441a4-a5, col_values=(('qos', UUID('6b99494a-8a4c-4241-8dbc-8f2f831d3770')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f5441a4-a5, col_values=(('external_ids', {'iface-id': '8f5441a4-a58c-4219-863d-8130491f403b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:bc:6f', 'vm-uuid': '2e10922b-fa67-46a7-895b-3f40a40bf23d'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:26 user nova-compute[74821]: INFO os_vif [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:bc:6f,bridge_name='br-int',has_traffic_filtering=True,id=8f5441a4-a58c-4219-863d-8130491f403b,network=Network(3e1f6a20-5316-4c49-93a5-deabb70d8608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f5441a4-a5')
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] No VIF found with MAC fa:16:3e:9d:bc:6f, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.network.neutron [req-aac00592-dfb5-45de-bfdc-6afa50785a2e req-f7d29ff0-e7ea-4b98-b60c-e5f7d5eee518 service nova] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Updated VIF entry in instance network info cache for port 8f5441a4-a58c-4219-863d-8130491f403b. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG nova.network.neutron [req-aac00592-dfb5-45de-bfdc-6afa50785a2e req-f7d29ff0-e7ea-4b98-b60c-e5f7d5eee518 service nova] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Updating instance_info_cache with network_info: [{"id": "8f5441a4-a58c-4219-863d-8130491f403b", "address": "fa:16:3e:9d:bc:6f", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f5441a4-a5", "ovs_interfaceid": "8f5441a4-a58c-4219-863d-8130491f403b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:36:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-aac00592-dfb5-45de-bfdc-6afa50785a2e req-f7d29ff0-e7ea-4b98-b60c-e5f7d5eee518 service nova] Releasing lock "refresh_cache-2e10922b-fa67-46a7-895b-3f40a40bf23d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:36:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:28 user nova-compute[74821]: DEBUG nova.compute.manager [req-7e202209-5905-423f-b42f-9fce15523760 req-7e60be10-e2f9-46c2-a9b6-b430620cefff service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Received event network-changed-30866a49-b7d0-458d-87a6-e97d3c533640 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:36:28 user nova-compute[74821]: DEBUG nova.compute.manager [req-7e202209-5905-423f-b42f-9fce15523760 req-7e60be10-e2f9-46c2-a9b6-b430620cefff service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Refreshing instance network info cache due to event network-changed-30866a49-b7d0-458d-87a6-e97d3c533640. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:36:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-7e202209-5905-423f-b42f-9fce15523760 req-7e60be10-e2f9-46c2-a9b6-b430620cefff service nova] Acquiring lock "refresh_cache-8467fdc8-ec8e-4eda-abbc-b146e58e90c8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:36:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-7e202209-5905-423f-b42f-9fce15523760 req-7e60be10-e2f9-46c2-a9b6-b430620cefff service nova] Acquired lock "refresh_cache-8467fdc8-ec8e-4eda-abbc-b146e58e90c8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:36:28 user nova-compute[74821]: DEBUG nova.network.neutron [req-7e202209-5905-423f-b42f-9fce15523760 req-7e60be10-e2f9-46c2-a9b6-b430620cefff service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Refreshing network info cache for port 30866a49-b7d0-458d-87a6-e97d3c533640 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:36:28 user nova-compute[74821]: DEBUG nova.compute.manager [req-d323b51c-0850-4701-92f2-29e490d17b17 req-ab447d24-bc54-4465-9289-7bfc95d43673 service nova] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Received event network-vif-plugged-8f5441a4-a58c-4219-863d-8130491f403b {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:36:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d323b51c-0850-4701-92f2-29e490d17b17 req-ab447d24-bc54-4465-9289-7bfc95d43673 service nova] Acquiring lock "2e10922b-fa67-46a7-895b-3f40a40bf23d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:36:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d323b51c-0850-4701-92f2-29e490d17b17 req-ab447d24-bc54-4465-9289-7bfc95d43673 service nova] Lock "2e10922b-fa67-46a7-895b-3f40a40bf23d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:36:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d323b51c-0850-4701-92f2-29e490d17b17 req-ab447d24-bc54-4465-9289-7bfc95d43673 service nova] Lock "2e10922b-fa67-46a7-895b-3f40a40bf23d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:36:28 user nova-compute[74821]: DEBUG nova.compute.manager [req-d323b51c-0850-4701-92f2-29e490d17b17 req-ab447d24-bc54-4465-9289-7bfc95d43673 service nova] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] No waiting events found dispatching network-vif-plugged-8f5441a4-a58c-4219-863d-8130491f403b {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:36:28 user nova-compute[74821]: WARNING nova.compute.manager [req-d323b51c-0850-4701-92f2-29e490d17b17 req-ab447d24-bc54-4465-9289-7bfc95d43673 service nova] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Received unexpected event network-vif-plugged-8f5441a4-a58c-4219-863d-8130491f403b for instance with vm_state building and task_state spawning.
Nov 06 13:36:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:28 user nova-compute[74821]: DEBUG nova.network.neutron [req-7e202209-5905-423f-b42f-9fce15523760 req-7e60be10-e2f9-46c2-a9b6-b430620cefff service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Updated VIF entry in instance network info cache for port 30866a49-b7d0-458d-87a6-e97d3c533640. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:36:28 user nova-compute[74821]: DEBUG nova.network.neutron [req-7e202209-5905-423f-b42f-9fce15523760 req-7e60be10-e2f9-46c2-a9b6-b430620cefff service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Updating instance_info_cache with network_info: [{"id": "30866a49-b7d0-458d-87a6-e97d3c533640", "address": "fa:16:3e:7c:2c:c7", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30866a49-b7", "ovs_interfaceid": "30866a49-b7d0-458d-87a6-e97d3c533640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:36:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-7e202209-5905-423f-b42f-9fce15523760 req-7e60be10-e2f9-46c2-a9b6-b430620cefff service nova] Releasing lock "refresh_cache-8467fdc8-ec8e-4eda-abbc-b146e58e90c8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:36:29 user nova-compute[74821]: DEBUG nova.compute.manager [req-08b2f300-eb22-4fcc-96b2-727ce5849833 req-c587e52f-2502-4bc9-9c5c-6ade01ae1968 service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Received event network-changed-30866a49-b7d0-458d-87a6-e97d3c533640 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:36:29 user nova-compute[74821]: DEBUG nova.compute.manager [req-08b2f300-eb22-4fcc-96b2-727ce5849833 req-c587e52f-2502-4bc9-9c5c-6ade01ae1968 service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Refreshing instance network info cache due to event network-changed-30866a49-b7d0-458d-87a6-e97d3c533640. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:36:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-08b2f300-eb22-4fcc-96b2-727ce5849833 req-c587e52f-2502-4bc9-9c5c-6ade01ae1968 service nova] Acquiring lock "refresh_cache-8467fdc8-ec8e-4eda-abbc-b146e58e90c8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:36:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-08b2f300-eb22-4fcc-96b2-727ce5849833 req-c587e52f-2502-4bc9-9c5c-6ade01ae1968 service nova] Acquired lock "refresh_cache-8467fdc8-ec8e-4eda-abbc-b146e58e90c8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:36:29 user nova-compute[74821]: DEBUG nova.network.neutron [req-08b2f300-eb22-4fcc-96b2-727ce5849833 req-c587e52f-2502-4bc9-9c5c-6ade01ae1968 service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Refreshing network info cache for port 30866a49-b7d0-458d-87a6-e97d3c533640 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:36:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:36:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:36:29 user nova-compute[74821]: INFO nova.compute.manager [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Detaching volume c298ae62-e2a0-49f4-a980-e7a04a9b6c13
Nov 06 13:36:29 user nova-compute[74821]: INFO nova.virt.block_device [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Attempting to driver detach volume c298ae62-e2a0-49f4-a980-e7a04a9b6c13 from mountpoint /dev/vdb
Nov 06 13:36:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Attempting to detach device vdb from instance 8467fdc8-ec8e-4eda-abbc-b146e58e90c8 from the persistent domain config. {{(pid=74821) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 13:36:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:36:29 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:36:29 user nova-compute[74821]:   <source dev="/dev/sdg"/>
Nov 06 13:36:29 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:36:29 user nova-compute[74821]:   <serial>c298ae62-e2a0-49f4-a980-e7a04a9b6c13</serial>
Nov 06 13:36:29 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 06 13:36:29 user nova-compute[74821]: </disk>
Nov 06 13:36:29 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:36:29 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Successfully detached device vdb from instance 8467fdc8-ec8e-4eda-abbc-b146e58e90c8 from the persistent domain config.
Nov 06 13:36:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8467fdc8-ec8e-4eda-abbc-b146e58e90c8 from the live domain config. {{(pid=74821) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 13:36:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:36:29 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:36:29 user nova-compute[74821]:   <source dev="/dev/sdg"/>
Nov 06 13:36:29 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:36:29 user nova-compute[74821]:   <serial>c298ae62-e2a0-49f4-a980-e7a04a9b6c13</serial>
Nov 06 13:36:29 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 06 13:36:29 user nova-compute[74821]: </disk>
Nov 06 13:36:29 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:36:29 user nova-compute[74821]: DEBUG nova.network.neutron [req-08b2f300-eb22-4fcc-96b2-727ce5849833 req-c587e52f-2502-4bc9-9c5c-6ade01ae1968 service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Updated VIF entry in instance network info cache for port 30866a49-b7d0-458d-87a6-e97d3c533640. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:36:29 user nova-compute[74821]: DEBUG nova.network.neutron [req-08b2f300-eb22-4fcc-96b2-727ce5849833 req-c587e52f-2502-4bc9-9c5c-6ade01ae1968 service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Updating instance_info_cache with network_info: [{"id": "30866a49-b7d0-458d-87a6-e97d3c533640", "address": "fa:16:3e:7c:2c:c7", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30866a49-b7", "ovs_interfaceid": "30866a49-b7d0-458d-87a6-e97d3c533640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:36:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-08b2f300-eb22-4fcc-96b2-727ce5849833 req-c587e52f-2502-4bc9-9c5c-6ade01ae1968 service nova] Releasing lock "refresh_cache-8467fdc8-ec8e-4eda-abbc-b146e58e90c8" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:36:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:30 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8467fdc8-ec8e-4eda-abbc-b146e58e90c8 {{(pid=74821) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 13:36:30 user nova-compute[74821]: DEBUG nova.compute.manager [req-44eab1d5-e99b-411a-af8c-9be55433d66f req-f43a558e-e63d-4656-9bf9-91c3e71de487 service nova] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Received event network-vif-plugged-8f5441a4-a58c-4219-863d-8130491f403b {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:36:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-44eab1d5-e99b-411a-af8c-9be55433d66f req-f43a558e-e63d-4656-9bf9-91c3e71de487 service nova] Acquiring lock "2e10922b-fa67-46a7-895b-3f40a40bf23d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:36:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-44eab1d5-e99b-411a-af8c-9be55433d66f req-f43a558e-e63d-4656-9bf9-91c3e71de487 service nova] Lock "2e10922b-fa67-46a7-895b-3f40a40bf23d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:36:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-44eab1d5-e99b-411a-af8c-9be55433d66f req-f43a558e-e63d-4656-9bf9-91c3e71de487 service nova] Lock "2e10922b-fa67-46a7-895b-3f40a40bf23d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:36:30 user nova-compute[74821]: DEBUG nova.compute.manager [req-44eab1d5-e99b-411a-af8c-9be55433d66f req-f43a558e-e63d-4656-9bf9-91c3e71de487 service nova] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] No waiting events found dispatching network-vif-plugged-8f5441a4-a58c-4219-863d-8130491f403b {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:36:30 user nova-compute[74821]: WARNING nova.compute.manager [req-44eab1d5-e99b-411a-af8c-9be55433d66f req-f43a558e-e63d-4656-9bf9-91c3e71de487 service nova] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Received unexpected event network-vif-plugged-8f5441a4-a58c-4219-863d-8130491f403b for instance with vm_state building and task_state spawning.
Nov 06 13:36:30 user nova-compute[74821]: DEBUG nova.compute.manager [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:36:30 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:36:30 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Instance spawned successfully.
Nov 06 13:36:30 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:36:30 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:36:30 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:36:30 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:36:30 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:36:30 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:36:30 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:36:30 user nova-compute[74821]: INFO nova.compute.manager [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Took 6.80 seconds to spawn the instance on the hypervisor.
Nov 06 13:36:30 user nova-compute[74821]: DEBUG nova.compute.manager [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:36:30 user nova-compute[74821]: INFO nova.compute.manager [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Took 7.50 seconds to build instance.
Nov 06 13:36:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7f29e74a-955a-428a-b4e0-c2b26b7ba578 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "2e10922b-fa67-46a7-895b-3f40a40bf23d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.615s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:36:31 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG nova.compute.manager [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:36:36 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Creating image(s)
Nov 06 13:36:36 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Did not create local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Ensure instance console log exists: /opt/stack/data/nova/instances/9e433454-d767-45fc-b45d-a1d39ee62bd6/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Start _get_guest_xml network_info=[{"id": "83625d0a-3bdb-41a2-8694-e65a9e0aaea1", "address": "fa:16:3e:23:4a:24", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83625d0a-3b", "ovs_interfaceid": "83625d0a-3bdb-41a2-8694-e65a9e0aaea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uwLJzhUA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9e433454-d767-45fc-b45d-a1d39ee62bd6', 'attached_at': '', 'detached_at': '', 'volume_id': '2c1819c2-2270-4762-ae03-e349c168c97d', 'serial': '2c1819c2-2270-4762-ae03-e349c168c97d'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '3fb73d57-ad86-4f37-beb9-867f790cc288', 'volume_type': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:36:36 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:36:36 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:36:36 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uwLJzhUA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:36:36 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:36:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:36:36 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:36:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:36:36 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:36:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a792880-b12d-45eb-99e8-cc69c700dc92]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:36:36 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fab1f5-6ecc-4b6f-9ae2-831d74358353]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d] added
Nov 06 13:36:36 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf83f51-f55b-4a65-b02d-d5038297e14c]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[212a3f7e-778a-4d86-9a8b-5a6464d46c9d]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uwLJzhUA {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uwLJzhUA" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[472cf234-1ca2-40b7-85dc-292bef637a90]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uwLJzhUA'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c076bf4c-47d5-441f-b8c7-f9c1d18ef60a]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8345db-2fbf-4480-b48e-7d799a8f2a67]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:36:36 user nova-compute[74821]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 (non-flash)
Nov 06 13:36:36 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:36:36 user nova-compute[74821]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 (non-flash)
Nov 06 13:36:36 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5f467d-8526-4664-9769-7fbadca905a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d, portal: 172.16.0.220,3260]
Nov 06 13:36:36 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d, portal: 172.16.0.220,3260] successful.
Nov 06 13:36:36 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:36:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:36:37 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d1f008-95ba-480e-b77f-05c59b1024a3]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:36:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:36:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:36:37 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[40450fc1-16dc-4561-9b88-0ff65f71c379]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:36:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:36:37 user nova-compute[74821]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 (non-flash)
Nov 06 13:36:37 user nova-compute[74821]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d (non-flash)
Nov 06 13:36:37 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:36:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:36:37 user nova-compute[74821]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 (non-flash)
Nov 06 13:36:37 user nova-compute[74821]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d (non-flash)
Nov 06 13:36:37 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:36:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:36:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:36:37 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:36:37 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:36:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:37 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:36:37 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1c0318-8707-49d7-bdea-6ff348725ccb]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:36:37 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:36:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uwLJzhUA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:36:38 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:36:38 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26638353962363530', 'path': '/dev/sdb'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:36:38 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638353962363530', 'path': '/dev/sdb'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:36:38 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:36:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-294954111',display_name='tempest-TestVolumeBootPattern-server-294954111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-294954111',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c8e811a3a30417a8dc6ccad03f2f8e0',ramdisk_id='',reservation_id='r-a1s7w5hl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1930796442',owner_user_name='tempest-TestVolumeBootPattern-1930796442-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:36:07Z,user_data=None,user_id='3bb6a168d90a4795a72b8ac69eeadcc9',uuid=9e433454-d767-45fc-b45d-a1d39ee62bd6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83625d0a-3bdb-41a2-8694-e65a9e0aaea1", "address": "fa:16:3e:23:4a:24", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83625d0a-3b", "ovs_interfaceid": "83625d0a-3bdb-41a2-8694-e65a9e0aaea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:36:38 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Converting VIF {"id": "83625d0a-3bdb-41a2-8694-e65a9e0aaea1", "address": "fa:16:3e:23:4a:24", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83625d0a-3b", "ovs_interfaceid": "83625d0a-3bdb-41a2-8694-e65a9e0aaea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:36:38 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:4a:24,bridge_name='br-int',has_traffic_filtering=True,id=83625d0a-3bdb-41a2-8694-e65a9e0aaea1,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83625d0a-3b') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:36:38 user nova-compute[74821]: DEBUG nova.objects.instance [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e433454-d767-45fc-b45d-a1d39ee62bd6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:36:38 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:36:38 user nova-compute[74821]:   <uuid>9e433454-d767-45fc-b45d-a1d39ee62bd6</uuid>
Nov 06 13:36:38 user nova-compute[74821]:   <name>instance-00000029</name>
Nov 06 13:36:38 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:36:38 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:36:38 user nova-compute[74821]:   <metadata>
Nov 06 13:36:38 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:36:38 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:36:38 user nova-compute[74821]:       <nova:name>tempest-TestVolumeBootPattern-server-294954111</nova:name>
Nov 06 13:36:38 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:36:36</nova:creationTime>
Nov 06 13:36:38 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:36:38 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:36:38 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:36:38 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:36:38 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:36:38 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:36:38 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:36:38 user nova-compute[74821]:       <nova:owner>
Nov 06 13:36:38 user nova-compute[74821]:         <nova:user uuid="3bb6a168d90a4795a72b8ac69eeadcc9">tempest-TestVolumeBootPattern-1930796442-project-member</nova:user>
Nov 06 13:36:38 user nova-compute[74821]:         <nova:project uuid="2c8e811a3a30417a8dc6ccad03f2f8e0">tempest-TestVolumeBootPattern-1930796442</nova:project>
Nov 06 13:36:38 user nova-compute[74821]:       </nova:owner>
Nov 06 13:36:38 user nova-compute[74821]:       <nova:ports>
Nov 06 13:36:38 user nova-compute[74821]:         <nova:port uuid="83625d0a-3bdb-41a2-8694-e65a9e0aaea1">
Nov 06 13:36:38 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 06 13:36:38 user nova-compute[74821]:         </nova:port>
Nov 06 13:36:38 user nova-compute[74821]:       </nova:ports>
Nov 06 13:36:38 user nova-compute[74821]:     </nova:instance>
Nov 06 13:36:38 user nova-compute[74821]:   </metadata>
Nov 06 13:36:38 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:36:38 user nova-compute[74821]:     <system>
Nov 06 13:36:38 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:36:38 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:36:38 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:36:38 user nova-compute[74821]:       <entry name="serial">9e433454-d767-45fc-b45d-a1d39ee62bd6</entry>
Nov 06 13:36:38 user nova-compute[74821]:       <entry name="uuid">9e433454-d767-45fc-b45d-a1d39ee62bd6</entry>
Nov 06 13:36:38 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:36:38 user nova-compute[74821]:     </system>
Nov 06 13:36:38 user nova-compute[74821]:   </sysinfo>
Nov 06 13:36:38 user nova-compute[74821]:   <os>
Nov 06 13:36:38 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:36:38 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:36:38 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:36:38 user nova-compute[74821]:   </os>
Nov 06 13:36:38 user nova-compute[74821]:   <features>
Nov 06 13:36:38 user nova-compute[74821]:     <acpi/>
Nov 06 13:36:38 user nova-compute[74821]:     <apic/>
Nov 06 13:36:38 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:36:38 user nova-compute[74821]:   </features>
Nov 06 13:36:38 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:36:38 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:36:38 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:36:38 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:36:38 user nova-compute[74821]:   </clock>
Nov 06 13:36:38 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:36:38 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:36:38 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:36:38 user nova-compute[74821]:   </cpu>
Nov 06 13:36:38 user nova-compute[74821]:   <devices>
Nov 06 13:36:38 user nova-compute[74821]:     <disk type="block" device="disk">
Nov 06 13:36:38 user nova-compute[74821]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:36:38 user nova-compute[74821]:       <source dev="/dev/sdb"/>
Nov 06 13:36:38 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:36:38 user nova-compute[74821]:       <serial>2c1819c2-2270-4762-ae03-e349c168c97d</serial>
Nov 06 13:36:38 user nova-compute[74821]:     </disk>
Nov 06 13:36:38 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:36:38 user nova-compute[74821]:       <mac address="fa:16:3e:23:4a:24"/>
Nov 06 13:36:38 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:36:38 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:36:38 user nova-compute[74821]:       <target dev="tap83625d0a-3b"/>
Nov 06 13:36:38 user nova-compute[74821]:     </interface>
Nov 06 13:36:38 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:36:38 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/9e433454-d767-45fc-b45d-a1d39ee62bd6/console.log" append="off"/>
Nov 06 13:36:38 user nova-compute[74821]:     </serial>
Nov 06 13:36:38 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:36:38 user nova-compute[74821]:     <video>
Nov 06 13:36:38 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:36:38 user nova-compute[74821]:     </video>
Nov 06 13:36:38 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:36:38 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:36:38 user nova-compute[74821]:     </rng>
Nov 06 13:36:38 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:36:38 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:36:38 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:36:38 user nova-compute[74821]:     </memballoon>
Nov 06 13:36:38 user nova-compute[74821]:   </devices>
Nov 06 13:36:38 user nova-compute[74821]: </domain>
Nov 06 13:36:38 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:36:38 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:36:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-294954111',display_name='tempest-TestVolumeBootPattern-server-294954111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-294954111',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c8e811a3a30417a8dc6ccad03f2f8e0',ramdisk_id='',reservation_id='r-a1s7w5hl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1930796442',owner_user_name='tempest-TestVolumeBootPattern-1930796442-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:36:07Z,user_data=None,user_id='3bb6a168d90a4795a72b8ac69eeadcc9',uuid=9e433454-d767-45fc-b45d-a1d39ee62bd6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83625d0a-3bdb-41a2-8694-e65a9e0aaea1", "address": "fa:16:3e:23:4a:24", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83625d0a-3b", "ovs_interfaceid": "83625d0a-3bdb-41a2-8694-e65a9e0aaea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:36:38 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Converting VIF {"id": "83625d0a-3bdb-41a2-8694-e65a9e0aaea1", "address": "fa:16:3e:23:4a:24", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83625d0a-3b", "ovs_interfaceid": "83625d0a-3bdb-41a2-8694-e65a9e0aaea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:36:38 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:4a:24,bridge_name='br-int',has_traffic_filtering=True,id=83625d0a-3bdb-41a2-8694-e65a9e0aaea1,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83625d0a-3b') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:36:38 user nova-compute[74821]: DEBUG os_vif [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:4a:24,bridge_name='br-int',has_traffic_filtering=True,id=83625d0a-3bdb-41a2-8694-e65a9e0aaea1,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83625d0a-3b') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:36:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:36:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:36:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd0ce243a-4728-5d65-81f0-0deb0995471a', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:36:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:36:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83625d0a-3b, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:36:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap83625d0a-3b, col_values=(('qos', UUID('1bc79bb7-004a-48e5-9c31-f5cbdf614f39')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:36:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap83625d0a-3b, col_values=(('external_ids', {'iface-id': '83625d0a-3bdb-41a2-8694-e65a9e0aaea1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:4a:24', 'vm-uuid': '9e433454-d767-45fc-b45d-a1d39ee62bd6'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:36:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:36:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:38 user nova-compute[74821]: INFO os_vif [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:4a:24,bridge_name='br-int',has_traffic_filtering=True,id=83625d0a-3bdb-41a2-8694-e65a9e0aaea1,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83625d0a-3b')
Nov 06 13:36:38 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:36:38 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] No VIF found with MAC fa:16:3e:23:4a:24, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:36:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:39 user nova-compute[74821]: DEBUG nova.compute.manager [req-d3f9b054-01b6-42eb-8142-d0d64bd40195 req-a549981c-1b42-48be-8533-5b7fb9cc35fd service nova] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Received event network-vif-plugged-83625d0a-3bdb-41a2-8694-e65a9e0aaea1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:36:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d3f9b054-01b6-42eb-8142-d0d64bd40195 req-a549981c-1b42-48be-8533-5b7fb9cc35fd service nova] Acquiring lock "9e433454-d767-45fc-b45d-a1d39ee62bd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:36:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d3f9b054-01b6-42eb-8142-d0d64bd40195 req-a549981c-1b42-48be-8533-5b7fb9cc35fd service nova] Lock "9e433454-d767-45fc-b45d-a1d39ee62bd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:36:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d3f9b054-01b6-42eb-8142-d0d64bd40195 req-a549981c-1b42-48be-8533-5b7fb9cc35fd service nova] Lock "9e433454-d767-45fc-b45d-a1d39ee62bd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:36:39 user nova-compute[74821]: DEBUG nova.compute.manager [req-d3f9b054-01b6-42eb-8142-d0d64bd40195 req-a549981c-1b42-48be-8533-5b7fb9cc35fd service nova] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] No waiting events found dispatching network-vif-plugged-83625d0a-3bdb-41a2-8694-e65a9e0aaea1 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:36:39 user nova-compute[74821]: WARNING nova.compute.manager [req-d3f9b054-01b6-42eb-8142-d0d64bd40195 req-a549981c-1b42-48be-8533-5b7fb9cc35fd service nova] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Received unexpected event network-vif-plugged-83625d0a-3bdb-41a2-8694-e65a9e0aaea1 for instance with vm_state building and task_state spawning.
Nov 06 13:36:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:40 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:36:41 user nova-compute[74821]: DEBUG nova.compute.manager [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:36:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:36:41 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Instance spawned successfully.
Nov 06 13:36:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:36:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:36:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:36:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:36:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:36:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:36:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:36:41 user nova-compute[74821]: INFO nova.compute.manager [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Took 5.07 seconds to spawn the instance on the hypervisor.
Nov 06 13:36:41 user nova-compute[74821]: DEBUG nova.compute.manager [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:36:41 user nova-compute[74821]: DEBUG nova.compute.manager [req-497e3037-3e7d-4fb3-a4df-9d390e1a7a86 req-33075e4a-2d43-4763-ae2e-fb2ace7478e6 service nova] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Received event network-vif-plugged-83625d0a-3bdb-41a2-8694-e65a9e0aaea1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:36:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-497e3037-3e7d-4fb3-a4df-9d390e1a7a86 req-33075e4a-2d43-4763-ae2e-fb2ace7478e6 service nova] Acquiring lock "9e433454-d767-45fc-b45d-a1d39ee62bd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:36:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-497e3037-3e7d-4fb3-a4df-9d390e1a7a86 req-33075e4a-2d43-4763-ae2e-fb2ace7478e6 service nova] Lock "9e433454-d767-45fc-b45d-a1d39ee62bd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:36:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-497e3037-3e7d-4fb3-a4df-9d390e1a7a86 req-33075e4a-2d43-4763-ae2e-fb2ace7478e6 service nova] Lock "9e433454-d767-45fc-b45d-a1d39ee62bd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:36:41 user nova-compute[74821]: DEBUG nova.compute.manager [req-497e3037-3e7d-4fb3-a4df-9d390e1a7a86 req-33075e4a-2d43-4763-ae2e-fb2ace7478e6 service nova] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] No waiting events found dispatching network-vif-plugged-83625d0a-3bdb-41a2-8694-e65a9e0aaea1 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:36:41 user nova-compute[74821]: WARNING nova.compute.manager [req-497e3037-3e7d-4fb3-a4df-9d390e1a7a86 req-33075e4a-2d43-4763-ae2e-fb2ace7478e6 service nova] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Received unexpected event network-vif-plugged-83625d0a-3bdb-41a2-8694-e65a9e0aaea1 for instance with vm_state building and task_state spawning.
Nov 06 13:36:41 user nova-compute[74821]: INFO nova.compute.manager [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Took 35.46 seconds to build instance.
Nov 06 13:36:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-48dc2ce2-f38e-4db5-ac0a-ff4874b32ad7 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "9e433454-d767-45fc-b45d-a1d39ee62bd6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.552s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:36:42 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:36:42 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:36:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-49c65aca-8392-46ba-8fa3-b47ff2416cb9" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:36:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-49c65aca-8392-46ba-8fa3-b47ff2416cb9" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:36:43 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:36:43 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:43 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Updating instance_info_cache with network_info: [{"id": "2000e5c8-e30c-44d9-b79c-fac8a9039c49", "address": "fa:16:3e:06:9f:52", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2000e5c8-e3", "ovs_interfaceid": "2000e5c8-e30c-44d9-b79c-fac8a9039c49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:36:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-49c65aca-8392-46ba-8fa3-b47ff2416cb9" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:36:43 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:36:44 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:36:44 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:36:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:46 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:36:46 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:36:47 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:36:48 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:48 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:50 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8467fdc8-ec8e-4eda-abbc-b146e58e90c8 is timed out.
Nov 06 13:36:50 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Successfully detached device vdb from instance 8467fdc8-ec8e-4eda-abbc-b146e58e90c8 from the live domain config.
Nov 06 13:36:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RvCcYpqK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:36:50 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:36:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0274c578-c515-4a2f-9e2c-85b46a1abe4e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:36:50 user nova-compute[74821]: No targets found.
Nov 06 13:36:50 user nova-compute[74821]: iSNS:
Nov 06 13:36:50 user nova-compute[74821]: No targets found.
Nov 06 13:36:50 user nova-compute[74821]: STATIC:
Nov 06 13:36:50 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13
Nov 06 13:36:50 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:36:50 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:36:50 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979
Nov 06 13:36:50 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:36:50 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:36:50 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d
Nov 06 13:36:50 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:36:50 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:36:50 user nova-compute[74821]: FIRMWARE:
Nov 06 13:36:50 user nova-compute[74821]: No targets found.
Nov 06 13:36:50 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:36:50 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:36:50 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[68240427-a354-48cc-ae33-f17021b23c5e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc86047-df23-4c5e-a17e-88f626d84e65]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:36:50 user nova-compute[74821]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 (non-flash)
Nov 06 13:36:50 user nova-compute[74821]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d (non-flash)
Nov 06 13:36:50 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:36:50 user nova-compute[74821]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 (non-flash)
Nov 06 13:36:50 user nova-compute[74821]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d (non-flash)
Nov 06 13:36:50 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e4040fe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13'): ({'sdg'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Removing single pathed devices sdg {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07461cb-cfcb-4073-afa5-8c5ec60cc244]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a36dde-462f-4a18-8f25-1f2b23b01c58]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Flushing IO for device /dev/sdg {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c754f71-481a-426d-adf2-355d4a1bc4bb]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9295c6ef-f194-4a0f-aff4-6ddedf2073c7]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] SCSI volumes sdg have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c0d599-ed6d-4ca2-a3c6-5c90d525e3ac]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f258bce2-f9b6-466d-a36a-39c999feeed8]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13, portal: 172.16.0.220,3260]
Nov 06 13:36:50 user nova-compute[74821]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13, portal: 172.16.0.220,3260] successful.
Nov 06 13:36:50 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c298ae62-e2a0-49f4-a980-e7a04a9b6c13 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f09154a-3733-4c72-8c42-2f5e20bc8b13]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] <== disconnect_volume: return (338ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:36:50 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:36:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:36:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:36:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:36:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:36:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:36:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:36:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:36:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:51 user nova-compute[74821]: DEBUG nova.objects.instance [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lazy-loading 'flavor' on Instance uuid 8467fdc8-ec8e-4eda-abbc-b146e58e90c8 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:36:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9088c056-dcd6-4e18-a6e0-0f4ee19343ab tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.154s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:36:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:36:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:36:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:36:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e10922b-fa67-46a7-895b-3f40a40bf23d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e10922b-fa67-46a7-895b-3f40a40bf23d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:36:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e10922b-fa67-46a7-895b-3f40a40bf23d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:36:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e10922b-fa67-46a7-895b-3f40a40bf23d/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:36:52 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:36:52 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:36:52 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=8309MB free_disk=25.027145385742188GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:36:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:36:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:36:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 49c65aca-8392-46ba-8fa3-b47ff2416cb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:36:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 496f8213-4b32-4211-a354-e33a4a088848 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:36:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 8467fdc8-ec8e-4eda-abbc-b146e58e90c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:36:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 9e433454-d767-45fc-b45d-a1d39ee62bd6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:36:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 2e10922b-fa67-46a7-895b-3f40a40bf23d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:36:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:36:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:36:53 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:53 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:36:53 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:36:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:36:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.376s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:36:54 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:36:54 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Cleaning up deleted instances {{(pid=74821) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 13:36:54 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] There are 0 instances to clean {{(pid=74821) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 13:36:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:36:55 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:36:57 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:36:58 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:00 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:00 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:37:00 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Cleaning up deleted instances with incomplete migration  {{(pid=74821) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 13:37:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "496f8213-4b32-4211-a354-e33a4a088848" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:37:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "496f8213-4b32-4211-a354-e33a4a088848" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:37:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "496f8213-4b32-4211-a354-e33a4a088848-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:37:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "496f8213-4b32-4211-a354-e33a4a088848-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:37:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "496f8213-4b32-4211-a354-e33a4a088848-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:37:09 user nova-compute[74821]: INFO nova.compute.manager [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Terminating instance
Nov 06 13:37:09 user nova-compute[74821]: DEBUG nova.compute.manager [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:37:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:09 user nova-compute[74821]: DEBUG nova.compute.manager [req-77c56c51-f89b-43b3-a2db-06b1362cc922 req-e1777830-17d3-457f-b08c-0d43af81fd41 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Received event network-vif-unplugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:37:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-77c56c51-f89b-43b3-a2db-06b1362cc922 req-e1777830-17d3-457f-b08c-0d43af81fd41 service nova] Acquiring lock "496f8213-4b32-4211-a354-e33a4a088848-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:37:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-77c56c51-f89b-43b3-a2db-06b1362cc922 req-e1777830-17d3-457f-b08c-0d43af81fd41 service nova] Lock "496f8213-4b32-4211-a354-e33a4a088848-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:37:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-77c56c51-f89b-43b3-a2db-06b1362cc922 req-e1777830-17d3-457f-b08c-0d43af81fd41 service nova] Lock "496f8213-4b32-4211-a354-e33a4a088848-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:37:09 user nova-compute[74821]: DEBUG nova.compute.manager [req-77c56c51-f89b-43b3-a2db-06b1362cc922 req-e1777830-17d3-457f-b08c-0d43af81fd41 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] No waiting events found dispatching network-vif-unplugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:37:09 user nova-compute[74821]: DEBUG nova.compute.manager [req-77c56c51-f89b-43b3-a2db-06b1362cc922 req-e1777830-17d3-457f-b08c-0d43af81fd41 service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Received event network-vif-unplugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:37:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:10 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Instance destroyed successfully.
Nov 06 13:37:10 user nova-compute[74821]: DEBUG nova.objects.instance [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lazy-loading 'resources' on Instance uuid 496f8213-4b32-4211-a354-e33a4a088848 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:19:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-980291330',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-980291330',id=24,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:21:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f745a322931e4150b12d139bfb17b94c',ramdisk_id='',reservation_id='r-ed18rll4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1064633830',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:23:26Z,user_data=None,user_id='133932d1063241078d84731624e89216',uuid=496f8213-4b32-4211-a354-e33a4a088848,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc", "address": "fa:16:3e:de:d4:5d", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dbd0a11-07", "ovs_interfaceid": "0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Converting VIF {"id": "0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc", "address": "fa:16:3e:de:d4:5d", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dbd0a11-07", "ovs_interfaceid": "0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:d4:5d,bridge_name='br-int',has_traffic_filtering=True,id=0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc,network=Network(354bf335-0cac-46d9-acb8-5095411f5db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dbd0a11-07') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG os_vif [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:d4:5d,bridge_name='br-int',has_traffic_filtering=True,id=0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc,network=Network(354bf335-0cac-46d9-acb8-5095411f5db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dbd0a11-07') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0dbd0a11-07, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0e28180-2cc8-43cf-b8ef-f0bd539bb816) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:37:10 user nova-compute[74821]: INFO os_vif [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:d4:5d,bridge_name='br-int',has_traffic_filtering=True,id=0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc,network=Network(354bf335-0cac-46d9-acb8-5095411f5db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dbd0a11-07')
Nov 06 13:37:10 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gVPeKGMQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:37:10 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:37:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8c49c2-187d-4813-b9ce-666c8a2959fa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:37:10 user nova-compute[74821]: No targets found.
Nov 06 13:37:10 user nova-compute[74821]: iSNS:
Nov 06 13:37:10 user nova-compute[74821]: No targets found.
Nov 06 13:37:10 user nova-compute[74821]: STATIC:
Nov 06 13:37:10 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979
Nov 06 13:37:10 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:37:10 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:37:10 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d
Nov 06 13:37:10 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:37:10 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:37:10 user nova-compute[74821]: FIRMWARE:
Nov 06 13:37:10 user nova-compute[74821]: No targets found.
Nov 06 13:37:10 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:37:10 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:37:10 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5056fb-bfae-4435-9ce1-a608e532942a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a546c9eb-21c6-439a-81bc-6404a88ab38f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:37:10 user nova-compute[74821]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d (non-flash)
Nov 06 13:37:10 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 (non-flash)
Nov 06 13:37:10 user nova-compute[74821]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d (non-flash)
Nov 06 13:37:10 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e5863c430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979'): ({'sdd'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Removing single pathed devices sdd {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8ff6a6-429f-4b73-8882-456a0322aab4]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b099a8-9fe4-4a60-9d60-ad48d257d6fb]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Flushing IO for device /dev/sdd {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e96f7c5-ca6c-44c1-8b0c-ad0af6699065]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b986fb-ea82-44cb-a9a6-9e3182220e32]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] SCSI volumes sdd have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0dc0182-0f74-4535-b28d-f4460bde867f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30aa3e6-beb9-44b4-a077-5fda871f4715]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979, portal: 172.16.0.220,3260]
Nov 06 13:37:10 user nova-compute[74821]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979, portal: 172.16.0.220,3260] successful.
Nov 06 13:37:10 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4739d8fa-3170-46f4-ac61-fa0fe6aa4979 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c6e61a-c8dd-4868-9834-adde4003fde2]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] <== disconnect_volume: return (330ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:37:10 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Deleting instance files /opt/stack/data/nova/instances/496f8213-4b32-4211-a354-e33a4a088848_del
Nov 06 13:37:10 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Deletion of /opt/stack/data/nova/instances/496f8213-4b32-4211-a354-e33a4a088848_del complete
Nov 06 13:37:10 user nova-compute[74821]: INFO nova.compute.manager [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 06 13:37:10 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:37:10 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 496f8213-4b32-4211-a354-e33a4a088848] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:37:11 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:37:11 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Took 0.48 seconds to deallocate network for instance.
Nov 06 13:37:11 user nova-compute[74821]: DEBUG nova.compute.manager [req-fcae81bc-c553-412b-b13b-8448ea3852c8 req-4501e0ee-5c2d-4a17-b44a-b3f4b922748c service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Received event network-vif-deleted-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:37:11 user nova-compute[74821]: DEBUG nova.compute.manager [req-c2e53d2a-b952-4bfd-889c-6a7461549656 req-5958d6e3-5c23-45f8-8ada-6c02c77714cc service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Received event network-vif-plugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:37:11 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c2e53d2a-b952-4bfd-889c-6a7461549656 req-5958d6e3-5c23-45f8-8ada-6c02c77714cc service nova] Acquiring lock "496f8213-4b32-4211-a354-e33a4a088848-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:37:11 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c2e53d2a-b952-4bfd-889c-6a7461549656 req-5958d6e3-5c23-45f8-8ada-6c02c77714cc service nova] Lock "496f8213-4b32-4211-a354-e33a4a088848-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:37:11 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c2e53d2a-b952-4bfd-889c-6a7461549656 req-5958d6e3-5c23-45f8-8ada-6c02c77714cc service nova] Lock "496f8213-4b32-4211-a354-e33a4a088848-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:37:11 user nova-compute[74821]: DEBUG nova.compute.manager [req-c2e53d2a-b952-4bfd-889c-6a7461549656 req-5958d6e3-5c23-45f8-8ada-6c02c77714cc service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] No waiting events found dispatching network-vif-plugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:37:11 user nova-compute[74821]: WARNING nova.compute.manager [req-c2e53d2a-b952-4bfd-889c-6a7461549656 req-5958d6e3-5c23-45f8-8ada-6c02c77714cc service nova] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Received unexpected event network-vif-plugged-0dbd0a11-0798-46b5-a3f6-45bdeaf0d7fc for instance with vm_state active and task_state deleting.
Nov 06 13:37:12 user nova-compute[74821]: INFO nova.compute.manager [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 496f8213-4b32-4211-a354-e33a4a088848] Took 0.93 seconds to detach 1 volumes for instance.
Nov 06 13:37:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:37:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:37:12 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Refreshing inventories for resource provider a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 13:37:12 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Updating ProviderTree inventory for provider a45ec519-15f5-48fe-877b-466db09f8afe from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 13:37:12 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Updating inventory in ProviderTree for provider a45ec519-15f5-48fe-877b-466db09f8afe with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 13:37:12 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Refreshing aggregate associations for resource provider a45ec519-15f5-48fe-877b-466db09f8afe, aggregates: None {{(pid=74821) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 13:37:12 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Refreshing trait associations for resource provider a45ec519-15f5-48fe-877b-466db09f8afe, traits: COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42 {{(pid=74821) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 13:37:12 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:37:12 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:37:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.481s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:37:12 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Deleted allocations for instance 496f8213-4b32-4211-a354-e33a4a088848
Nov 06 13:37:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fc041902-b860-4f42-8380-ef214a1e64ba tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "496f8213-4b32-4211-a354-e33a4a088848" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.304s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:37:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:20 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:20 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:37:24 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:37:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:37:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:37:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:37:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:37:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-78cf0216-d289-4315-a249-ceb64ac701e3 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:37:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-78cf0216-d289-4315-a249-ceb64ac701e3 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:37:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-78cf0216-d289-4315-a249-ceb64ac701e3 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:37:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-78cf0216-d289-4315-a249-ceb64ac701e3 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:37:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-78cf0216-d289-4315-a249-ceb64ac701e3 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:37:33 user nova-compute[74821]: INFO nova.compute.manager [None req-78cf0216-d289-4315-a249-ceb64ac701e3 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Terminating instance
Nov 06 13:37:33 user nova-compute[74821]: DEBUG nova.compute.manager [None req-78cf0216-d289-4315-a249-ceb64ac701e3 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:37:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:34 user nova-compute[74821]: DEBUG nova.compute.manager [req-05e07db7-5e8d-49c5-984e-d0cd1932a789 req-493e112e-406a-4f3f-96a1-cf4030513fdb service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Received event network-vif-unplugged-30866a49-b7d0-458d-87a6-e97d3c533640 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:37:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-05e07db7-5e8d-49c5-984e-d0cd1932a789 req-493e112e-406a-4f3f-96a1-cf4030513fdb service nova] Acquiring lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:37:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-05e07db7-5e8d-49c5-984e-d0cd1932a789 req-493e112e-406a-4f3f-96a1-cf4030513fdb service nova] Lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:37:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-05e07db7-5e8d-49c5-984e-d0cd1932a789 req-493e112e-406a-4f3f-96a1-cf4030513fdb service nova] Lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:37:34 user nova-compute[74821]: DEBUG nova.compute.manager [req-05e07db7-5e8d-49c5-984e-d0cd1932a789 req-493e112e-406a-4f3f-96a1-cf4030513fdb service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] No waiting events found dispatching network-vif-unplugged-30866a49-b7d0-458d-87a6-e97d3c533640 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:37:34 user nova-compute[74821]: DEBUG nova.compute.manager [req-05e07db7-5e8d-49c5-984e-d0cd1932a789 req-493e112e-406a-4f3f-96a1-cf4030513fdb service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Received event network-vif-unplugged-30866a49-b7d0-458d-87a6-e97d3c533640 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:37:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:34 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Instance destroyed successfully.
Nov 06 13:37:34 user nova-compute[74821]: DEBUG nova.objects.instance [None req-78cf0216-d289-4315-a249-ceb64ac701e3 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lazy-loading 'resources' on Instance uuid 8467fdc8-ec8e-4eda-abbc-b146e58e90c8 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:37:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-78cf0216-d289-4315-a249-ceb64ac701e3 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:31:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1664915128',display_name='tempest-TestMinimumBasicScenario-server-1664915128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1664915128',id=39,image_ref='149fc74a-1ade-4b08-9498-88510804c090',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPC/WyWwJ1mdb7Q1HCFQa68dEwI0XyfAWMaXm4AvxqK0uA59dwuMN3WSFpUeeufZrkTJoJN71RO50MRXJvZqvtDVtE16HLEjQ928R5bTilrQQ7UOiHqmsqTXF4fpZzdNYA==',key_name='tempest-TestMinimumBasicScenario-2075493504',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:31:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2772db4aac63412fb8cfe945c89f7156',ramdisk_id='',reservation_id='r-dh6uy30j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='149fc74a-1ade-4b08-9498-88510804c090',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1779731878',owner_user_name='tempest-TestMinimumBasicScenario-1779731878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:34:44Z,user_data=None,user_id='19e457098f3242979db3fc25390965a4',uuid=8467fdc8-ec8e-4eda-abbc-b146e58e90c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30866a49-b7d0-458d-87a6-e97d3c533640", "address": "fa:16:3e:7c:2c:c7", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30866a49-b7", "ovs_interfaceid": "30866a49-b7d0-458d-87a6-e97d3c533640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:37:34 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-78cf0216-d289-4315-a249-ceb64ac701e3 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Converting VIF {"id": "30866a49-b7d0-458d-87a6-e97d3c533640", "address": "fa:16:3e:7c:2c:c7", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30866a49-b7", "ovs_interfaceid": "30866a49-b7d0-458d-87a6-e97d3c533640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:37:34 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-78cf0216-d289-4315-a249-ceb64ac701e3 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:2c:c7,bridge_name='br-int',has_traffic_filtering=True,id=30866a49-b7d0-458d-87a6-e97d3c533640,network=Network(57870f63-b015-4453-ae32-18f642d7c4b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30866a49-b7') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:37:34 user nova-compute[74821]: DEBUG os_vif [None req-78cf0216-d289-4315-a249-ceb64ac701e3 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:2c:c7,bridge_name='br-int',has_traffic_filtering=True,id=30866a49-b7d0-458d-87a6-e97d3c533640,network=Network(57870f63-b015-4453-ae32-18f642d7c4b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30866a49-b7') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:37:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30866a49-b7, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:37:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:37:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2cf0bac5-8dc3-4708-b4df-5d02fb69e5e6) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:37:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:34 user nova-compute[74821]: INFO os_vif [None req-78cf0216-d289-4315-a249-ceb64ac701e3 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:2c:c7,bridge_name='br-int',has_traffic_filtering=True,id=30866a49-b7d0-458d-87a6-e97d3c533640,network=Network(57870f63-b015-4453-ae32-18f642d7c4b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30866a49-b7')
Nov 06 13:37:34 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-78cf0216-d289-4315-a249-ceb64ac701e3 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Deleting instance files /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8_del
Nov 06 13:37:34 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-78cf0216-d289-4315-a249-ceb64ac701e3 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Deletion of /opt/stack/data/nova/instances/8467fdc8-ec8e-4eda-abbc-b146e58e90c8_del complete
Nov 06 13:37:34 user nova-compute[74821]: INFO nova.compute.manager [None req-78cf0216-d289-4315-a249-ceb64ac701e3 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 06 13:37:34 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-78cf0216-d289-4315-a249-ceb64ac701e3 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:37:34 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:37:34 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:37:35 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:37:35 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Took 0.64 seconds to deallocate network for instance.
Nov 06 13:37:35 user nova-compute[74821]: DEBUG nova.compute.manager [req-528813e5-9738-4754-a287-85dc752b952a req-48bde1ca-7050-439f-8fb3-9c6fbaa8b14d service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Received event network-vif-deleted-30866a49-b7d0-458d-87a6-e97d3c533640 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:37:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-78cf0216-d289-4315-a249-ceb64ac701e3 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:37:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-78cf0216-d289-4315-a249-ceb64ac701e3 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:37:35 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-78cf0216-d289-4315-a249-ceb64ac701e3 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:37:35 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-78cf0216-d289-4315-a249-ceb64ac701e3 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:37:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-78cf0216-d289-4315-a249-ceb64ac701e3 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.213s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:37:35 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-78cf0216-d289-4315-a249-ceb64ac701e3 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Deleted allocations for instance 8467fdc8-ec8e-4eda-abbc-b146e58e90c8
Nov 06 13:37:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-78cf0216-d289-4315-a249-ceb64ac701e3 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.936s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:37:36 user nova-compute[74821]: DEBUG nova.compute.manager [req-11e8db69-8c72-4423-b63d-cddebb08fa64 req-8cc50482-77ae-4f45-a03e-28eb7accc337 service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Received event network-vif-plugged-30866a49-b7d0-458d-87a6-e97d3c533640 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:37:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-11e8db69-8c72-4423-b63d-cddebb08fa64 req-8cc50482-77ae-4f45-a03e-28eb7accc337 service nova] Acquiring lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:37:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-11e8db69-8c72-4423-b63d-cddebb08fa64 req-8cc50482-77ae-4f45-a03e-28eb7accc337 service nova] Lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:37:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-11e8db69-8c72-4423-b63d-cddebb08fa64 req-8cc50482-77ae-4f45-a03e-28eb7accc337 service nova] Lock "8467fdc8-ec8e-4eda-abbc-b146e58e90c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:37:36 user nova-compute[74821]: DEBUG nova.compute.manager [req-11e8db69-8c72-4423-b63d-cddebb08fa64 req-8cc50482-77ae-4f45-a03e-28eb7accc337 service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] No waiting events found dispatching network-vif-plugged-30866a49-b7d0-458d-87a6-e97d3c533640 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:37:36 user nova-compute[74821]: WARNING nova.compute.manager [req-11e8db69-8c72-4423-b63d-cddebb08fa64 req-8cc50482-77ae-4f45-a03e-28eb7accc337 service nova] [instance: 8467fdc8-ec8e-4eda-abbc-b146e58e90c8] Received unexpected event network-vif-plugged-30866a49-b7d0-458d-87a6-e97d3c533640 for instance with vm_state deleted and task_state None.
Nov 06 13:37:37 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._sync_power_states {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:37:37 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Triggering sync for uuid 49c65aca-8392-46ba-8fa3-b47ff2416cb9 {{(pid=74821) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 13:37:37 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Triggering sync for uuid 9e433454-d767-45fc-b45d-a1d39ee62bd6 {{(pid=74821) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 13:37:37 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Triggering sync for uuid 2e10922b-fa67-46a7-895b-3f40a40bf23d {{(pid=74821) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 13:37:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "49c65aca-8392-46ba-8fa3-b47ff2416cb9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:37:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "49c65aca-8392-46ba-8fa3-b47ff2416cb9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:37:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "9e433454-d767-45fc-b45d-a1d39ee62bd6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:37:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "9e433454-d767-45fc-b45d-a1d39ee62bd6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:37:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "2e10922b-fa67-46a7-895b-3f40a40bf23d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:37:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "2e10922b-fa67-46a7-895b-3f40a40bf23d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:37:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "49c65aca-8392-46ba-8fa3-b47ff2416cb9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:37:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "9e433454-d767-45fc-b45d-a1d39ee62bd6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:37:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "2e10922b-fa67-46a7-895b-3f40a40bf23d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:37:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:42 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:37:42 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:37:42 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:37:43 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Didn't find any instances for network info cache update. {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 13:37:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:37:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:37:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:37:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:37:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:45 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:37:46 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:37:46 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:37:46 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:37:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:49 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:37:49 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:37:51 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:37:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:37:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:37:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:37:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:37:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:37:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:37:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:37:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:37:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:37:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e10922b-fa67-46a7-895b-3f40a40bf23d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:37:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e10922b-fa67-46a7-895b-3f40a40bf23d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:37:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e10922b-fa67-46a7-895b-3f40a40bf23d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:37:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e10922b-fa67-46a7-895b-3f40a40bf23d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:37:53 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:37:53 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:37:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=8544MB free_disk=25.050487518310547GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:37:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:37:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:37:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 49c65aca-8392-46ba-8fa3-b47ff2416cb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:37:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 9e433454-d767-45fc-b45d-a1d39ee62bd6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:37:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 2e10922b-fa67-46a7-895b-3f40a40bf23d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:37:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:37:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:37:53 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:37:53 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:37:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:37:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.265s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:37:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:37:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:37:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:37:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:37:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:37:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "9e433454-d767-45fc-b45d-a1d39ee62bd6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:37:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "9e433454-d767-45fc-b45d-a1d39ee62bd6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:37:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "9e433454-d767-45fc-b45d-a1d39ee62bd6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:37:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "9e433454-d767-45fc-b45d-a1d39ee62bd6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.005s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:37:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "9e433454-d767-45fc-b45d-a1d39ee62bd6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:37:56 user nova-compute[74821]: INFO nova.compute.manager [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Terminating instance
Nov 06 13:37:56 user nova-compute[74821]: DEBUG nova.compute.manager [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG nova.compute.manager [req-c3634f05-a9fd-44fd-8ec2-2fe4a6ad1add req-8d31c636-af2e-47a7-88a1-2e8e2f72eb0e service nova] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Received event network-vif-unplugged-83625d0a-3bdb-41a2-8694-e65a9e0aaea1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c3634f05-a9fd-44fd-8ec2-2fe4a6ad1add req-8d31c636-af2e-47a7-88a1-2e8e2f72eb0e service nova] Acquiring lock "9e433454-d767-45fc-b45d-a1d39ee62bd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c3634f05-a9fd-44fd-8ec2-2fe4a6ad1add req-8d31c636-af2e-47a7-88a1-2e8e2f72eb0e service nova] Lock "9e433454-d767-45fc-b45d-a1d39ee62bd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c3634f05-a9fd-44fd-8ec2-2fe4a6ad1add req-8d31c636-af2e-47a7-88a1-2e8e2f72eb0e service nova] Lock "9e433454-d767-45fc-b45d-a1d39ee62bd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG nova.compute.manager [req-c3634f05-a9fd-44fd-8ec2-2fe4a6ad1add req-8d31c636-af2e-47a7-88a1-2e8e2f72eb0e service nova] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] No waiting events found dispatching network-vif-unplugged-83625d0a-3bdb-41a2-8694-e65a9e0aaea1 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG nova.compute.manager [req-c3634f05-a9fd-44fd-8ec2-2fe4a6ad1add req-8d31c636-af2e-47a7-88a1-2e8e2f72eb0e service nova] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Received event network-vif-unplugged-83625d0a-3bdb-41a2-8694-e65a9e0aaea1 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:57 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Instance destroyed successfully.
Nov 06 13:37:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG nova.objects.instance [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lazy-loading 'resources' on Instance uuid 9e433454-d767-45fc-b45d-a1d39ee62bd6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:36:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-294954111',display_name='tempest-TestVolumeBootPattern-server-294954111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-294954111',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:36:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c8e811a3a30417a8dc6ccad03f2f8e0',ramdisk_id='',reservation_id='r-a1s7w5hl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1930796442',owner_user_name='tempest-TestVolumeBootPattern-1930796442-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:36:42Z,user_data=None,user_id='3bb6a168d90a4795a72b8ac69eeadcc9',uuid=9e433454-d767-45fc-b45d-a1d39ee62bd6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83625d0a-3bdb-41a2-8694-e65a9e0aaea1", "address": "fa:16:3e:23:4a:24", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83625d0a-3b", "ovs_interfaceid": "83625d0a-3bdb-41a2-8694-e65a9e0aaea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Converting VIF {"id": "83625d0a-3bdb-41a2-8694-e65a9e0aaea1", "address": "fa:16:3e:23:4a:24", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83625d0a-3b", "ovs_interfaceid": "83625d0a-3bdb-41a2-8694-e65a9e0aaea1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:4a:24,bridge_name='br-int',has_traffic_filtering=True,id=83625d0a-3bdb-41a2-8694-e65a9e0aaea1,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83625d0a-3b') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG os_vif [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:4a:24,bridge_name='br-int',has_traffic_filtering=True,id=83625d0a-3bdb-41a2-8694-e65a9e0aaea1,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83625d0a-3b') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83625d0a-3b, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1bc79bb7-004a-48e5-9c31-f5cbdf614f39) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:37:57 user nova-compute[74821]: INFO os_vif [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:4a:24,bridge_name='br-int',has_traffic_filtering=True,id=83625d0a-3bdb-41a2-8694-e65a9e0aaea1,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83625d0a-3b')
Nov 06 13:37:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uwLJzhUA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:37:57 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:37:57 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c61c841-fc46-46c4-a758-cb44b8b23cf0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:37:57 user nova-compute[74821]: No targets found.
Nov 06 13:37:57 user nova-compute[74821]: iSNS:
Nov 06 13:37:57 user nova-compute[74821]: No targets found.
Nov 06 13:37:57 user nova-compute[74821]: STATIC:
Nov 06 13:37:57 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d
Nov 06 13:37:57 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:37:57 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:37:57 user nova-compute[74821]: FIRMWARE:
Nov 06 13:37:57 user nova-compute[74821]: No targets found.
Nov 06 13:37:57 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:37:57 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:37:57 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd741cf0-e796-447a-94c2-10a792768290]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfab0cf-0d9a-4f2b-a59b-f71ee9d1b540]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d (non-flash)
Nov 06 13:37:57 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d (non-flash)
Nov 06 13:37:57 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e406327a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d'): ({'sdb'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Removing single pathed devices sdb {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c072e928-53d0-4db0-b41e-d9bd9f515e4c]: (4, ('path checker states:\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa20234-758a-4303-b7e9-eca604a1fb45]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Flushing IO for device /dev/sdb {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[900b7b27-7d8b-4c64-9111-bffff2edf8a5]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:37:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:37:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:37:58 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12a24a1-1a2e-4896-8930-6241410d63e3]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:37:58 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:37:58 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] SCSI volumes sdb have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:37:58 user nova-compute[74821]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26638353962363530', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d65b65ae', '/dev/disk/by-id/scsi-1SCST_BIOd65b65ae-f859b6505b9f9b2f') {{(pid=85818) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 06 13:37:58 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2030e1e7-b89e-4e27-9fce-a92703d8fe3e]: (4, None) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:37:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:37:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:37:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:37:58 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[60942093-b878-4ba1-99f9-7e50b88e0058]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:37:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:37:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:37:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:37:58 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf528694-2551-4186-86c9-d930840cccea]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:37:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d, portal: 172.16.0.220,3260]
Nov 06 13:37:58 user nova-compute[74821]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d, portal: 172.16.0.220,3260] successful.
Nov 06 13:37:58 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:37:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:37:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c1819c2-2270-4762-ae03-e349c168c97d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:37:58 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fcc602-1b74-4e11-bb98-edc5bdb72d90]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:37:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:37:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:37:58 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] <== disconnect_volume: return (346ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:37:58 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:37:58 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Deleting instance files /opt/stack/data/nova/instances/9e433454-d767-45fc-b45d-a1d39ee62bd6_del
Nov 06 13:37:58 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Deletion of /opt/stack/data/nova/instances/9e433454-d767-45fc-b45d-a1d39ee62bd6_del complete
Nov 06 13:37:58 user nova-compute[74821]: INFO nova.compute.manager [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 06 13:37:58 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:37:58 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:37:58 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:37:58 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:58 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:58 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:58 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:58 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:37:58 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:37:58 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Took 0.57 seconds to deallocate network for instance.
Nov 06 13:37:58 user nova-compute[74821]: DEBUG nova.compute.manager [req-7aebc3d0-24b1-4ce6-a062-eb860ba03b38 req-54f6fb74-4348-48af-9ec8-1ab0b28954b0 service nova] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Received event network-vif-deleted-83625d0a-3bdb-41a2-8694-e65a9e0aaea1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:37:58 user nova-compute[74821]: INFO nova.compute.manager [req-7aebc3d0-24b1-4ce6-a062-eb860ba03b38 req-54f6fb74-4348-48af-9ec8-1ab0b28954b0 service nova] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Neutron deleted interface 83625d0a-3bdb-41a2-8694-e65a9e0aaea1; detaching it from the instance and deleting it from the info cache
Nov 06 13:37:58 user nova-compute[74821]: DEBUG nova.network.neutron [req-7aebc3d0-24b1-4ce6-a062-eb860ba03b38 req-54f6fb74-4348-48af-9ec8-1ab0b28954b0 service nova] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:37:58 user nova-compute[74821]: DEBUG nova.compute.manager [req-7aebc3d0-24b1-4ce6-a062-eb860ba03b38 req-54f6fb74-4348-48af-9ec8-1ab0b28954b0 service nova] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Detach interface failed, port_id=83625d0a-3bdb-41a2-8694-e65a9e0aaea1, reason: Instance 9e433454-d767-45fc-b45d-a1d39ee62bd6 could not be found. {{(pid=74821) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 13:37:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-b2d4be65-7b10-4f54-81db-babfe3d6aaac req-d28b9961-cecd-4fb0-9316-4f37d4a5bef7 service nova] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Received event network-vif-plugged-83625d0a-3bdb-41a2-8694-e65a9e0aaea1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:37:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b2d4be65-7b10-4f54-81db-babfe3d6aaac req-d28b9961-cecd-4fb0-9316-4f37d4a5bef7 service nova] Acquiring lock "9e433454-d767-45fc-b45d-a1d39ee62bd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:37:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b2d4be65-7b10-4f54-81db-babfe3d6aaac req-d28b9961-cecd-4fb0-9316-4f37d4a5bef7 service nova] Lock "9e433454-d767-45fc-b45d-a1d39ee62bd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:37:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b2d4be65-7b10-4f54-81db-babfe3d6aaac req-d28b9961-cecd-4fb0-9316-4f37d4a5bef7 service nova] Lock "9e433454-d767-45fc-b45d-a1d39ee62bd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:37:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-b2d4be65-7b10-4f54-81db-babfe3d6aaac req-d28b9961-cecd-4fb0-9316-4f37d4a5bef7 service nova] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] No waiting events found dispatching network-vif-plugged-83625d0a-3bdb-41a2-8694-e65a9e0aaea1 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:37:59 user nova-compute[74821]: WARNING nova.compute.manager [req-b2d4be65-7b10-4f54-81db-babfe3d6aaac req-d28b9961-cecd-4fb0-9316-4f37d4a5bef7 service nova] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Received unexpected event network-vif-plugged-83625d0a-3bdb-41a2-8694-e65a9e0aaea1 for instance with vm_state active and task_state deleting.
Nov 06 13:37:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-b2d4be65-7b10-4f54-81db-babfe3d6aaac req-d28b9961-cecd-4fb0-9316-4f37d4a5bef7 service nova] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Received event network-vif-plugged-83625d0a-3bdb-41a2-8694-e65a9e0aaea1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:37:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b2d4be65-7b10-4f54-81db-babfe3d6aaac req-d28b9961-cecd-4fb0-9316-4f37d4a5bef7 service nova] Acquiring lock "9e433454-d767-45fc-b45d-a1d39ee62bd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:37:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b2d4be65-7b10-4f54-81db-babfe3d6aaac req-d28b9961-cecd-4fb0-9316-4f37d4a5bef7 service nova] Lock "9e433454-d767-45fc-b45d-a1d39ee62bd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:37:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b2d4be65-7b10-4f54-81db-babfe3d6aaac req-d28b9961-cecd-4fb0-9316-4f37d4a5bef7 service nova] Lock "9e433454-d767-45fc-b45d-a1d39ee62bd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:37:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-b2d4be65-7b10-4f54-81db-babfe3d6aaac req-d28b9961-cecd-4fb0-9316-4f37d4a5bef7 service nova] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] No waiting events found dispatching network-vif-plugged-83625d0a-3bdb-41a2-8694-e65a9e0aaea1 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:37:59 user nova-compute[74821]: WARNING nova.compute.manager [req-b2d4be65-7b10-4f54-81db-babfe3d6aaac req-d28b9961-cecd-4fb0-9316-4f37d4a5bef7 service nova] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Received unexpected event network-vif-plugged-83625d0a-3bdb-41a2-8694-e65a9e0aaea1 for instance with vm_state active and task_state deleting.
Nov 06 13:37:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-b2d4be65-7b10-4f54-81db-babfe3d6aaac req-d28b9961-cecd-4fb0-9316-4f37d4a5bef7 service nova] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Received event network-vif-plugged-83625d0a-3bdb-41a2-8694-e65a9e0aaea1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:37:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b2d4be65-7b10-4f54-81db-babfe3d6aaac req-d28b9961-cecd-4fb0-9316-4f37d4a5bef7 service nova] Acquiring lock "9e433454-d767-45fc-b45d-a1d39ee62bd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:37:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b2d4be65-7b10-4f54-81db-babfe3d6aaac req-d28b9961-cecd-4fb0-9316-4f37d4a5bef7 service nova] Lock "9e433454-d767-45fc-b45d-a1d39ee62bd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:37:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b2d4be65-7b10-4f54-81db-babfe3d6aaac req-d28b9961-cecd-4fb0-9316-4f37d4a5bef7 service nova] Lock "9e433454-d767-45fc-b45d-a1d39ee62bd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:37:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-b2d4be65-7b10-4f54-81db-babfe3d6aaac req-d28b9961-cecd-4fb0-9316-4f37d4a5bef7 service nova] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] No waiting events found dispatching network-vif-plugged-83625d0a-3bdb-41a2-8694-e65a9e0aaea1 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:37:59 user nova-compute[74821]: WARNING nova.compute.manager [req-b2d4be65-7b10-4f54-81db-babfe3d6aaac req-d28b9961-cecd-4fb0-9316-4f37d4a5bef7 service nova] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Received unexpected event network-vif-plugged-83625d0a-3bdb-41a2-8694-e65a9e0aaea1 for instance with vm_state active and task_state deleting.
Nov 06 13:37:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-b2d4be65-7b10-4f54-81db-babfe3d6aaac req-d28b9961-cecd-4fb0-9316-4f37d4a5bef7 service nova] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Received event network-vif-unplugged-83625d0a-3bdb-41a2-8694-e65a9e0aaea1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:37:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b2d4be65-7b10-4f54-81db-babfe3d6aaac req-d28b9961-cecd-4fb0-9316-4f37d4a5bef7 service nova] Acquiring lock "9e433454-d767-45fc-b45d-a1d39ee62bd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:37:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b2d4be65-7b10-4f54-81db-babfe3d6aaac req-d28b9961-cecd-4fb0-9316-4f37d4a5bef7 service nova] Lock "9e433454-d767-45fc-b45d-a1d39ee62bd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:37:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b2d4be65-7b10-4f54-81db-babfe3d6aaac req-d28b9961-cecd-4fb0-9316-4f37d4a5bef7 service nova] Lock "9e433454-d767-45fc-b45d-a1d39ee62bd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:37:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-b2d4be65-7b10-4f54-81db-babfe3d6aaac req-d28b9961-cecd-4fb0-9316-4f37d4a5bef7 service nova] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] No waiting events found dispatching network-vif-unplugged-83625d0a-3bdb-41a2-8694-e65a9e0aaea1 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:37:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-b2d4be65-7b10-4f54-81db-babfe3d6aaac req-d28b9961-cecd-4fb0-9316-4f37d4a5bef7 service nova] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Received event network-vif-unplugged-83625d0a-3bdb-41a2-8694-e65a9e0aaea1 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:37:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-b2d4be65-7b10-4f54-81db-babfe3d6aaac req-d28b9961-cecd-4fb0-9316-4f37d4a5bef7 service nova] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Received event network-vif-plugged-83625d0a-3bdb-41a2-8694-e65a9e0aaea1 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:37:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b2d4be65-7b10-4f54-81db-babfe3d6aaac req-d28b9961-cecd-4fb0-9316-4f37d4a5bef7 service nova] Acquiring lock "9e433454-d767-45fc-b45d-a1d39ee62bd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:37:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b2d4be65-7b10-4f54-81db-babfe3d6aaac req-d28b9961-cecd-4fb0-9316-4f37d4a5bef7 service nova] Lock "9e433454-d767-45fc-b45d-a1d39ee62bd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:37:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b2d4be65-7b10-4f54-81db-babfe3d6aaac req-d28b9961-cecd-4fb0-9316-4f37d4a5bef7 service nova] Lock "9e433454-d767-45fc-b45d-a1d39ee62bd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:37:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-b2d4be65-7b10-4f54-81db-babfe3d6aaac req-d28b9961-cecd-4fb0-9316-4f37d4a5bef7 service nova] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] No waiting events found dispatching network-vif-plugged-83625d0a-3bdb-41a2-8694-e65a9e0aaea1 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:37:59 user nova-compute[74821]: WARNING nova.compute.manager [req-b2d4be65-7b10-4f54-81db-babfe3d6aaac req-d28b9961-cecd-4fb0-9316-4f37d4a5bef7 service nova] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Received unexpected event network-vif-plugged-83625d0a-3bdb-41a2-8694-e65a9e0aaea1 for instance with vm_state active and task_state deleting.
Nov 06 13:37:59 user nova-compute[74821]: INFO nova.compute.manager [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Took 1.03 seconds to detach 1 volumes for instance.
Nov 06 13:37:59 user nova-compute[74821]: DEBUG nova.compute.manager [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9e433454-d767-45fc-b45d-a1d39ee62bd6] Deleting volume: 2c1819c2-2270-4762-ae03-e349c168c97d {{(pid=74821) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 06 13:37:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:37:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:38:00 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:38:00 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:38:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.328s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:38:00 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Deleted allocations for instance 9e433454-d767-45fc-b45d-a1d39ee62bd6
Nov 06 13:38:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b28da111-6899-49ea-8b95-e9e85fcfd9db tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "9e433454-d767-45fc-b45d-a1d39ee62bd6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.482s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:38:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-219fe94a-2f40-496e-a925-daa445bc026f tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "49c65aca-8392-46ba-8fa3-b47ff2416cb9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:38:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-219fe94a-2f40-496e-a925-daa445bc026f tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "49c65aca-8392-46ba-8fa3-b47ff2416cb9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:38:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-219fe94a-2f40-496e-a925-daa445bc026f tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "49c65aca-8392-46ba-8fa3-b47ff2416cb9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:38:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-219fe94a-2f40-496e-a925-daa445bc026f tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "49c65aca-8392-46ba-8fa3-b47ff2416cb9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:38:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-219fe94a-2f40-496e-a925-daa445bc026f tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "49c65aca-8392-46ba-8fa3-b47ff2416cb9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:38:00 user nova-compute[74821]: INFO nova.compute.manager [None req-219fe94a-2f40-496e-a925-daa445bc026f tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Terminating instance
Nov 06 13:38:00 user nova-compute[74821]: DEBUG nova.compute.manager [None req-219fe94a-2f40-496e-a925-daa445bc026f tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:38:00 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:00 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:00 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:00 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:00 user nova-compute[74821]: DEBUG nova.compute.manager [req-8dad0574-3881-42a1-88ef-05a00d54e52a req-2c72572f-9099-43b2-8738-6195112dab13 service nova] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Received event network-vif-unplugged-2000e5c8-e30c-44d9-b79c-fac8a9039c49 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:38:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8dad0574-3881-42a1-88ef-05a00d54e52a req-2c72572f-9099-43b2-8738-6195112dab13 service nova] Acquiring lock "49c65aca-8392-46ba-8fa3-b47ff2416cb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:38:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8dad0574-3881-42a1-88ef-05a00d54e52a req-2c72572f-9099-43b2-8738-6195112dab13 service nova] Lock "49c65aca-8392-46ba-8fa3-b47ff2416cb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:38:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8dad0574-3881-42a1-88ef-05a00d54e52a req-2c72572f-9099-43b2-8738-6195112dab13 service nova] Lock "49c65aca-8392-46ba-8fa3-b47ff2416cb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:38:00 user nova-compute[74821]: DEBUG nova.compute.manager [req-8dad0574-3881-42a1-88ef-05a00d54e52a req-2c72572f-9099-43b2-8738-6195112dab13 service nova] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] No waiting events found dispatching network-vif-unplugged-2000e5c8-e30c-44d9-b79c-fac8a9039c49 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:38:00 user nova-compute[74821]: DEBUG nova.compute.manager [req-8dad0574-3881-42a1-88ef-05a00d54e52a req-2c72572f-9099-43b2-8738-6195112dab13 service nova] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Received event network-vif-unplugged-2000e5c8-e30c-44d9-b79c-fac8a9039c49 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:38:01 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Instance destroyed successfully.
Nov 06 13:38:01 user nova-compute[74821]: DEBUG nova.objects.instance [None req-219fe94a-2f40-496e-a925-daa445bc026f tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lazy-loading 'resources' on Instance uuid 49c65aca-8392-46ba-8fa3-b47ff2416cb9 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:38:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-219fe94a-2f40-496e-a925-daa445bc026f tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:16:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1651102471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1651102471',id=16,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:16:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f745a322931e4150b12d139bfb17b94c',ramdisk_id='',reservation_id='r-3r89gq7d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1064633830',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:18:36Z,user_data=None,user_id='133932d1063241078d84731624e89216',uuid=49c65aca-8392-46ba-8fa3-b47ff2416cb9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2000e5c8-e30c-44d9-b79c-fac8a9039c49", "address": "fa:16:3e:06:9f:52", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2000e5c8-e3", "ovs_interfaceid": "2000e5c8-e30c-44d9-b79c-fac8a9039c49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:38:01 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-219fe94a-2f40-496e-a925-daa445bc026f tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Converting VIF {"id": "2000e5c8-e30c-44d9-b79c-fac8a9039c49", "address": "fa:16:3e:06:9f:52", "network": {"id": "354bf335-0cac-46d9-acb8-5095411f5db9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-306482348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f745a322931e4150b12d139bfb17b94c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2000e5c8-e3", "ovs_interfaceid": "2000e5c8-e30c-44d9-b79c-fac8a9039c49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:38:01 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-219fe94a-2f40-496e-a925-daa445bc026f tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:9f:52,bridge_name='br-int',has_traffic_filtering=True,id=2000e5c8-e30c-44d9-b79c-fac8a9039c49,network=Network(354bf335-0cac-46d9-acb8-5095411f5db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2000e5c8-e3') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:38:01 user nova-compute[74821]: DEBUG os_vif [None req-219fe94a-2f40-496e-a925-daa445bc026f tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:9f:52,bridge_name='br-int',has_traffic_filtering=True,id=2000e5c8-e30c-44d9-b79c-fac8a9039c49,network=Network(354bf335-0cac-46d9-acb8-5095411f5db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2000e5c8-e3') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:38:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2000e5c8-e3, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:38:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:38:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f12123f4-5eea-46d6-a7b2-f20cec842d6b) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:38:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:01 user nova-compute[74821]: INFO os_vif [None req-219fe94a-2f40-496e-a925-daa445bc026f tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:9f:52,bridge_name='br-int',has_traffic_filtering=True,id=2000e5c8-e30c-44d9-b79c-fac8a9039c49,network=Network(354bf335-0cac-46d9-acb8-5095411f5db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2000e5c8-e3')
Nov 06 13:38:01 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-219fe94a-2f40-496e-a925-daa445bc026f tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Deleting instance files /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9_del
Nov 06 13:38:01 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-219fe94a-2f40-496e-a925-daa445bc026f tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Deletion of /opt/stack/data/nova/instances/49c65aca-8392-46ba-8fa3-b47ff2416cb9_del complete
Nov 06 13:38:01 user nova-compute[74821]: INFO nova.compute.manager [None req-219fe94a-2f40-496e-a925-daa445bc026f tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 06 13:38:01 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-219fe94a-2f40-496e-a925-daa445bc026f tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:38:01 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:38:01 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:38:01 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:38:02 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:38:02 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Took 1.15 seconds to deallocate network for instance.
Nov 06 13:38:02 user nova-compute[74821]: DEBUG nova.compute.manager [req-45f4d58e-a594-47ce-a41c-4a9cf1c17996 req-47a581ec-d884-42a5-b72f-1a1fcf721f7c service nova] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Received event network-vif-deleted-2000e5c8-e30c-44d9-b79c-fac8a9039c49 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:38:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-219fe94a-2f40-496e-a925-daa445bc026f tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:38:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-219fe94a-2f40-496e-a925-daa445bc026f tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:38:02 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-219fe94a-2f40-496e-a925-daa445bc026f tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:38:02 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-219fe94a-2f40-496e-a925-daa445bc026f tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:38:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-219fe94a-2f40-496e-a925-daa445bc026f tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.221s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:38:02 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-219fe94a-2f40-496e-a925-daa445bc026f tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Deleted allocations for instance 49c65aca-8392-46ba-8fa3-b47ff2416cb9
Nov 06 13:38:02 user nova-compute[74821]: DEBUG nova.compute.manager [req-8863cfcc-a8a3-437e-8378-238c4785b6a0 req-06c04ae9-d9aa-4c83-a22a-bd4713cc6d16 service nova] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Received event network-vif-plugged-2000e5c8-e30c-44d9-b79c-fac8a9039c49 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:38:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8863cfcc-a8a3-437e-8378-238c4785b6a0 req-06c04ae9-d9aa-4c83-a22a-bd4713cc6d16 service nova] Acquiring lock "49c65aca-8392-46ba-8fa3-b47ff2416cb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:38:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8863cfcc-a8a3-437e-8378-238c4785b6a0 req-06c04ae9-d9aa-4c83-a22a-bd4713cc6d16 service nova] Lock "49c65aca-8392-46ba-8fa3-b47ff2416cb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:38:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8863cfcc-a8a3-437e-8378-238c4785b6a0 req-06c04ae9-d9aa-4c83-a22a-bd4713cc6d16 service nova] Lock "49c65aca-8392-46ba-8fa3-b47ff2416cb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:38:02 user nova-compute[74821]: DEBUG nova.compute.manager [req-8863cfcc-a8a3-437e-8378-238c4785b6a0 req-06c04ae9-d9aa-4c83-a22a-bd4713cc6d16 service nova] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] No waiting events found dispatching network-vif-plugged-2000e5c8-e30c-44d9-b79c-fac8a9039c49 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:38:02 user nova-compute[74821]: WARNING nova.compute.manager [req-8863cfcc-a8a3-437e-8378-238c4785b6a0 req-06c04ae9-d9aa-4c83-a22a-bd4713cc6d16 service nova] [instance: 49c65aca-8392-46ba-8fa3-b47ff2416cb9] Received unexpected event network-vif-plugged-2000e5c8-e30c-44d9-b79c-fac8a9039c49 for instance with vm_state deleted and task_state None.
Nov 06 13:38:03 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-219fe94a-2f40-496e-a925-daa445bc026f tempest-ServerBootFromVolumeStableRescueTest-1064633830 tempest-ServerBootFromVolumeStableRescueTest-1064633830-project-member] Lock "49c65aca-8392-46ba-8fa3-b47ff2416cb9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.583s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:38:06 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:11 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:38:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:14 user nova-compute[74821]: DEBUG nova.compute.manager [req-006000d2-1de2-4e24-bf23-5e9aa2447980 req-d74d9772-4ce5-4960-a414-d4e28525b12d service nova] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Received event network-changed-8f5441a4-a58c-4219-863d-8130491f403b {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:38:14 user nova-compute[74821]: DEBUG nova.compute.manager [req-006000d2-1de2-4e24-bf23-5e9aa2447980 req-d74d9772-4ce5-4960-a414-d4e28525b12d service nova] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Refreshing instance network info cache due to event network-changed-8f5441a4-a58c-4219-863d-8130491f403b. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:38:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-006000d2-1de2-4e24-bf23-5e9aa2447980 req-d74d9772-4ce5-4960-a414-d4e28525b12d service nova] Acquiring lock "refresh_cache-2e10922b-fa67-46a7-895b-3f40a40bf23d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:38:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-006000d2-1de2-4e24-bf23-5e9aa2447980 req-d74d9772-4ce5-4960-a414-d4e28525b12d service nova] Acquired lock "refresh_cache-2e10922b-fa67-46a7-895b-3f40a40bf23d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:38:14 user nova-compute[74821]: DEBUG nova.network.neutron [req-006000d2-1de2-4e24-bf23-5e9aa2447980 req-d74d9772-4ce5-4960-a414-d4e28525b12d service nova] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Refreshing network info cache for port 8f5441a4-a58c-4219-863d-8130491f403b {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:38:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:15 user nova-compute[74821]: DEBUG nova.network.neutron [req-006000d2-1de2-4e24-bf23-5e9aa2447980 req-d74d9772-4ce5-4960-a414-d4e28525b12d service nova] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Updated VIF entry in instance network info cache for port 8f5441a4-a58c-4219-863d-8130491f403b. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:38:15 user nova-compute[74821]: DEBUG nova.network.neutron [req-006000d2-1de2-4e24-bf23-5e9aa2447980 req-d74d9772-4ce5-4960-a414-d4e28525b12d service nova] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Updating instance_info_cache with network_info: [{"id": "8f5441a4-a58c-4219-863d-8130491f403b", "address": "fa:16:3e:9d:bc:6f", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f5441a4-a5", "ovs_interfaceid": "8f5441a4-a58c-4219-863d-8130491f403b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:38:15 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-006000d2-1de2-4e24-bf23-5e9aa2447980 req-d74d9772-4ce5-4960-a414-d4e28525b12d service nova] Releasing lock "refresh_cache-2e10922b-fa67-46a7-895b-3f40a40bf23d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:38:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:20 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "2e10922b-fa67-46a7-895b-3f40a40bf23d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:38:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "2e10922b-fa67-46a7-895b-3f40a40bf23d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:38:21 user nova-compute[74821]: DEBUG nova.objects.instance [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lazy-loading 'flavor' on Instance uuid 2e10922b-fa67-46a7-895b-3f40a40bf23d {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:38:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "2e10922b-fa67-46a7-895b-3f40a40bf23d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:38:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "2e10922b-fa67-46a7-895b-3f40a40bf23d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:38:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "2e10922b-fa67-46a7-895b-3f40a40bf23d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:38:21 user nova-compute[74821]: INFO nova.compute.manager [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Attaching volume a094de47-549f-46df-a43f-af414364483a to /dev/vdb
Nov 06 13:38:21 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:21 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:21 user nova-compute[74821]: DEBUG os_brick.utils [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:38:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:38:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:38:21 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a840a864-877c-4c44-8a0f-886ae3309a5e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:38:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:38:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:38:21 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f800b83-d3ed-47f8-9862-edf647a86363]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:38:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:38:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:38:21 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae00ab3-cc2a-4f19-99c6-f191b66c0bb9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:38:21 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe99a2e6-3ed0-4832-898e-f8b9056aa859]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:38:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:38:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:38:21 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:38:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:38:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:38:21 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:38:21 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4265368b-6fd1-4f2c-ae8a-2e64a7d8d282]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:38:21 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:38:21 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:38:21 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:38:21 user nova-compute[74821]: DEBUG os_brick.utils [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:38:21 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Updating existing volume attachment record: bcc86ce7-2d2f-46fa-9ab0-2367fadfc05d {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:38:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Acquiring lock "db04d895-338b-46fb-af08-779ad5d1181d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:38:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "db04d895-338b-46fb-af08-779ad5d1181d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:38:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:38:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:38:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:38:26 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:38:26 user nova-compute[74821]: INFO nova.compute.claims [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Claim successful on node user
Nov 06 13:38:26 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:38:26 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:38:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.290s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:38:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:38:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:38:26 user nova-compute[74821]: DEBUG nova.network.neutron [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:38:26 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:38:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:38:26 user nova-compute[74821]: DEBUG nova.policy [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44a138b3c24e462287d29a4b892b5923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a79b69221f742dc9f128dd708d1b9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:38:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:38:26 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:38:26 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Creating image(s)
Nov 06 13:38:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Acquiring lock "/opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:38:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "/opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:38:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "/opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:38:26 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:38:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.187s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:38:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:38:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:38:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:38:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.209s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:38:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:38:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk 1073741824" returned: 0 in 0.051s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:38:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:38:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:38:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.175s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:38:27 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Checking if we can resize image /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:38:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:38:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:38:27 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Cannot resize image /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:38:27 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:38:27 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Ensure instance console log exists: /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:38:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:38:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:38:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:38:27 user nova-compute[74821]: DEBUG nova.network.neutron [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Successfully created port: 0997f4aa-17bc-4f72-b43a-63eb00bd4a71 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:38:28 user nova-compute[74821]: DEBUG nova.network.neutron [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Successfully updated port: 0997f4aa-17bc-4f72-b43a-63eb00bd4a71 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:38:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Acquiring lock "refresh_cache-db04d895-338b-46fb-af08-779ad5d1181d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:38:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Acquired lock "refresh_cache-db04d895-338b-46fb-af08-779ad5d1181d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:38:28 user nova-compute[74821]: DEBUG nova.network.neutron [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:38:28 user nova-compute[74821]: DEBUG nova.compute.manager [req-ded037be-e251-446c-b7e2-0af5e0cf9d54 req-a62f197f-4cb1-4683-a97c-d55146fa39c8 service nova] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Received event network-changed-0997f4aa-17bc-4f72-b43a-63eb00bd4a71 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:38:28 user nova-compute[74821]: DEBUG nova.compute.manager [req-ded037be-e251-446c-b7e2-0af5e0cf9d54 req-a62f197f-4cb1-4683-a97c-d55146fa39c8 service nova] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Refreshing instance network info cache due to event network-changed-0997f4aa-17bc-4f72-b43a-63eb00bd4a71. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:38:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ded037be-e251-446c-b7e2-0af5e0cf9d54 req-a62f197f-4cb1-4683-a97c-d55146fa39c8 service nova] Acquiring lock "refresh_cache-db04d895-338b-46fb-af08-779ad5d1181d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:38:28 user nova-compute[74821]: DEBUG nova.network.neutron [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.compute.manager [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:38:29 user nova-compute[74821]: INFO nova.compute.claims [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Claim successful on node user
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.network.neutron [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Updating instance_info_cache with network_info: [{"id": "0997f4aa-17bc-4f72-b43a-63eb00bd4a71", "address": "fa:16:3e:46:dc:53", "network": {"id": "9dfb5db2-5cef-4f79-a41d-af4ae6967c09", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1976265278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a79b69221f742dc9f128dd708d1b9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0997f4aa-17", "ovs_interfaceid": "0997f4aa-17bc-4f72-b43a-63eb00bd4a71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Releasing lock "refresh_cache-db04d895-338b-46fb-af08-779ad5d1181d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.compute.manager [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Instance network_info: |[{"id": "0997f4aa-17bc-4f72-b43a-63eb00bd4a71", "address": "fa:16:3e:46:dc:53", "network": {"id": "9dfb5db2-5cef-4f79-a41d-af4ae6967c09", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1976265278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a79b69221f742dc9f128dd708d1b9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0997f4aa-17", "ovs_interfaceid": "0997f4aa-17bc-4f72-b43a-63eb00bd4a71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ded037be-e251-446c-b7e2-0af5e0cf9d54 req-a62f197f-4cb1-4683-a97c-d55146fa39c8 service nova] Acquired lock "refresh_cache-db04d895-338b-46fb-af08-779ad5d1181d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.network.neutron [req-ded037be-e251-446c-b7e2-0af5e0cf9d54 req-a62f197f-4cb1-4683-a97c-d55146fa39c8 service nova] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Refreshing network info cache for port 0997f4aa-17bc-4f72-b43a-63eb00bd4a71 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Start _get_guest_xml network_info=[{"id": "0997f4aa-17bc-4f72-b43a-63eb00bd4a71", "address": "fa:16:3e:46:dc:53", "network": {"id": "9dfb5db2-5cef-4f79-a41d-af4ae6967c09", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1976265278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a79b69221f742dc9f128dd708d1b9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0997f4aa-17", "ovs_interfaceid": "0997f4aa-17bc-4f72-b43a-63eb00bd4a71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:38:29 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:38:29 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-335810033',display_name='tempest-SnapshotDataIntegrityTests-server-335810033',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-335810033',id=43,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGRM2scSWIB9SJVmVaK/TIRflWA9+OKPVB/HP4WWZWcIPzN8dsrSzB4SmzKnfq19/ZTqcIPWLmq+BLb/XrmixEZclq08+LpZtf2QCzhMkqaUtNiA51kyuD8lF/xjis8Yw==',key_name='tempest-keypair-1748001198',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a79b69221f742dc9f128dd708d1b9c9',ramdisk_id='',reservation_id='r-h92c1vgc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1195143959',owner_user_name='tempest-SnapshotDataIntegrityTests-1195143959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44a138b3c24e462287d29a4b892b5923',uuid=db04d895-338b-46fb-af08-779ad5d1181d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0997f4aa-17bc-4f72-b43a-63eb00bd4a71", "address": "fa:16:3e:46:dc:53", "network": {"id": "9dfb5db2-5cef-4f79-a41d-af4ae6967c09", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1976265278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a79b69221f742dc9f128dd708d1b9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0997f4aa-17", "ovs_interfaceid": "0997f4aa-17bc-4f72-b43a-63eb00bd4a71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Converting VIF {"id": "0997f4aa-17bc-4f72-b43a-63eb00bd4a71", "address": "fa:16:3e:46:dc:53", "network": {"id": "9dfb5db2-5cef-4f79-a41d-af4ae6967c09", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1976265278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a79b69221f742dc9f128dd708d1b9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0997f4aa-17", "ovs_interfaceid": "0997f4aa-17bc-4f72-b43a-63eb00bd4a71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:dc:53,bridge_name='br-int',has_traffic_filtering=True,id=0997f4aa-17bc-4f72-b43a-63eb00bd4a71,network=Network(9dfb5db2-5cef-4f79-a41d-af4ae6967c09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0997f4aa-17') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.objects.instance [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lazy-loading 'pci_devices' on Instance uuid db04d895-338b-46fb-af08-779ad5d1181d {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:38:29 user nova-compute[74821]:   <uuid>db04d895-338b-46fb-af08-779ad5d1181d</uuid>
Nov 06 13:38:29 user nova-compute[74821]:   <name>instance-0000002b</name>
Nov 06 13:38:29 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:38:29 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:38:29 user nova-compute[74821]:   <metadata>
Nov 06 13:38:29 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:38:29 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:38:29 user nova-compute[74821]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-335810033</nova:name>
Nov 06 13:38:29 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:38:29</nova:creationTime>
Nov 06 13:38:29 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:38:29 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:38:29 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:38:29 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:38:29 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:38:29 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:38:29 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:38:29 user nova-compute[74821]:       <nova:owner>
Nov 06 13:38:29 user nova-compute[74821]:         <nova:user uuid="44a138b3c24e462287d29a4b892b5923">tempest-SnapshotDataIntegrityTests-1195143959-project-member</nova:user>
Nov 06 13:38:29 user nova-compute[74821]:         <nova:project uuid="5a79b69221f742dc9f128dd708d1b9c9">tempest-SnapshotDataIntegrityTests-1195143959</nova:project>
Nov 06 13:38:29 user nova-compute[74821]:       </nova:owner>
Nov 06 13:38:29 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:38:29 user nova-compute[74821]:       <nova:ports>
Nov 06 13:38:29 user nova-compute[74821]:         <nova:port uuid="0997f4aa-17bc-4f72-b43a-63eb00bd4a71">
Nov 06 13:38:29 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 06 13:38:29 user nova-compute[74821]:         </nova:port>
Nov 06 13:38:29 user nova-compute[74821]:       </nova:ports>
Nov 06 13:38:29 user nova-compute[74821]:     </nova:instance>
Nov 06 13:38:29 user nova-compute[74821]:   </metadata>
Nov 06 13:38:29 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:38:29 user nova-compute[74821]:     <system>
Nov 06 13:38:29 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:38:29 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:38:29 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:38:29 user nova-compute[74821]:       <entry name="serial">db04d895-338b-46fb-af08-779ad5d1181d</entry>
Nov 06 13:38:29 user nova-compute[74821]:       <entry name="uuid">db04d895-338b-46fb-af08-779ad5d1181d</entry>
Nov 06 13:38:29 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:38:29 user nova-compute[74821]:     </system>
Nov 06 13:38:29 user nova-compute[74821]:   </sysinfo>
Nov 06 13:38:29 user nova-compute[74821]:   <os>
Nov 06 13:38:29 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:38:29 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:38:29 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:38:29 user nova-compute[74821]:   </os>
Nov 06 13:38:29 user nova-compute[74821]:   <features>
Nov 06 13:38:29 user nova-compute[74821]:     <acpi/>
Nov 06 13:38:29 user nova-compute[74821]:     <apic/>
Nov 06 13:38:29 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:38:29 user nova-compute[74821]:   </features>
Nov 06 13:38:29 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:38:29 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:38:29 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:38:29 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:38:29 user nova-compute[74821]:   </clock>
Nov 06 13:38:29 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:38:29 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:38:29 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:38:29 user nova-compute[74821]:   </cpu>
Nov 06 13:38:29 user nova-compute[74821]:   <devices>
Nov 06 13:38:29 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:38:29 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:38:29 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk"/>
Nov 06 13:38:29 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:38:29 user nova-compute[74821]:     </disk>
Nov 06 13:38:29 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:38:29 user nova-compute[74821]:       <mac address="fa:16:3e:46:dc:53"/>
Nov 06 13:38:29 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:38:29 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:38:29 user nova-compute[74821]:       <target dev="tap0997f4aa-17"/>
Nov 06 13:38:29 user nova-compute[74821]:     </interface>
Nov 06 13:38:29 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:38:29 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/console.log" append="off"/>
Nov 06 13:38:29 user nova-compute[74821]:     </serial>
Nov 06 13:38:29 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:38:29 user nova-compute[74821]:     <video>
Nov 06 13:38:29 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:38:29 user nova-compute[74821]:     </video>
Nov 06 13:38:29 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:38:29 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:38:29 user nova-compute[74821]:     </rng>
Nov 06 13:38:29 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:38:29 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:38:29 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:38:29 user nova-compute[74821]:     </memballoon>
Nov 06 13:38:29 user nova-compute[74821]:   </devices>
Nov 06 13:38:29 user nova-compute[74821]: </domain>
Nov 06 13:38:29 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-335810033',display_name='tempest-SnapshotDataIntegrityTests-server-335810033',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-335810033',id=43,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGRM2scSWIB9SJVmVaK/TIRflWA9+OKPVB/HP4WWZWcIPzN8dsrSzB4SmzKnfq19/ZTqcIPWLmq+BLb/XrmixEZclq08+LpZtf2QCzhMkqaUtNiA51kyuD8lF/xjis8Yw==',key_name='tempest-keypair-1748001198',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a79b69221f742dc9f128dd708d1b9c9',ramdisk_id='',reservation_id='r-h92c1vgc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1195143959',owner_user_name='tempest-SnapshotDataIntegrityTests-1195143959-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44a138b3c24e462287d29a4b892b5923',uuid=db04d895-338b-46fb-af08-779ad5d1181d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0997f4aa-17bc-4f72-b43a-63eb00bd4a71", "address": "fa:16:3e:46:dc:53", "network": {"id": "9dfb5db2-5cef-4f79-a41d-af4ae6967c09", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1976265278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a79b69221f742dc9f128dd708d1b9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0997f4aa-17", "ovs_interfaceid": "0997f4aa-17bc-4f72-b43a-63eb00bd4a71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Converting VIF {"id": "0997f4aa-17bc-4f72-b43a-63eb00bd4a71", "address": "fa:16:3e:46:dc:53", "network": {"id": "9dfb5db2-5cef-4f79-a41d-af4ae6967c09", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1976265278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a79b69221f742dc9f128dd708d1b9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0997f4aa-17", "ovs_interfaceid": "0997f4aa-17bc-4f72-b43a-63eb00bd4a71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:dc:53,bridge_name='br-int',has_traffic_filtering=True,id=0997f4aa-17bc-4f72-b43a-63eb00bd4a71,network=Network(9dfb5db2-5cef-4f79-a41d-af4ae6967c09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0997f4aa-17') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG os_vif [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:dc:53,bridge_name='br-int',has_traffic_filtering=True,id=0997f4aa-17bc-4f72-b43a-63eb00bd4a71,network=Network(9dfb5db2-5cef-4f79-a41d-af4ae6967c09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0997f4aa-17') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bb1e1cfe-e904-5e32-80cd-6c7f97759e2b', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0997f4aa-17, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0997f4aa-17, col_values=(('qos', UUID('16611c90-0759-485c-92f9-e700ddc12afd')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0997f4aa-17, col_values=(('external_ids', {'iface-id': '0997f4aa-17bc-4f72-b43a-63eb00bd4a71', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:dc:53', 'vm-uuid': 'db04d895-338b-46fb-af08-779ad5d1181d'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:29 user nova-compute[74821]: INFO os_vif [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:dc:53,bridge_name='br-int',has_traffic_filtering=True,id=0997f4aa-17bc-4f72-b43a-63eb00bd4a71,network=Network(9dfb5db2-5cef-4f79-a41d-af4ae6967c09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0997f4aa-17')
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] No VIF found with MAC fa:16:3e:46:dc:53, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.371s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.compute.manager [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.compute.manager [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.network.neutron [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:38:29 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.network.neutron [req-ded037be-e251-446c-b7e2-0af5e0cf9d54 req-a62f197f-4cb1-4683-a97c-d55146fa39c8 service nova] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Updated VIF entry in instance network info cache for port 0997f4aa-17bc-4f72-b43a-63eb00bd4a71. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.network.neutron [req-ded037be-e251-446c-b7e2-0af5e0cf9d54 req-a62f197f-4cb1-4683-a97c-d55146fa39c8 service nova] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Updating instance_info_cache with network_info: [{"id": "0997f4aa-17bc-4f72-b43a-63eb00bd4a71", "address": "fa:16:3e:46:dc:53", "network": {"id": "9dfb5db2-5cef-4f79-a41d-af4ae6967c09", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1976265278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a79b69221f742dc9f128dd708d1b9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0997f4aa-17", "ovs_interfaceid": "0997f4aa-17bc-4f72-b43a-63eb00bd4a71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.compute.manager [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ded037be-e251-446c-b7e2-0af5e0cf9d54 req-a62f197f-4cb1-4683-a97c-d55146fa39c8 service nova] Releasing lock "refresh_cache-db04d895-338b-46fb-af08-779ad5d1181d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:38:29 user nova-compute[74821]: DEBUG nova.policy [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19e457098f3242979db3fc25390965a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2772db4aac63412fb8cfe945c89f7156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:38:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:30 user nova-compute[74821]: DEBUG nova.compute.manager [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:38:30 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:38:30 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Creating image(s)
Nov 06 13:38:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "/opt/stack/data/nova/instances/929e1e7d-3abf-4c2f-b792-16b0ef970d88/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:38:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "/opt/stack/data/nova/instances/929e1e7d-3abf-4c2f-b792-16b0ef970d88/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:38:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "/opt/stack/data/nova/instances/929e1e7d-3abf-4c2f-b792-16b0ef970d88/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:38:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "406e8191d82b819844fed77b556cd6d5e9162d2c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:38:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "406e8191d82b819844fed77b556cd6d5e9162d2c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:38:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/406e8191d82b819844fed77b556cd6d5e9162d2c.part --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:38:30 user nova-compute[74821]: DEBUG nova.network.neutron [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Successfully created port: f0259675-f417-4927-993f-769bab8f0086 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:38:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/406e8191d82b819844fed77b556cd6d5e9162d2c.part --force-share --output=json" returned: 0 in 0.188s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:38:30 user nova-compute[74821]: DEBUG nova.virt.images [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] 21b25f4e-5a63-4244-acb3-f39a4c13700d was qcow2, converting to raw {{(pid=74821) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 06 13:38:30 user nova-compute[74821]: DEBUG nova.privsep.utils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74821) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 06 13:38:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/406e8191d82b819844fed77b556cd6d5e9162d2c.part /opt/stack/data/nova/instances/_base/406e8191d82b819844fed77b556cd6d5e9162d2c.converted {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:38:31 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:31 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:31 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/406e8191d82b819844fed77b556cd6d5e9162d2c.part /opt/stack/data/nova/instances/_base/406e8191d82b819844fed77b556cd6d5e9162d2c.converted" returned: 0 in 0.757s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:38:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/406e8191d82b819844fed77b556cd6d5e9162d2c.converted --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:38:31 user nova-compute[74821]: DEBUG nova.compute.manager [req-3a73f98a-fa44-4230-a366-f27f1d65671f req-b0ea5f49-25d7-4d0f-9d0f-111d08a6b38a service nova] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Received event network-vif-plugged-0997f4aa-17bc-4f72-b43a-63eb00bd4a71 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:38:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3a73f98a-fa44-4230-a366-f27f1d65671f req-b0ea5f49-25d7-4d0f-9d0f-111d08a6b38a service nova] Acquiring lock "db04d895-338b-46fb-af08-779ad5d1181d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:38:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3a73f98a-fa44-4230-a366-f27f1d65671f req-b0ea5f49-25d7-4d0f-9d0f-111d08a6b38a service nova] Lock "db04d895-338b-46fb-af08-779ad5d1181d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:38:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3a73f98a-fa44-4230-a366-f27f1d65671f req-b0ea5f49-25d7-4d0f-9d0f-111d08a6b38a service nova] Lock "db04d895-338b-46fb-af08-779ad5d1181d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:38:31 user nova-compute[74821]: DEBUG nova.compute.manager [req-3a73f98a-fa44-4230-a366-f27f1d65671f req-b0ea5f49-25d7-4d0f-9d0f-111d08a6b38a service nova] [instance: db04d895-338b-46fb-af08-779ad5d1181d] No waiting events found dispatching network-vif-plugged-0997f4aa-17bc-4f72-b43a-63eb00bd4a71 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:38:31 user nova-compute[74821]: WARNING nova.compute.manager [req-3a73f98a-fa44-4230-a366-f27f1d65671f req-b0ea5f49-25d7-4d0f-9d0f-111d08a6b38a service nova] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Received unexpected event network-vif-plugged-0997f4aa-17bc-4f72-b43a-63eb00bd4a71 for instance with vm_state building and task_state spawning.
Nov 06 13:38:31 user nova-compute[74821]: DEBUG nova.network.neutron [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Successfully updated port: f0259675-f417-4927-993f-769bab8f0086 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:38:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "refresh_cache-929e1e7d-3abf-4c2f-b792-16b0ef970d88" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:38:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquired lock "refresh_cache-929e1e7d-3abf-4c2f-b792-16b0ef970d88" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:38:31 user nova-compute[74821]: DEBUG nova.network.neutron [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:38:31 user nova-compute[74821]: DEBUG nova.compute.manager [req-b86a04b3-48a9-4156-af7f-b36ac7241f6c req-1d8db412-5af0-4136-85b7-176b26773568 service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Received event network-changed-f0259675-f417-4927-993f-769bab8f0086 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:38:31 user nova-compute[74821]: DEBUG nova.compute.manager [req-b86a04b3-48a9-4156-af7f-b36ac7241f6c req-1d8db412-5af0-4136-85b7-176b26773568 service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Refreshing instance network info cache due to event network-changed-f0259675-f417-4927-993f-769bab8f0086. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:38:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b86a04b3-48a9-4156-af7f-b36ac7241f6c req-1d8db412-5af0-4136-85b7-176b26773568 service nova] Acquiring lock "refresh_cache-929e1e7d-3abf-4c2f-b792-16b0ef970d88" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:38:31 user nova-compute[74821]: DEBUG nova.network.neutron [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:38:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/406e8191d82b819844fed77b556cd6d5e9162d2c.converted --force-share --output=json" returned: 0 in 0.253s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:38:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "406e8191d82b819844fed77b556cd6d5e9162d2c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.770s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:38:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/406e8191d82b819844fed77b556cd6d5e9162d2c --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/406e8191d82b819844fed77b556cd6d5e9162d2c --force-share --output=json" returned: 0 in 0.214s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "406e8191d82b819844fed77b556cd6d5e9162d2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "406e8191d82b819844fed77b556cd6d5e9162d2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/406e8191d82b819844fed77b556cd6d5e9162d2c --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG nova.network.neutron [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Updating instance_info_cache with network_info: [{"id": "f0259675-f417-4927-993f-769bab8f0086", "address": "fa:16:3e:de:27:55", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0259675-f4", "ovs_interfaceid": "f0259675-f417-4927-993f-769bab8f0086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Releasing lock "refresh_cache-929e1e7d-3abf-4c2f-b792-16b0ef970d88" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG nova.compute.manager [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Instance network_info: |[{"id": "f0259675-f417-4927-993f-769bab8f0086", "address": "fa:16:3e:de:27:55", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0259675-f4", "ovs_interfaceid": "f0259675-f417-4927-993f-769bab8f0086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b86a04b3-48a9-4156-af7f-b36ac7241f6c req-1d8db412-5af0-4136-85b7-176b26773568 service nova] Acquired lock "refresh_cache-929e1e7d-3abf-4c2f-b792-16b0ef970d88" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG nova.network.neutron [req-b86a04b3-48a9-4156-af7f-b36ac7241f6c req-1d8db412-5af0-4136-85b7-176b26773568 service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Refreshing network info cache for port f0259675-f417-4927-993f-769bab8f0086 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/406e8191d82b819844fed77b556cd6d5e9162d2c --force-share --output=json" returned: 0 in 0.200s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/406e8191d82b819844fed77b556cd6d5e9162d2c,backing_fmt=raw /opt/stack/data/nova/instances/929e1e7d-3abf-4c2f-b792-16b0ef970d88/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/406e8191d82b819844fed77b556cd6d5e9162d2c,backing_fmt=raw /opt/stack/data/nova/instances/929e1e7d-3abf-4c2f-b792-16b0ef970d88/disk 1073741824" returned: 0 in 0.050s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "406e8191d82b819844fed77b556cd6d5e9162d2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/406e8191d82b819844fed77b556cd6d5e9162d2c --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/406e8191d82b819844fed77b556cd6d5e9162d2c --force-share --output=json" returned: 0 in 0.178s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Checking if we can resize image /opt/stack/data/nova/instances/929e1e7d-3abf-4c2f-b792-16b0ef970d88/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e1e7d-3abf-4c2f-b792-16b0ef970d88/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e1e7d-3abf-4c2f-b792-16b0ef970d88/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Cannot resize image /opt/stack/data/nova/instances/929e1e7d-3abf-4c2f-b792-16b0ef970d88/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Ensure instance console log exists: /opt/stack/data/nova/instances/929e1e7d-3abf-4c2f-b792-16b0ef970d88/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Start _get_guest_xml network_info=[{"id": "f0259675-f417-4927-993f-769bab8f0086", "address": "fa:16:3e:de:27:55", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0259675-f4", "ovs_interfaceid": "f0259675-f417-4927-993f-769bab8f0086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:38:25Z,direct_url=<?>,disk_format='qcow2',id=21b25f4e-5a63-4244-acb3-f39a4c13700d,min_disk=0,min_ram=0,name='tempest-scenario-img--129812663',owner='2772db4aac63412fb8cfe945c89f7156',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:38:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '21b25f4e-5a63-4244-acb3-f39a4c13700d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:38:32 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:38:32 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:38:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:38:25Z,direct_url=<?>,disk_format='qcow2',id=21b25f4e-5a63-4244-acb3-f39a4c13700d,min_disk=0,min_ram=0,name='tempest-scenario-img--129812663',owner='2772db4aac63412fb8cfe945c89f7156',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:38:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:38:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-584527761',display_name='tempest-TestMinimumBasicScenario-server-584527761',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-584527761',id=44,image_ref='21b25f4e-5a63-4244-acb3-f39a4c13700d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJy0BO/dDw3FKfQJnWRxfcEU1+xWCTLEWzSYIFWI6XGAnsTY2LNSK10eN3A97l8XSNFtymVwEeQfrelcSe6wBru5Hleo7BiT2Og49tPTmaLlpCAr/OR2LCBG7D543Fr1Ew==',key_name='tempest-TestMinimumBasicScenario-1166531264',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2772db4aac63412fb8cfe945c89f7156',ramdisk_id='',reservation_id='r-x6kbq8o3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21b25f4e-5a63-4244-acb3-f39a4c13700d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1779731878',owner_user_name='tempest-TestMinimumBasicScenario-1779731878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:38:30Z,user_data=None,user_id='19e457098f3242979db3fc25390965a4',uuid=929e1e7d-3abf-4c2f-b792-16b0ef970d88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0259675-f417-4927-993f-769bab8f0086", "address": "fa:16:3e:de:27:55", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0259675-f4", "ovs_interfaceid": "f0259675-f417-4927-993f-769bab8f0086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Converting VIF {"id": "f0259675-f417-4927-993f-769bab8f0086", "address": "fa:16:3e:de:27:55", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0259675-f4", "ovs_interfaceid": "f0259675-f417-4927-993f-769bab8f0086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:27:55,bridge_name='br-int',has_traffic_filtering=True,id=f0259675-f417-4927-993f-769bab8f0086,network=Network(57870f63-b015-4453-ae32-18f642d7c4b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0259675-f4') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG nova.objects.instance [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lazy-loading 'pci_devices' on Instance uuid 929e1e7d-3abf-4c2f-b792-16b0ef970d88 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG nova.network.neutron [req-b86a04b3-48a9-4156-af7f-b36ac7241f6c req-1d8db412-5af0-4136-85b7-176b26773568 service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Updated VIF entry in instance network info cache for port f0259675-f417-4927-993f-769bab8f0086. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG nova.network.neutron [req-b86a04b3-48a9-4156-af7f-b36ac7241f6c req-1d8db412-5af0-4136-85b7-176b26773568 service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Updating instance_info_cache with network_info: [{"id": "f0259675-f417-4927-993f-769bab8f0086", "address": "fa:16:3e:de:27:55", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0259675-f4", "ovs_interfaceid": "f0259675-f417-4927-993f-769bab8f0086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:38:32 user nova-compute[74821]:   <uuid>929e1e7d-3abf-4c2f-b792-16b0ef970d88</uuid>
Nov 06 13:38:32 user nova-compute[74821]:   <name>instance-0000002c</name>
Nov 06 13:38:32 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:38:32 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:38:32 user nova-compute[74821]:   <metadata>
Nov 06 13:38:32 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:38:32 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:38:32 user nova-compute[74821]:       <nova:name>tempest-TestMinimumBasicScenario-server-584527761</nova:name>
Nov 06 13:38:32 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:38:32</nova:creationTime>
Nov 06 13:38:32 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:38:32 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:38:32 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:38:32 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:38:32 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:38:32 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:38:32 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:38:32 user nova-compute[74821]:       <nova:owner>
Nov 06 13:38:32 user nova-compute[74821]:         <nova:user uuid="19e457098f3242979db3fc25390965a4">tempest-TestMinimumBasicScenario-1779731878-project-member</nova:user>
Nov 06 13:38:32 user nova-compute[74821]:         <nova:project uuid="2772db4aac63412fb8cfe945c89f7156">tempest-TestMinimumBasicScenario-1779731878</nova:project>
Nov 06 13:38:32 user nova-compute[74821]:       </nova:owner>
Nov 06 13:38:32 user nova-compute[74821]:       <nova:root type="image" uuid="21b25f4e-5a63-4244-acb3-f39a4c13700d"/>
Nov 06 13:38:32 user nova-compute[74821]:       <nova:ports>
Nov 06 13:38:32 user nova-compute[74821]:         <nova:port uuid="f0259675-f417-4927-993f-769bab8f0086">
Nov 06 13:38:32 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 06 13:38:32 user nova-compute[74821]:         </nova:port>
Nov 06 13:38:32 user nova-compute[74821]:       </nova:ports>
Nov 06 13:38:32 user nova-compute[74821]:     </nova:instance>
Nov 06 13:38:32 user nova-compute[74821]:   </metadata>
Nov 06 13:38:32 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:38:32 user nova-compute[74821]:     <system>
Nov 06 13:38:32 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:38:32 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:38:32 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:38:32 user nova-compute[74821]:       <entry name="serial">929e1e7d-3abf-4c2f-b792-16b0ef970d88</entry>
Nov 06 13:38:32 user nova-compute[74821]:       <entry name="uuid">929e1e7d-3abf-4c2f-b792-16b0ef970d88</entry>
Nov 06 13:38:32 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:38:32 user nova-compute[74821]:     </system>
Nov 06 13:38:32 user nova-compute[74821]:   </sysinfo>
Nov 06 13:38:32 user nova-compute[74821]:   <os>
Nov 06 13:38:32 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:38:32 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:38:32 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:38:32 user nova-compute[74821]:   </os>
Nov 06 13:38:32 user nova-compute[74821]:   <features>
Nov 06 13:38:32 user nova-compute[74821]:     <acpi/>
Nov 06 13:38:32 user nova-compute[74821]:     <apic/>
Nov 06 13:38:32 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:38:32 user nova-compute[74821]:   </features>
Nov 06 13:38:32 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:38:32 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:38:32 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:38:32 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:38:32 user nova-compute[74821]:   </clock>
Nov 06 13:38:32 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:38:32 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:38:32 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:38:32 user nova-compute[74821]:   </cpu>
Nov 06 13:38:32 user nova-compute[74821]:   <devices>
Nov 06 13:38:32 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:38:32 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:38:32 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/929e1e7d-3abf-4c2f-b792-16b0ef970d88/disk"/>
Nov 06 13:38:32 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:38:32 user nova-compute[74821]:     </disk>
Nov 06 13:38:32 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:38:32 user nova-compute[74821]:       <mac address="fa:16:3e:de:27:55"/>
Nov 06 13:38:32 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:38:32 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:38:32 user nova-compute[74821]:       <target dev="tapf0259675-f4"/>
Nov 06 13:38:32 user nova-compute[74821]:     </interface>
Nov 06 13:38:32 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:38:32 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/929e1e7d-3abf-4c2f-b792-16b0ef970d88/console.log" append="off"/>
Nov 06 13:38:32 user nova-compute[74821]:     </serial>
Nov 06 13:38:32 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:38:32 user nova-compute[74821]:     <video>
Nov 06 13:38:32 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:38:32 user nova-compute[74821]:     </video>
Nov 06 13:38:32 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:38:32 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:38:32 user nova-compute[74821]:     </rng>
Nov 06 13:38:32 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:38:32 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:38:32 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:38:32 user nova-compute[74821]:     </memballoon>
Nov 06 13:38:32 user nova-compute[74821]:   </devices>
Nov 06 13:38:32 user nova-compute[74821]: </domain>
Nov 06 13:38:32 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:38:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-584527761',display_name='tempest-TestMinimumBasicScenario-server-584527761',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-584527761',id=44,image_ref='21b25f4e-5a63-4244-acb3-f39a4c13700d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJy0BO/dDw3FKfQJnWRxfcEU1+xWCTLEWzSYIFWI6XGAnsTY2LNSK10eN3A97l8XSNFtymVwEeQfrelcSe6wBru5Hleo7BiT2Og49tPTmaLlpCAr/OR2LCBG7D543Fr1Ew==',key_name='tempest-TestMinimumBasicScenario-1166531264',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2772db4aac63412fb8cfe945c89f7156',ramdisk_id='',reservation_id='r-x6kbq8o3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21b25f4e-5a63-4244-acb3-f39a4c13700d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1779731878',owner_user_name='tempest-TestMinimumBasicScenario-1779731878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:38:30Z,user_data=None,user_id='19e457098f3242979db3fc25390965a4',uuid=929e1e7d-3abf-4c2f-b792-16b0ef970d88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0259675-f417-4927-993f-769bab8f0086", "address": "fa:16:3e:de:27:55", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0259675-f4", "ovs_interfaceid": "f0259675-f417-4927-993f-769bab8f0086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Converting VIF {"id": "f0259675-f417-4927-993f-769bab8f0086", "address": "fa:16:3e:de:27:55", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0259675-f4", "ovs_interfaceid": "f0259675-f417-4927-993f-769bab8f0086", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:27:55,bridge_name='br-int',has_traffic_filtering=True,id=f0259675-f417-4927-993f-769bab8f0086,network=Network(57870f63-b015-4453-ae32-18f642d7c4b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0259675-f4') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG os_vif [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:27:55,bridge_name='br-int',has_traffic_filtering=True,id=f0259675-f417-4927-993f-769bab8f0086,network=Network(57870f63-b015-4453-ae32-18f642d7c4b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0259675-f4') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b86a04b3-48a9-4156-af7f-b36ac7241f6c req-1d8db412-5af0-4136-85b7-176b26773568 service nova] Releasing lock "refresh_cache-929e1e7d-3abf-4c2f-b792-16b0ef970d88" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b5d0c621-e335-55d6-8cb2-b111bb8212f1', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0259675-f4, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf0259675-f4, col_values=(('qos', UUID('549018e4-3396-47d3-a2b1-845ade0fbca1')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf0259675-f4, col_values=(('external_ids', {'iface-id': 'f0259675-f417-4927-993f-769bab8f0086', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:27:55', 'vm-uuid': '929e1e7d-3abf-4c2f-b792-16b0ef970d88'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:32 user nova-compute[74821]: INFO os_vif [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:27:55,bridge_name='br-int',has_traffic_filtering=True,id=f0259675-f417-4927-993f-769bab8f0086,network=Network(57870f63-b015-4453-ae32-18f642d7c4b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0259675-f4')
Nov 06 13:38:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:38:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] No VIF found with MAC fa:16:3e:de:27:55, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:38:33 user nova-compute[74821]: DEBUG nova.compute.manager [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:38:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:38:33 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Instance spawned successfully.
Nov 06 13:38:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:38:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:38:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:38:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:38:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:38:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:38:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:38:33 user nova-compute[74821]: INFO nova.compute.manager [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Took 6.79 seconds to spawn the instance on the hypervisor.
Nov 06 13:38:33 user nova-compute[74821]: DEBUG nova.compute.manager [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:38:33 user nova-compute[74821]: DEBUG nova.compute.manager [req-fc3d0a2a-d896-43ba-bd6a-4f20403dc3ea req-ab4902a1-10e2-47d8-913b-a4d5c42e1be6 service nova] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Received event network-vif-plugged-0997f4aa-17bc-4f72-b43a-63eb00bd4a71 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:38:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fc3d0a2a-d896-43ba-bd6a-4f20403dc3ea req-ab4902a1-10e2-47d8-913b-a4d5c42e1be6 service nova] Acquiring lock "db04d895-338b-46fb-af08-779ad5d1181d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:38:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fc3d0a2a-d896-43ba-bd6a-4f20403dc3ea req-ab4902a1-10e2-47d8-913b-a4d5c42e1be6 service nova] Lock "db04d895-338b-46fb-af08-779ad5d1181d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:38:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-fc3d0a2a-d896-43ba-bd6a-4f20403dc3ea req-ab4902a1-10e2-47d8-913b-a4d5c42e1be6 service nova] Lock "db04d895-338b-46fb-af08-779ad5d1181d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:38:33 user nova-compute[74821]: DEBUG nova.compute.manager [req-fc3d0a2a-d896-43ba-bd6a-4f20403dc3ea req-ab4902a1-10e2-47d8-913b-a4d5c42e1be6 service nova] [instance: db04d895-338b-46fb-af08-779ad5d1181d] No waiting events found dispatching network-vif-plugged-0997f4aa-17bc-4f72-b43a-63eb00bd4a71 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:38:33 user nova-compute[74821]: WARNING nova.compute.manager [req-fc3d0a2a-d896-43ba-bd6a-4f20403dc3ea req-ab4902a1-10e2-47d8-913b-a4d5c42e1be6 service nova] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Received unexpected event network-vif-plugged-0997f4aa-17bc-4f72-b43a-63eb00bd4a71 for instance with vm_state building and task_state spawning.
Nov 06 13:38:33 user nova-compute[74821]: INFO nova.compute.manager [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Took 7.43 seconds to build instance.
Nov 06 13:38:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d16f47f8-2531-479c-b631-7d43f930b93b tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "db04d895-338b-46fb-af08-779ad5d1181d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.542s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:38:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:34 user nova-compute[74821]: DEBUG nova.compute.manager [req-f31403c9-4a91-49a1-9d67-9324b79a0420 req-5fa0bc09-fcab-43b2-8063-8ede5a2fa6ef service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Received event network-vif-plugged-f0259675-f417-4927-993f-769bab8f0086 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:38:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f31403c9-4a91-49a1-9d67-9324b79a0420 req-5fa0bc09-fcab-43b2-8063-8ede5a2fa6ef service nova] Acquiring lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:38:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f31403c9-4a91-49a1-9d67-9324b79a0420 req-5fa0bc09-fcab-43b2-8063-8ede5a2fa6ef service nova] Lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:38:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f31403c9-4a91-49a1-9d67-9324b79a0420 req-5fa0bc09-fcab-43b2-8063-8ede5a2fa6ef service nova] Lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:38:34 user nova-compute[74821]: DEBUG nova.compute.manager [req-f31403c9-4a91-49a1-9d67-9324b79a0420 req-5fa0bc09-fcab-43b2-8063-8ede5a2fa6ef service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] No waiting events found dispatching network-vif-plugged-f0259675-f417-4927-993f-769bab8f0086 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:38:34 user nova-compute[74821]: WARNING nova.compute.manager [req-f31403c9-4a91-49a1-9d67-9324b79a0420 req-5fa0bc09-fcab-43b2-8063-8ede5a2fa6ef service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Received unexpected event network-vif-plugged-f0259675-f417-4927-993f-769bab8f0086 for instance with vm_state building and task_state spawning.
Nov 06 13:38:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:36 user nova-compute[74821]: DEBUG nova.compute.manager [req-0e9f02d3-a6d1-4a75-871c-ca49dfc4d19c req-d63e603e-873d-4fa3-8c11-2ee6e2d93f7d service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Received event network-vif-plugged-f0259675-f417-4927-993f-769bab8f0086 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:38:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0e9f02d3-a6d1-4a75-871c-ca49dfc4d19c req-d63e603e-873d-4fa3-8c11-2ee6e2d93f7d service nova] Acquiring lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:38:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0e9f02d3-a6d1-4a75-871c-ca49dfc4d19c req-d63e603e-873d-4fa3-8c11-2ee6e2d93f7d service nova] Lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:38:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0e9f02d3-a6d1-4a75-871c-ca49dfc4d19c req-d63e603e-873d-4fa3-8c11-2ee6e2d93f7d service nova] Lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:38:36 user nova-compute[74821]: DEBUG nova.compute.manager [req-0e9f02d3-a6d1-4a75-871c-ca49dfc4d19c req-d63e603e-873d-4fa3-8c11-2ee6e2d93f7d service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] No waiting events found dispatching network-vif-plugged-f0259675-f417-4927-993f-769bab8f0086 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:38:36 user nova-compute[74821]: WARNING nova.compute.manager [req-0e9f02d3-a6d1-4a75-871c-ca49dfc4d19c req-d63e603e-873d-4fa3-8c11-2ee6e2d93f7d service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Received unexpected event network-vif-plugged-f0259675-f417-4927-993f-769bab8f0086 for instance with vm_state building and task_state spawning.
Nov 06 13:38:36 user nova-compute[74821]: DEBUG nova.compute.manager [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:38:36 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:38:36 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Instance spawned successfully.
Nov 06 13:38:36 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:38:36 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:38:36 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:38:36 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:38:36 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:38:36 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:38:36 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:38:36 user nova-compute[74821]: INFO nova.compute.manager [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Took 6.78 seconds to spawn the instance on the hypervisor.
Nov 06 13:38:36 user nova-compute[74821]: DEBUG nova.compute.manager [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:38:36 user nova-compute[74821]: INFO nova.compute.manager [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Took 7.55 seconds to build instance.
Nov 06 13:38:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f7c07f6e-87fb-4a8a-aa6f-9b6d69a7512c tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.227s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:38:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:42 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:38:43 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:38:43 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:38:43 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Rebuilding the list of instances to heal {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-2e10922b-fa67-46a7-895b-3f40a40bf23d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-2e10922b-fa67-46a7-895b-3f40a40bf23d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG nova.objects.instance [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lazy-loading 'info_cache' on Instance uuid 2e10922b-fa67-46a7-895b-3f40a40bf23d {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tEXcTwqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:38:44 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:38:44 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:38:44 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:38:44 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:38:44 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:38:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6350125f-4851-430e-99dc-d532a5aae4dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:38:44 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9df9ec3-57b4-4f81-8bc9-2ae08987048f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a] added
Nov 06 13:38:44 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7805cf2-5f8e-4edf-be5b-36b713ffcc52]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a3b778-e80c-40d8-8357-da08791f7680]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tEXcTwqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tEXcTwqn" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e592c93-0be2-4fd0-b4a0-d0555d0e2912]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tEXcTwqn'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4207ce27-fd81-49b8-8c90-7239d8999d86]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1240fd80-c80f-41b2-8923-7edf8390a6c0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 06 13:38:44 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 06 13:38:44 user nova-compute[74821]:  {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:38:44 user nova-compute[74821]: WARNING os_brick.initiator.connectors.iscsi [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 06 13:38:44 user nova-compute[74821]: 
Nov 06 13:38:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdc85ea-02c5-4c80-97a1-77239f1ecc82]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a, portal: 172.16.0.220,3260]
Nov 06 13:38:44 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a, portal: 172.16.0.220,3260] successful.
Nov 06 13:38:44 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5039fbc0-3940-45a7-b1bb-dc3bf1c254b3]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[155ea9e3-1069-4827-abb1-794c83f526a9]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a (non-flash)
Nov 06 13:38:44 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a (non-flash)
Nov 06 13:38:44 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[988ea366-3d8d-427f-95be-ad530d84f4cd]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tEXcTwqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Updating instance_info_cache with network_info: [{"id": "8f5441a4-a58c-4219-863d-8130491f403b", "address": "fa:16:3e:9d:bc:6f", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f5441a4-a5", "ovs_interfaceid": "8f5441a4-a58c-4219-863d-8130491f403b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-2e10922b-fa67-46a7-895b-3f40a40bf23d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:38:44 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:38:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:45 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:38:45 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23533373836386363', 'path': '/dev/sdb'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:38:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533373836386363', 'path': '/dev/sdb'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:38:45 user nova-compute[74821]: DEBUG nova.objects.instance [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lazy-loading 'flavor' on Instance uuid 2e10922b-fa67-46a7-895b-3f40a40bf23d {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:38:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 13:38:45 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:38:45 user nova-compute[74821]:   <source dev="/dev/sdb"/>
Nov 06 13:38:45 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:38:45 user nova-compute[74821]:   <serial>a094de47-549f-46df-a43f-af414364483a</serial>
Nov 06 13:38:45 user nova-compute[74821]: </disk>
Nov 06 13:38:45 user nova-compute[74821]:  {{(pid=74821) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 13:38:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:38:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:38:45 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] No VIF found with MAC fa:16:3e:9d:bc:6f, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:38:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fcb1845c-70ef-4f8e-87c7-7eeba66911c0 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "2e10922b-fa67-46a7-895b-3f40a40bf23d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.767s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:38:46 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:38:46 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:38:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "2e10922b-fa67-46a7-895b-3f40a40bf23d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:38:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "2e10922b-fa67-46a7-895b-3f40a40bf23d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:38:47 user nova-compute[74821]: INFO nova.compute.manager [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Detaching volume a094de47-549f-46df-a43f-af414364483a
Nov 06 13:38:47 user nova-compute[74821]: INFO nova.virt.block_device [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Attempting to driver detach volume a094de47-549f-46df-a43f-af414364483a from mountpoint /dev/vdb
Nov 06 13:38:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Attempting to detach device vdb from instance 2e10922b-fa67-46a7-895b-3f40a40bf23d from the persistent domain config. {{(pid=74821) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 13:38:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:38:47 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:38:47 user nova-compute[74821]:   <source dev="/dev/sdb"/>
Nov 06 13:38:47 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:38:47 user nova-compute[74821]:   <serial>a094de47-549f-46df-a43f-af414364483a</serial>
Nov 06 13:38:47 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:38:47 user nova-compute[74821]: </disk>
Nov 06 13:38:47 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:38:47 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Successfully detached device vdb from instance 2e10922b-fa67-46a7-895b-3f40a40bf23d from the persistent domain config.
Nov 06 13:38:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2e10922b-fa67-46a7-895b-3f40a40bf23d from the live domain config. {{(pid=74821) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 13:38:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:38:47 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:38:47 user nova-compute[74821]:   <source dev="/dev/sdb"/>
Nov 06 13:38:47 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:38:47 user nova-compute[74821]:   <serial>a094de47-549f-46df-a43f-af414364483a</serial>
Nov 06 13:38:47 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:38:47 user nova-compute[74821]: </disk>
Nov 06 13:38:47 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:38:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:47 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:38:48 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2e10922b-fa67-46a7-895b-3f40a40bf23d {{(pid=74821) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 13:38:48 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:38:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:50 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:38:50 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:38:51 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:38:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:38:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:38:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:38:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:38:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:38:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:38:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:38:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:38:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e1e7d-3abf-4c2f-b792-16b0ef970d88/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:38:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e1e7d-3abf-4c2f-b792-16b0ef970d88/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:38:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e1e7d-3abf-4c2f-b792-16b0ef970d88/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:38:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e1e7d-3abf-4c2f-b792-16b0ef970d88/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:38:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e10922b-fa67-46a7-895b-3f40a40bf23d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:38:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e10922b-fa67-46a7-895b-3f40a40bf23d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:38:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e10922b-fa67-46a7-895b-3f40a40bf23d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:38:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e10922b-fa67-46a7-895b-3f40a40bf23d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:38:53 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:38:53 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:38:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=8426MB free_disk=25.088783264160156GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:38:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:38:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:38:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 2e10922b-fa67-46a7-895b-3f40a40bf23d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:38:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance db04d895-338b-46fb-af08-779ad5d1181d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:38:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 929e1e7d-3abf-4c2f-b792-16b0ef970d88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:38:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:38:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:38:53 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:53 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:38:53 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:38:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:38:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:38:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:57 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:38:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:38:59 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:39:00 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "c3293c45-e843-4d6b-bc15-a10010a24ea6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:39:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:39:05 user nova-compute[74821]: DEBUG nova.compute.manager [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:39:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:39:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:39:05 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:39:05 user nova-compute[74821]: INFO nova.compute.claims [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Claim successful on node user
Nov 06 13:39:05 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:39:06 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:39:06 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:39:06 user nova-compute[74821]: DEBUG nova.compute.manager [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:39:06 user nova-compute[74821]: DEBUG nova.compute.manager [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:39:06 user nova-compute[74821]: DEBUG nova.network.neutron [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:39:06 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:39:06 user nova-compute[74821]: DEBUG nova.compute.manager [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:39:06 user nova-compute[74821]: DEBUG nova.policy [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '88ff13567ecb4157898a278d3ae6e0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f3e02b312774fffa90b9aea7611b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:39:06 user nova-compute[74821]: DEBUG nova.compute.manager [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:39:06 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:39:06 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Creating image(s)
Nov 06 13:39:06 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "/opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:39:06 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "/opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:39:06 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "/opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:39:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.186s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:39:06 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:39:06 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:39:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.227s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:39:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk 1073741824" returned: 0 in 0.065s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:39:06 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:39:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.188s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:39:06 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:39:06 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:39:07 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Cannot resize image /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:39:07 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:39:07 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Ensure instance console log exists: /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:39:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:39:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:39:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:39:07 user nova-compute[74821]: DEBUG nova.network.neutron [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Successfully created port: 4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:39:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:07 user nova-compute[74821]: DEBUG nova.network.neutron [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Successfully updated port: 4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:39:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "refresh_cache-c3293c45-e843-4d6b-bc15-a10010a24ea6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:39:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquired lock "refresh_cache-c3293c45-e843-4d6b-bc15-a10010a24ea6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:39:07 user nova-compute[74821]: DEBUG nova.network.neutron [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.compute.manager [req-0be774cb-8045-4933-ae27-d133b85e703a req-c2984b03-4b0a-4226-a829-e5e8e2843218 service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Received event network-changed-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.compute.manager [req-0be774cb-8045-4933-ae27-d133b85e703a req-c2984b03-4b0a-4226-a829-e5e8e2843218 service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Refreshing instance network info cache due to event network-changed-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0be774cb-8045-4933-ae27-d133b85e703a req-c2984b03-4b0a-4226-a829-e5e8e2843218 service nova] Acquiring lock "refresh_cache-c3293c45-e843-4d6b-bc15-a10010a24ea6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.network.neutron [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:39:08 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2e10922b-fa67-46a7-895b-3f40a40bf23d is timed out.
Nov 06 13:39:08 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Successfully detached device vdb from instance 2e10922b-fa67-46a7-895b-3f40a40bf23d from the live domain config.
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tEXcTwqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:39:08 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:39:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a22e7a-4dc8-4d1a-82ff-6dfb0afb492a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:39:08 user nova-compute[74821]: No targets found.
Nov 06 13:39:08 user nova-compute[74821]: iSNS:
Nov 06 13:39:08 user nova-compute[74821]: No targets found.
Nov 06 13:39:08 user nova-compute[74821]: STATIC:
Nov 06 13:39:08 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a
Nov 06 13:39:08 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:39:08 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:39:08 user nova-compute[74821]: FIRMWARE:
Nov 06 13:39:08 user nova-compute[74821]: No targets found.
Nov 06 13:39:08 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:39:08 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:39:08 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bfc2f0-fd84-4b87-972d-0eb3c4192821]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a64c2d-fefc-4b18-a3c5-415928c17a92]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a (non-flash)
Nov 06 13:39:08 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a (non-flash)
Nov 06 13:39:08 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e4012a8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a'): ({'sdb'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Removing single pathed devices sdb {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.network.neutron [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Updating instance_info_cache with network_info: [{"id": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "address": "fa:16:3e:87:40:ab", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da3ffbf-3f", "ovs_interfaceid": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8487ec5-99dc-4e55-8c00-14648ac3205a]: (4, ('path checker states:\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Releasing lock "refresh_cache-c3293c45-e843-4d6b-bc15-a10010a24ea6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.compute.manager [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Instance network_info: |[{"id": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "address": "fa:16:3e:87:40:ab", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da3ffbf-3f", "ovs_interfaceid": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0be774cb-8045-4933-ae27-d133b85e703a req-c2984b03-4b0a-4226-a829-e5e8e2843218 service nova] Acquired lock "refresh_cache-c3293c45-e843-4d6b-bc15-a10010a24ea6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.network.neutron [req-0be774cb-8045-4933-ae27-d133b85e703a req-c2984b03-4b0a-4226-a829-e5e8e2843218 service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Refreshing network info cache for port 4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Start _get_guest_xml network_info=[{"id": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "address": "fa:16:3e:87:40:ab", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da3ffbf-3f", "ovs_interfaceid": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca0161a-950f-4f4e-b868-ed250e1dc5ee]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Flushing IO for device /dev/sdb {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:39:08 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:39:08 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:39:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:39:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1993604917',display_name='tempest-AttachVolumeTestJSON-server-1993604917',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1993604917',id=45,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVB62RpV7sb/k2zRM/ERNI4ujnBhy7CTod4Pfx14PprgP+C8QSul7cOBioxpJJqMn0wC1iI7xPCkFVcTSwGlIE5o2jmZYDIM/eqmdyMBPfuKA5g8IgRvnLBPlG3P7M+Gw==',key_name='tempest-keypair-2114445980',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f3e02b312774fffa90b9aea7611b7d2',ramdisk_id='',reservation_id='r-e3xww6ds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1920917363',owner_user_name='tempest-AttachVolumeTestJSON-1920917363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:39:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88ff13567ecb4157898a278d3ae6e0d0',uuid=c3293c45-e843-4d6b-bc15-a10010a24ea6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "address": "fa:16:3e:87:40:ab", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da3ffbf-3f", "ovs_interfaceid": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Converting VIF {"id": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "address": "fa:16:3e:87:40:ab", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da3ffbf-3f", "ovs_interfaceid": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:40:ab,bridge_name='br-int',has_traffic_filtering=True,id=4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec,network=Network(a2ec52e9-7476-4ced-9810-d58d3f9eec4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4da3ffbf-3f') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.objects.instance [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lazy-loading 'pci_devices' on Instance uuid c3293c45-e843-4d6b-bc15-a10010a24ea6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[96eb0e82-09d4-4c75-95a4-3255ca59f536]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:39:08 user nova-compute[74821]:   <uuid>c3293c45-e843-4d6b-bc15-a10010a24ea6</uuid>
Nov 06 13:39:08 user nova-compute[74821]:   <name>instance-0000002d</name>
Nov 06 13:39:08 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:39:08 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:39:08 user nova-compute[74821]:   <metadata>
Nov 06 13:39:08 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:39:08 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:39:08 user nova-compute[74821]:       <nova:name>tempest-AttachVolumeTestJSON-server-1993604917</nova:name>
Nov 06 13:39:08 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:39:08</nova:creationTime>
Nov 06 13:39:08 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:39:08 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:39:08 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:39:08 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:39:08 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:39:08 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:39:08 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:39:08 user nova-compute[74821]:       <nova:owner>
Nov 06 13:39:08 user nova-compute[74821]:         <nova:user uuid="88ff13567ecb4157898a278d3ae6e0d0">tempest-AttachVolumeTestJSON-1920917363-project-member</nova:user>
Nov 06 13:39:08 user nova-compute[74821]:         <nova:project uuid="9f3e02b312774fffa90b9aea7611b7d2">tempest-AttachVolumeTestJSON-1920917363</nova:project>
Nov 06 13:39:08 user nova-compute[74821]:       </nova:owner>
Nov 06 13:39:08 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:39:08 user nova-compute[74821]:       <nova:ports>
Nov 06 13:39:08 user nova-compute[74821]:         <nova:port uuid="4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec">
Nov 06 13:39:08 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 06 13:39:08 user nova-compute[74821]:         </nova:port>
Nov 06 13:39:08 user nova-compute[74821]:       </nova:ports>
Nov 06 13:39:08 user nova-compute[74821]:     </nova:instance>
Nov 06 13:39:08 user nova-compute[74821]:   </metadata>
Nov 06 13:39:08 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:39:08 user nova-compute[74821]:     <system>
Nov 06 13:39:08 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:39:08 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:39:08 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:39:08 user nova-compute[74821]:       <entry name="serial">c3293c45-e843-4d6b-bc15-a10010a24ea6</entry>
Nov 06 13:39:08 user nova-compute[74821]:       <entry name="uuid">c3293c45-e843-4d6b-bc15-a10010a24ea6</entry>
Nov 06 13:39:08 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:39:08 user nova-compute[74821]:     </system>
Nov 06 13:39:08 user nova-compute[74821]:   </sysinfo>
Nov 06 13:39:08 user nova-compute[74821]:   <os>
Nov 06 13:39:08 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:39:08 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:39:08 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:39:08 user nova-compute[74821]:   </os>
Nov 06 13:39:08 user nova-compute[74821]:   <features>
Nov 06 13:39:08 user nova-compute[74821]:     <acpi/>
Nov 06 13:39:08 user nova-compute[74821]:     <apic/>
Nov 06 13:39:08 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:39:08 user nova-compute[74821]:   </features>
Nov 06 13:39:08 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:39:08 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:39:08 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:39:08 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:39:08 user nova-compute[74821]:   </clock>
Nov 06 13:39:08 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:39:08 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:39:08 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:39:08 user nova-compute[74821]:   </cpu>
Nov 06 13:39:08 user nova-compute[74821]:   <devices>
Nov 06 13:39:08 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:39:08 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:39:08 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk"/>
Nov 06 13:39:08 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:39:08 user nova-compute[74821]:     </disk>
Nov 06 13:39:08 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:39:08 user nova-compute[74821]:       <mac address="fa:16:3e:87:40:ab"/>
Nov 06 13:39:08 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:39:08 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:39:08 user nova-compute[74821]:       <target dev="tap4da3ffbf-3f"/>
Nov 06 13:39:08 user nova-compute[74821]:     </interface>
Nov 06 13:39:08 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:39:08 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/console.log" append="off"/>
Nov 06 13:39:08 user nova-compute[74821]:     </serial>
Nov 06 13:39:08 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:39:08 user nova-compute[74821]:     <video>
Nov 06 13:39:08 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:39:08 user nova-compute[74821]:     </video>
Nov 06 13:39:08 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:39:08 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:39:08 user nova-compute[74821]:     </rng>
Nov 06 13:39:08 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:39:08 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:39:08 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:39:08 user nova-compute[74821]:     </memballoon>
Nov 06 13:39:08 user nova-compute[74821]:   </devices>
Nov 06 13:39:08 user nova-compute[74821]: </domain>
Nov 06 13:39:08 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:39:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1993604917',display_name='tempest-AttachVolumeTestJSON-server-1993604917',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1993604917',id=45,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVB62RpV7sb/k2zRM/ERNI4ujnBhy7CTod4Pfx14PprgP+C8QSul7cOBioxpJJqMn0wC1iI7xPCkFVcTSwGlIE5o2jmZYDIM/eqmdyMBPfuKA5g8IgRvnLBPlG3P7M+Gw==',key_name='tempest-keypair-2114445980',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f3e02b312774fffa90b9aea7611b7d2',ramdisk_id='',reservation_id='r-e3xww6ds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1920917363',owner_user_name='tempest-AttachVolumeTestJSON-1920917363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:39:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88ff13567ecb4157898a278d3ae6e0d0',uuid=c3293c45-e843-4d6b-bc15-a10010a24ea6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "address": "fa:16:3e:87:40:ab", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da3ffbf-3f", "ovs_interfaceid": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Converting VIF {"id": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "address": "fa:16:3e:87:40:ab", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da3ffbf-3f", "ovs_interfaceid": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:40:ab,bridge_name='br-int',has_traffic_filtering=True,id=4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec,network=Network(a2ec52e9-7476-4ced-9810-d58d3f9eec4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4da3ffbf-3f') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG os_vif [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:40:ab,bridge_name='br-int',has_traffic_filtering=True,id=4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec,network=Network(a2ec52e9-7476-4ced-9810-d58d3f9eec4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4da3ffbf-3f') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e06a90f1-fdc0-5ef6-969e-1e527b1fdc96', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4da3ffbf-3f, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4da3ffbf-3f, col_values=(('qos', UUID('6b05cbda-bab2-4e1f-bd89-1cd528b66b7a')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4da3ffbf-3f, col_values=(('external_ids', {'iface-id': '4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:40:ab', 'vm-uuid': 'c3293c45-e843-4d6b-bc15-a10010a24ea6'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb904915-a059-4346-b494-768d7fd29b95]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] SCSI volumes sdb have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:08 user nova-compute[74821]: INFO os_vif [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:40:ab,bridge_name='br-int',has_traffic_filtering=True,id=4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec,network=Network(a2ec52e9-7476-4ced-9810-d58d3f9eec4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4da3ffbf-3f')
Nov 06 13:39:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ada9ee-1623-4a36-82c7-db58366c36ba]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] No VIF found with MAC fa:16:3e:87:40:ab, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7eca18-21bc-44dd-b31f-a9f58023456e]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a, portal: 172.16.0.220,3260]
Nov 06 13:39:08 user nova-compute[74821]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a, portal: 172.16.0.220,3260] successful.
Nov 06 13:39:08 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a094de47-549f-46df-a43f-af414364483a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[454d2db7-b401-4c33-a9dd-1dd285ab6f0d]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] <== disconnect_volume: return (348ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.network.neutron [req-0be774cb-8045-4933-ae27-d133b85e703a req-c2984b03-4b0a-4226-a829-e5e8e2843218 service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Updated VIF entry in instance network info cache for port 4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG nova.network.neutron [req-0be774cb-8045-4933-ae27-d133b85e703a req-c2984b03-4b0a-4226-a829-e5e8e2843218 service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Updating instance_info_cache with network_info: [{"id": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "address": "fa:16:3e:87:40:ab", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da3ffbf-3f", "ovs_interfaceid": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:39:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0be774cb-8045-4933-ae27-d133b85e703a req-c2984b03-4b0a-4226-a829-e5e8e2843218 service nova] Releasing lock "refresh_cache-c3293c45-e843-4d6b-bc15-a10010a24ea6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:39:09 user nova-compute[74821]: DEBUG nova.objects.instance [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lazy-loading 'flavor' on Instance uuid 2e10922b-fa67-46a7-895b-3f40a40bf23d {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:39:09 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c3521bd7-fbdb-459a-9572-e3681b6adad4 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "2e10922b-fa67-46a7-895b-3f40a40bf23d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.854s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:39:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:10 user nova-compute[74821]: DEBUG nova.compute.manager [req-ebe4c5b6-dcf8-4c16-8dd2-e3d5ea213388 req-b0275453-ea53-4af0-a069-95617e63cc13 service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Received event network-vif-plugged-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:39:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ebe4c5b6-dcf8-4c16-8dd2-e3d5ea213388 req-b0275453-ea53-4af0-a069-95617e63cc13 service nova] Acquiring lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:39:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ebe4c5b6-dcf8-4c16-8dd2-e3d5ea213388 req-b0275453-ea53-4af0-a069-95617e63cc13 service nova] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:39:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-ebe4c5b6-dcf8-4c16-8dd2-e3d5ea213388 req-b0275453-ea53-4af0-a069-95617e63cc13 service nova] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:39:10 user nova-compute[74821]: DEBUG nova.compute.manager [req-ebe4c5b6-dcf8-4c16-8dd2-e3d5ea213388 req-b0275453-ea53-4af0-a069-95617e63cc13 service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] No waiting events found dispatching network-vif-plugged-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:39:10 user nova-compute[74821]: WARNING nova.compute.manager [req-ebe4c5b6-dcf8-4c16-8dd2-e3d5ea213388 req-b0275453-ea53-4af0-a069-95617e63cc13 service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Received unexpected event network-vif-plugged-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec for instance with vm_state building and task_state spawning.
Nov 06 13:39:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:11 user nova-compute[74821]: DEBUG nova.compute.manager [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:39:11 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:39:11 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Instance spawned successfully.
Nov 06 13:39:11 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:39:12 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:39:12 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:39:12 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:39:12 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:39:12 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:39:12 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:39:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-0f3d9c3b-b5bc-49e9-9857-c5128959e3a1 req-e087abac-44c7-4fc5-bc33-fc465edd35cb service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Received event network-vif-plugged-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:39:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0f3d9c3b-b5bc-49e9-9857-c5128959e3a1 req-e087abac-44c7-4fc5-bc33-fc465edd35cb service nova] Acquiring lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:39:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0f3d9c3b-b5bc-49e9-9857-c5128959e3a1 req-e087abac-44c7-4fc5-bc33-fc465edd35cb service nova] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:39:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0f3d9c3b-b5bc-49e9-9857-c5128959e3a1 req-e087abac-44c7-4fc5-bc33-fc465edd35cb service nova] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:39:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-0f3d9c3b-b5bc-49e9-9857-c5128959e3a1 req-e087abac-44c7-4fc5-bc33-fc465edd35cb service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] No waiting events found dispatching network-vif-plugged-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:39:12 user nova-compute[74821]: WARNING nova.compute.manager [req-0f3d9c3b-b5bc-49e9-9857-c5128959e3a1 req-e087abac-44c7-4fc5-bc33-fc465edd35cb service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Received unexpected event network-vif-plugged-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec for instance with vm_state building and task_state spawning.
Nov 06 13:39:12 user nova-compute[74821]: INFO nova.compute.manager [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Took 5.87 seconds to spawn the instance on the hypervisor.
Nov 06 13:39:12 user nova-compute[74821]: DEBUG nova.compute.manager [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:39:12 user nova-compute[74821]: INFO nova.compute.manager [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Took 6.72 seconds to build instance.
Nov 06 13:39:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-848d35b1-42dd-47de-a9f1-3a680cff1810 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.847s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:39:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:39:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "754e8314-2f91-4aa4-83d0-2ce9b94db4cc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:39:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "754e8314-2f91-4aa4-83d0-2ce9b94db4cc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:39:29 user nova-compute[74821]: DEBUG nova.compute.manager [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:39:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:39:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:39:29 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:39:29 user nova-compute[74821]: INFO nova.compute.claims [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Claim successful on node user
Nov 06 13:39:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:30 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:39:30 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:39:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:39:30 user nova-compute[74821]: DEBUG nova.compute.manager [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:39:30 user nova-compute[74821]: DEBUG nova.compute.manager [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:39:30 user nova-compute[74821]: DEBUG nova.network.neutron [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:39:30 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:39:30 user nova-compute[74821]: DEBUG nova.compute.manager [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:39:30 user nova-compute[74821]: DEBUG nova.policy [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3bb6a168d90a4795a72b8ac69eeadcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e811a3a30417a8dc6ccad03f2f8e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:39:30 user nova-compute[74821]: INFO nova.virt.block_device [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Booting with volume 1f599665-77ef-4677-9f2a-a49c77df3b07 at /dev/vda
Nov 06 13:39:30 user nova-compute[74821]: DEBUG os_brick.utils [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:39:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:39:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[14472661-131c-459a-b5d0-a81ccec85bf7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:39:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:39:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[df45efe8-d929-46ca-99d4-4beb36ca56b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:39:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:39:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8088fcbc-62bd-465a-b2ee-9bab7b730e9b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:39:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f904d8fb-3537-405a-ad7f-a912504e5418]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:39:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:39:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:39:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:39:30 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:39:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b69122e-2702-4f09-b997-0edcda6f5dbf]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:39:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:39:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:39:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:39:30 user nova-compute[74821]: DEBUG os_brick.utils [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:39:30 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Updating existing volume attachment record: 00341945-e8d3-47b0-91cf-f97c474ff344 {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:39:31 user nova-compute[74821]: DEBUG nova.network.neutron [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Successfully created port: 6c14439c-9307-476c-bb5a-484f35b38659 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:39:31 user nova-compute[74821]: DEBUG nova.network.neutron [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Successfully updated port: 6c14439c-9307-476c-bb5a-484f35b38659 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:39:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "refresh_cache-754e8314-2f91-4aa4-83d0-2ce9b94db4cc" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:39:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquired lock "refresh_cache-754e8314-2f91-4aa4-83d0-2ce9b94db4cc" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:39:31 user nova-compute[74821]: DEBUG nova.network.neutron [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:39:31 user nova-compute[74821]: DEBUG nova.compute.manager [req-babc1679-0ac6-478b-8df3-5d3d5f4ad5c6 req-62a17903-4d85-4376-82bd-851c438e54b2 service nova] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Received event network-changed-6c14439c-9307-476c-bb5a-484f35b38659 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:39:31 user nova-compute[74821]: DEBUG nova.compute.manager [req-babc1679-0ac6-478b-8df3-5d3d5f4ad5c6 req-62a17903-4d85-4376-82bd-851c438e54b2 service nova] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Refreshing instance network info cache due to event network-changed-6c14439c-9307-476c-bb5a-484f35b38659. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:39:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-babc1679-0ac6-478b-8df3-5d3d5f4ad5c6 req-62a17903-4d85-4376-82bd-851c438e54b2 service nova] Acquiring lock "refresh_cache-754e8314-2f91-4aa4-83d0-2ce9b94db4cc" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:39:31 user nova-compute[74821]: DEBUG nova.network.neutron [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:39:32 user nova-compute[74821]: DEBUG nova.network.neutron [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Updating instance_info_cache with network_info: [{"id": "6c14439c-9307-476c-bb5a-484f35b38659", "address": "fa:16:3e:e4:d9:3e", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c14439c-93", "ovs_interfaceid": "6c14439c-9307-476c-bb5a-484f35b38659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:39:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Releasing lock "refresh_cache-754e8314-2f91-4aa4-83d0-2ce9b94db4cc" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:39:32 user nova-compute[74821]: DEBUG nova.compute.manager [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Instance network_info: |[{"id": "6c14439c-9307-476c-bb5a-484f35b38659", "address": "fa:16:3e:e4:d9:3e", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c14439c-93", "ovs_interfaceid": "6c14439c-9307-476c-bb5a-484f35b38659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:39:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-babc1679-0ac6-478b-8df3-5d3d5f4ad5c6 req-62a17903-4d85-4376-82bd-851c438e54b2 service nova] Acquired lock "refresh_cache-754e8314-2f91-4aa4-83d0-2ce9b94db4cc" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:39:32 user nova-compute[74821]: DEBUG nova.network.neutron [req-babc1679-0ac6-478b-8df3-5d3d5f4ad5c6 req-62a17903-4d85-4376-82bd-851c438e54b2 service nova] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Refreshing network info cache for port 6c14439c-9307-476c-bb5a-484f35b38659 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:39:32 user nova-compute[74821]: DEBUG nova.network.neutron [req-babc1679-0ac6-478b-8df3-5d3d5f4ad5c6 req-62a17903-4d85-4376-82bd-851c438e54b2 service nova] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Updated VIF entry in instance network info cache for port 6c14439c-9307-476c-bb5a-484f35b38659. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:39:32 user nova-compute[74821]: DEBUG nova.network.neutron [req-babc1679-0ac6-478b-8df3-5d3d5f4ad5c6 req-62a17903-4d85-4376-82bd-851c438e54b2 service nova] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Updating instance_info_cache with network_info: [{"id": "6c14439c-9307-476c-bb5a-484f35b38659", "address": "fa:16:3e:e4:d9:3e", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c14439c-93", "ovs_interfaceid": "6c14439c-9307-476c-bb5a-484f35b38659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:39:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-babc1679-0ac6-478b-8df3-5d3d5f4ad5c6 req-62a17903-4d85-4376-82bd-851c438e54b2 service nova] Releasing lock "refresh_cache-754e8314-2f91-4aa4-83d0-2ce9b94db4cc" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:39:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-66bd39ee-83dc-47b5-b5e3-b1cb22965c70 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "2e10922b-fa67-46a7-895b-3f40a40bf23d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:39:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-66bd39ee-83dc-47b5-b5e3-b1cb22965c70 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "2e10922b-fa67-46a7-895b-3f40a40bf23d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:39:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-66bd39ee-83dc-47b5-b5e3-b1cb22965c70 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "2e10922b-fa67-46a7-895b-3f40a40bf23d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:39:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-66bd39ee-83dc-47b5-b5e3-b1cb22965c70 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "2e10922b-fa67-46a7-895b-3f40a40bf23d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:39:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-66bd39ee-83dc-47b5-b5e3-b1cb22965c70 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "2e10922b-fa67-46a7-895b-3f40a40bf23d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:39:38 user nova-compute[74821]: INFO nova.compute.manager [None req-66bd39ee-83dc-47b5-b5e3-b1cb22965c70 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Terminating instance
Nov 06 13:39:38 user nova-compute[74821]: DEBUG nova.compute.manager [None req-66bd39ee-83dc-47b5-b5e3-b1cb22965c70 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:39:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:38 user nova-compute[74821]: DEBUG nova.compute.manager [req-0b08d12f-2469-4d32-b7bf-cc9bf8968ec5 req-863ebb7d-1909-4f73-a5bc-eebf5e55f069 service nova] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Received event network-vif-unplugged-8f5441a4-a58c-4219-863d-8130491f403b {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:39:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0b08d12f-2469-4d32-b7bf-cc9bf8968ec5 req-863ebb7d-1909-4f73-a5bc-eebf5e55f069 service nova] Acquiring lock "2e10922b-fa67-46a7-895b-3f40a40bf23d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:39:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0b08d12f-2469-4d32-b7bf-cc9bf8968ec5 req-863ebb7d-1909-4f73-a5bc-eebf5e55f069 service nova] Lock "2e10922b-fa67-46a7-895b-3f40a40bf23d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:39:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0b08d12f-2469-4d32-b7bf-cc9bf8968ec5 req-863ebb7d-1909-4f73-a5bc-eebf5e55f069 service nova] Lock "2e10922b-fa67-46a7-895b-3f40a40bf23d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:39:38 user nova-compute[74821]: DEBUG nova.compute.manager [req-0b08d12f-2469-4d32-b7bf-cc9bf8968ec5 req-863ebb7d-1909-4f73-a5bc-eebf5e55f069 service nova] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] No waiting events found dispatching network-vif-unplugged-8f5441a4-a58c-4219-863d-8130491f403b {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:39:38 user nova-compute[74821]: DEBUG nova.compute.manager [req-0b08d12f-2469-4d32-b7bf-cc9bf8968ec5 req-863ebb7d-1909-4f73-a5bc-eebf5e55f069 service nova] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Received event network-vif-unplugged-8f5441a4-a58c-4219-863d-8130491f403b for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:39:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:38 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Instance destroyed successfully.
Nov 06 13:39:38 user nova-compute[74821]: DEBUG nova.objects.instance [None req-66bd39ee-83dc-47b5-b5e3-b1cb22965c70 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lazy-loading 'resources' on Instance uuid 2e10922b-fa67-46a7-895b-3f40a40bf23d {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:39:38 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-66bd39ee-83dc-47b5-b5e3-b1cb22965c70 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:36:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2020946681',display_name='tempest-AttachVolumeNegativeTest-server-2020946681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2020946681',id=42,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZJjBw2TFtMYdIk8jRkD2eHhoqvtH+yc4HejhRw1RpK8+1oQ8a9aL4WGrwjddk3kjtNeUyuUirH/H2gwpUawcUrEAVxbGwu48jIpyitaOVpoHO7wfUTbe1H4xR0QVGPeg==',key_name='tempest-keypair-1358561599',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:36:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c6d2ded0b1d4af09f1e05582bcbd3ae',ramdisk_id='',reservation_id='r-v8qyv8yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1164383705',owner_user_name='tempest-AttachVolumeNegativeTest-1164383705-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:36:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ffddfc972374f6aa7d81288d34690cf',uuid=2e10922b-fa67-46a7-895b-3f40a40bf23d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f5441a4-a58c-4219-863d-8130491f403b", "address": "fa:16:3e:9d:bc:6f", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f5441a4-a5", "ovs_interfaceid": "8f5441a4-a58c-4219-863d-8130491f403b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:39:38 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-66bd39ee-83dc-47b5-b5e3-b1cb22965c70 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Converting VIF {"id": "8f5441a4-a58c-4219-863d-8130491f403b", "address": "fa:16:3e:9d:bc:6f", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f5441a4-a5", "ovs_interfaceid": "8f5441a4-a58c-4219-863d-8130491f403b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:39:38 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-66bd39ee-83dc-47b5-b5e3-b1cb22965c70 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:bc:6f,bridge_name='br-int',has_traffic_filtering=True,id=8f5441a4-a58c-4219-863d-8130491f403b,network=Network(3e1f6a20-5316-4c49-93a5-deabb70d8608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f5441a4-a5') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:39:38 user nova-compute[74821]: DEBUG os_vif [None req-66bd39ee-83dc-47b5-b5e3-b1cb22965c70 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:bc:6f,bridge_name='br-int',has_traffic_filtering=True,id=8f5441a4-a58c-4219-863d-8130491f403b,network=Network(3e1f6a20-5316-4c49-93a5-deabb70d8608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f5441a4-a5') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:39:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f5441a4-a5, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:39:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:39:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6b99494a-8a4c-4241-8dbc-8f2f831d3770) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:39:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:38 user nova-compute[74821]: INFO os_vif [None req-66bd39ee-83dc-47b5-b5e3-b1cb22965c70 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:bc:6f,bridge_name='br-int',has_traffic_filtering=True,id=8f5441a4-a58c-4219-863d-8130491f403b,network=Network(3e1f6a20-5316-4c49-93a5-deabb70d8608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f5441a4-a5')
Nov 06 13:39:38 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-66bd39ee-83dc-47b5-b5e3-b1cb22965c70 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Deleting instance files /opt/stack/data/nova/instances/2e10922b-fa67-46a7-895b-3f40a40bf23d_del
Nov 06 13:39:38 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-66bd39ee-83dc-47b5-b5e3-b1cb22965c70 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Deletion of /opt/stack/data/nova/instances/2e10922b-fa67-46a7-895b-3f40a40bf23d_del complete
Nov 06 13:39:39 user nova-compute[74821]: INFO nova.compute.manager [None req-66bd39ee-83dc-47b5-b5e3-b1cb22965c70 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 06 13:39:39 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-66bd39ee-83dc-47b5-b5e3-b1cb22965c70 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:39:39 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:39:39 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:39:39 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:39:39 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Took 0.74 seconds to deallocate network for instance.
Nov 06 13:39:39 user nova-compute[74821]: DEBUG nova.compute.manager [req-44e11b9b-56de-4b22-bab9-32bf8264b201 req-208ba407-2788-401a-88c1-bdf91d2bcac7 service nova] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Received event network-vif-deleted-8f5441a4-a58c-4219-863d-8130491f403b {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:39:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-66bd39ee-83dc-47b5-b5e3-b1cb22965c70 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:39:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-66bd39ee-83dc-47b5-b5e3-b1cb22965c70 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:39:39 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-66bd39ee-83dc-47b5-b5e3-b1cb22965c70 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:39:39 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-66bd39ee-83dc-47b5-b5e3-b1cb22965c70 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:39:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-66bd39ee-83dc-47b5-b5e3-b1cb22965c70 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.201s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:39:40 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-66bd39ee-83dc-47b5-b5e3-b1cb22965c70 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Deleted allocations for instance 2e10922b-fa67-46a7-895b-3f40a40bf23d
Nov 06 13:39:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-66bd39ee-83dc-47b5-b5e3-b1cb22965c70 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "2e10922b-fa67-46a7-895b-3f40a40bf23d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.018s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:39:40 user nova-compute[74821]: DEBUG nova.compute.manager [req-b96fadcf-74e6-4498-88df-522a684a42a6 req-1729f6a3-fa92-409e-be5d-6f6d8a989a49 service nova] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Received event network-vif-plugged-8f5441a4-a58c-4219-863d-8130491f403b {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:39:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b96fadcf-74e6-4498-88df-522a684a42a6 req-1729f6a3-fa92-409e-be5d-6f6d8a989a49 service nova] Acquiring lock "2e10922b-fa67-46a7-895b-3f40a40bf23d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:39:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b96fadcf-74e6-4498-88df-522a684a42a6 req-1729f6a3-fa92-409e-be5d-6f6d8a989a49 service nova] Lock "2e10922b-fa67-46a7-895b-3f40a40bf23d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:39:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b96fadcf-74e6-4498-88df-522a684a42a6 req-1729f6a3-fa92-409e-be5d-6f6d8a989a49 service nova] Lock "2e10922b-fa67-46a7-895b-3f40a40bf23d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:39:40 user nova-compute[74821]: DEBUG nova.compute.manager [req-b96fadcf-74e6-4498-88df-522a684a42a6 req-1729f6a3-fa92-409e-be5d-6f6d8a989a49 service nova] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] No waiting events found dispatching network-vif-plugged-8f5441a4-a58c-4219-863d-8130491f403b {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:39:40 user nova-compute[74821]: WARNING nova.compute.manager [req-b96fadcf-74e6-4498-88df-522a684a42a6 req-1729f6a3-fa92-409e-be5d-6f6d8a989a49 service nova] [instance: 2e10922b-fa67-46a7-895b-3f40a40bf23d] Received unexpected event network-vif-plugged-8f5441a4-a58c-4219-863d-8130491f403b for instance with vm_state deleted and task_state None.
Nov 06 13:39:43 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:43 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:39:43 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:39:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-db04d895-338b-46fb-af08-779ad5d1181d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:39:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-db04d895-338b-46fb-af08-779ad5d1181d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:39:44 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:39:44 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Updating instance_info_cache with network_info: [{"id": "0997f4aa-17bc-4f72-b43a-63eb00bd4a71", "address": "fa:16:3e:46:dc:53", "network": {"id": "9dfb5db2-5cef-4f79-a41d-af4ae6967c09", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1976265278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a79b69221f742dc9f128dd708d1b9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0997f4aa-17", "ovs_interfaceid": "0997f4aa-17bc-4f72-b43a-63eb00bd4a71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:39:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-db04d895-338b-46fb-af08-779ad5d1181d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:39:44 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:39:44 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:39:48 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:39:48 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:48 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:39:48 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:39:48 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:39:48 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:48 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:39:48 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:39:48 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:39:49 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:39:50 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG nova.compute.manager [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:39:51 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Creating image(s)
Nov 06 13:39:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Did not create local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Ensure instance console log exists: /opt/stack/data/nova/instances/754e8314-2f91-4aa4-83d0-2ce9b94db4cc/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Start _get_guest_xml network_info=[{"id": "6c14439c-9307-476c-bb5a-484f35b38659", "address": "fa:16:3e:e4:d9:3e", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c14439c-93", "ovs_interfaceid": "6c14439c-9307-476c-bb5a-484f35b38659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cbXQAMsg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '754e8314-2f91-4aa4-83d0-2ce9b94db4cc', 'attached_at': '', 'detached_at': '', 'volume_id': '1f599665-77ef-4677-9f2a-a49c77df3b07', 'serial': '1f599665-77ef-4677-9f2a-a49c77df3b07'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': '00341945-e8d3-47b0-91cf-f97c474ff344', 'volume_type': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:39:51 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:39:51 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:39:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cbXQAMsg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:39:51 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:39:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:39:51 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:39:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:39:51 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e26894d-00cf-40f3-9486-013ac6fe0249]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:39:51 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cba85d-2547-45aa-a9f8-b0f23f4a0f20]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07] added
Nov 06 13:39:51 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1155689-2949-4523-97dd-53d984c99e56]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98dfdd5-a244-4e84-800f-0b8bfe9c6ed6]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cbXQAMsg {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cbXQAMsg" returned: 0 in 0.050s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3049bd5b-689a-49c1-a0e8-cc54e1d64db4]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cbXQAMsg'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c9c271-0b52-4473-bcd8-9142b7b6ffb7]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b9adab-9f1c-4a5a-91c9-dee3873389d1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 06 13:39:51 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 06 13:39:51 user nova-compute[74821]:  {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:39:51 user nova-compute[74821]: WARNING os_brick.initiator.connectors.iscsi [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 06 13:39:51 user nova-compute[74821]: 
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b253ce4-7a91-44ca-99c5-237fa283cc7f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07, portal: 172.16.0.220,3260]
Nov 06 13:39:51 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07, portal: 172.16.0.220,3260] successful.
Nov 06 13:39:51 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1d7e1e-e76c-4de0-8afe-5283a58ba081]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[508d26b1-dd6f-4dcb-8b08-b1a3df20b91a]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:39:51 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:39:51 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2047e541-5724-40e4-b815-df92b17626b2]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cbXQAMsg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:39:51 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:39:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:39:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:39:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e1e7d-3abf-4c2f-b792-16b0ef970d88/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e1e7d-3abf-4c2f-b792-16b0ef970d88/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:39:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e1e7d-3abf-4c2f-b792-16b0ef970d88/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:39:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23866333630353738', 'path': '/dev/sdb'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:39:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866333630353738', 'path': '/dev/sdb'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:39:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e1e7d-3abf-4c2f-b792-16b0ef970d88/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:39:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:39:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1099211257',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1099211257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1099211257',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGnq5y/MXe6UZrW1LNCywluTqthvaFWeogiAwRexvSjfpgmSSwLmZZZCaPd4/pdZhObjp7zR0lMzi3/WgjbTBYbir+OrXV9P+2/ciUapjpdFzriUXRwpwUH6gBEDYplWA==',key_name='tempest-keypair-1193584422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c8e811a3a30417a8dc6ccad03f2f8e0',ramdisk_id='',reservation_id='r-1b0whqts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1930796442',owner_user_name='tempest-TestVolumeBootPattern-1930796442-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:39:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bb6a168d90a4795a72b8ac69eeadcc9',uuid=754e8314-2f91-4aa4-83d0-2ce9b94db4cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c14439c-9307-476c-bb5a-484f35b38659", "address": "fa:16:3e:e4:d9:3e", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c14439c-93", "ovs_interfaceid": "6c14439c-9307-476c-bb5a-484f35b38659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:39:52 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Converting VIF {"id": "6c14439c-9307-476c-bb5a-484f35b38659", "address": "fa:16:3e:e4:d9:3e", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c14439c-93", "ovs_interfaceid": "6c14439c-9307-476c-bb5a-484f35b38659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:39:52 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:d9:3e,bridge_name='br-int',has_traffic_filtering=True,id=6c14439c-9307-476c-bb5a-484f35b38659,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c14439c-93') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:39:52 user nova-compute[74821]: DEBUG nova.objects.instance [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lazy-loading 'pci_devices' on Instance uuid 754e8314-2f91-4aa4-83d0-2ce9b94db4cc {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:39:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:39:52 user nova-compute[74821]:   <uuid>754e8314-2f91-4aa4-83d0-2ce9b94db4cc</uuid>
Nov 06 13:39:52 user nova-compute[74821]:   <name>instance-0000002e</name>
Nov 06 13:39:52 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:39:52 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:39:52 user nova-compute[74821]:   <metadata>
Nov 06 13:39:52 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:39:52 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:39:52 user nova-compute[74821]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1099211257</nova:name>
Nov 06 13:39:52 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:39:51</nova:creationTime>
Nov 06 13:39:52 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:39:52 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:39:52 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:39:52 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:39:52 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:39:52 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:39:52 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:39:52 user nova-compute[74821]:       <nova:owner>
Nov 06 13:39:52 user nova-compute[74821]:         <nova:user uuid="3bb6a168d90a4795a72b8ac69eeadcc9">tempest-TestVolumeBootPattern-1930796442-project-member</nova:user>
Nov 06 13:39:52 user nova-compute[74821]:         <nova:project uuid="2c8e811a3a30417a8dc6ccad03f2f8e0">tempest-TestVolumeBootPattern-1930796442</nova:project>
Nov 06 13:39:52 user nova-compute[74821]:       </nova:owner>
Nov 06 13:39:52 user nova-compute[74821]:       <nova:ports>
Nov 06 13:39:52 user nova-compute[74821]:         <nova:port uuid="6c14439c-9307-476c-bb5a-484f35b38659">
Nov 06 13:39:52 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 06 13:39:52 user nova-compute[74821]:         </nova:port>
Nov 06 13:39:52 user nova-compute[74821]:       </nova:ports>
Nov 06 13:39:52 user nova-compute[74821]:     </nova:instance>
Nov 06 13:39:52 user nova-compute[74821]:   </metadata>
Nov 06 13:39:52 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:39:52 user nova-compute[74821]:     <system>
Nov 06 13:39:52 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:39:52 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:39:52 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:39:52 user nova-compute[74821]:       <entry name="serial">754e8314-2f91-4aa4-83d0-2ce9b94db4cc</entry>
Nov 06 13:39:52 user nova-compute[74821]:       <entry name="uuid">754e8314-2f91-4aa4-83d0-2ce9b94db4cc</entry>
Nov 06 13:39:52 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:39:52 user nova-compute[74821]:     </system>
Nov 06 13:39:52 user nova-compute[74821]:   </sysinfo>
Nov 06 13:39:52 user nova-compute[74821]:   <os>
Nov 06 13:39:52 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:39:52 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:39:52 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:39:52 user nova-compute[74821]:   </os>
Nov 06 13:39:52 user nova-compute[74821]:   <features>
Nov 06 13:39:52 user nova-compute[74821]:     <acpi/>
Nov 06 13:39:52 user nova-compute[74821]:     <apic/>
Nov 06 13:39:52 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:39:52 user nova-compute[74821]:   </features>
Nov 06 13:39:52 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:39:52 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:39:52 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:39:52 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:39:52 user nova-compute[74821]:   </clock>
Nov 06 13:39:52 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:39:52 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:39:52 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:39:52 user nova-compute[74821]:   </cpu>
Nov 06 13:39:52 user nova-compute[74821]:   <devices>
Nov 06 13:39:52 user nova-compute[74821]:     <disk type="block" device="disk">
Nov 06 13:39:52 user nova-compute[74821]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:39:52 user nova-compute[74821]:       <source dev="/dev/sdb"/>
Nov 06 13:39:52 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:39:52 user nova-compute[74821]:       <serial>1f599665-77ef-4677-9f2a-a49c77df3b07</serial>
Nov 06 13:39:52 user nova-compute[74821]:     </disk>
Nov 06 13:39:52 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:39:52 user nova-compute[74821]:       <mac address="fa:16:3e:e4:d9:3e"/>
Nov 06 13:39:52 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:39:52 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:39:52 user nova-compute[74821]:       <target dev="tap6c14439c-93"/>
Nov 06 13:39:52 user nova-compute[74821]:     </interface>
Nov 06 13:39:52 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:39:52 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/754e8314-2f91-4aa4-83d0-2ce9b94db4cc/console.log" append="off"/>
Nov 06 13:39:52 user nova-compute[74821]:     </serial>
Nov 06 13:39:52 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:39:52 user nova-compute[74821]:     <video>
Nov 06 13:39:52 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:39:52 user nova-compute[74821]:     </video>
Nov 06 13:39:52 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:39:52 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:39:52 user nova-compute[74821]:     </rng>
Nov 06 13:39:52 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:39:52 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:39:52 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:39:52 user nova-compute[74821]:     </memballoon>
Nov 06 13:39:52 user nova-compute[74821]:   </devices>
Nov 06 13:39:52 user nova-compute[74821]: </domain>
Nov 06 13:39:52 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:39:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:39:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1099211257',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1099211257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1099211257',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGnq5y/MXe6UZrW1LNCywluTqthvaFWeogiAwRexvSjfpgmSSwLmZZZCaPd4/pdZhObjp7zR0lMzi3/WgjbTBYbir+OrXV9P+2/ciUapjpdFzriUXRwpwUH6gBEDYplWA==',key_name='tempest-keypair-1193584422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c8e811a3a30417a8dc6ccad03f2f8e0',ramdisk_id='',reservation_id='r-1b0whqts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1930796442',owner_user_name='tempest-TestVolumeBootPattern-1930796442-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:39:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bb6a168d90a4795a72b8ac69eeadcc9',uuid=754e8314-2f91-4aa4-83d0-2ce9b94db4cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c14439c-9307-476c-bb5a-484f35b38659", "address": "fa:16:3e:e4:d9:3e", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c14439c-93", "ovs_interfaceid": "6c14439c-9307-476c-bb5a-484f35b38659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:39:52 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Converting VIF {"id": "6c14439c-9307-476c-bb5a-484f35b38659", "address": "fa:16:3e:e4:d9:3e", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c14439c-93", "ovs_interfaceid": "6c14439c-9307-476c-bb5a-484f35b38659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:39:52 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:d9:3e,bridge_name='br-int',has_traffic_filtering=True,id=6c14439c-9307-476c-bb5a-484f35b38659,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c14439c-93') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:39:52 user nova-compute[74821]: DEBUG os_vif [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:d9:3e,bridge_name='br-int',has_traffic_filtering=True,id=6c14439c-9307-476c-bb5a-484f35b38659,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c14439c-93') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:39:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:39:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:39:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a15435ee-ee06-580b-ab93-ba5ac5ddef1c', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:39:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:39:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c14439c-93, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:39:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6c14439c-93, col_values=(('qos', UUID('0d14d6ff-5585-4e71-b724-451f7b3be4e4')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:39:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6c14439c-93, col_values=(('external_ids', {'iface-id': '6c14439c-9307-476c-bb5a-484f35b38659', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:d9:3e', 'vm-uuid': '754e8314-2f91-4aa4-83d0-2ce9b94db4cc'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:39:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:39:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:52 user nova-compute[74821]: INFO os_vif [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:d9:3e,bridge_name='br-int',has_traffic_filtering=True,id=6c14439c-9307-476c-bb5a-484f35b38659,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c14439c-93')
Nov 06 13:39:53 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:39:53 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] No VIF found with MAC fa:16:3e:e4:d9:3e, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:39:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:39:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:39:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:39:53 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:39:53 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:39:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=8616MB free_disk=25.073974609375GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:39:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:39:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:39:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance db04d895-338b-46fb-af08-779ad5d1181d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:39:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 929e1e7d-3abf-4c2f-b792-16b0ef970d88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:39:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance c3293c45-e843-4d6b-bc15-a10010a24ea6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:39:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 754e8314-2f91-4aa4-83d0-2ce9b94db4cc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:39:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:39:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:39:53 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:39:53 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:39:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:39:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.264s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:39:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:54 user nova-compute[74821]: DEBUG nova.compute.manager [req-19631b29-786a-496f-b8c8-adcac2ca255e req-f5596803-446c-4c85-97f7-7d1a357035ea service nova] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Received event network-vif-plugged-6c14439c-9307-476c-bb5a-484f35b38659 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:39:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-19631b29-786a-496f-b8c8-adcac2ca255e req-f5596803-446c-4c85-97f7-7d1a357035ea service nova] Acquiring lock "754e8314-2f91-4aa4-83d0-2ce9b94db4cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:39:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-19631b29-786a-496f-b8c8-adcac2ca255e req-f5596803-446c-4c85-97f7-7d1a357035ea service nova] Lock "754e8314-2f91-4aa4-83d0-2ce9b94db4cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:39:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-19631b29-786a-496f-b8c8-adcac2ca255e req-f5596803-446c-4c85-97f7-7d1a357035ea service nova] Lock "754e8314-2f91-4aa4-83d0-2ce9b94db4cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:39:54 user nova-compute[74821]: DEBUG nova.compute.manager [req-19631b29-786a-496f-b8c8-adcac2ca255e req-f5596803-446c-4c85-97f7-7d1a357035ea service nova] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] No waiting events found dispatching network-vif-plugged-6c14439c-9307-476c-bb5a-484f35b38659 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:39:54 user nova-compute[74821]: WARNING nova.compute.manager [req-19631b29-786a-496f-b8c8-adcac2ca255e req-f5596803-446c-4c85-97f7-7d1a357035ea service nova] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Received unexpected event network-vif-plugged-6c14439c-9307-476c-bb5a-484f35b38659 for instance with vm_state building and task_state spawning.
Nov 06 13:39:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:39:56 user nova-compute[74821]: DEBUG nova.compute.manager [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:39:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:39:56 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Instance spawned successfully.
Nov 06 13:39:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:39:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:39:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:39:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:39:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:39:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:39:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:39:56 user nova-compute[74821]: DEBUG nova.compute.manager [req-5323f871-eff7-401f-a039-f8cc517f027d req-9d85ec6d-6f55-413c-9377-009869c2997f service nova] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Received event network-vif-plugged-6c14439c-9307-476c-bb5a-484f35b38659 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:39:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5323f871-eff7-401f-a039-f8cc517f027d req-9d85ec6d-6f55-413c-9377-009869c2997f service nova] Acquiring lock "754e8314-2f91-4aa4-83d0-2ce9b94db4cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:39:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5323f871-eff7-401f-a039-f8cc517f027d req-9d85ec6d-6f55-413c-9377-009869c2997f service nova] Lock "754e8314-2f91-4aa4-83d0-2ce9b94db4cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:39:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5323f871-eff7-401f-a039-f8cc517f027d req-9d85ec6d-6f55-413c-9377-009869c2997f service nova] Lock "754e8314-2f91-4aa4-83d0-2ce9b94db4cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:39:56 user nova-compute[74821]: DEBUG nova.compute.manager [req-5323f871-eff7-401f-a039-f8cc517f027d req-9d85ec6d-6f55-413c-9377-009869c2997f service nova] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] No waiting events found dispatching network-vif-plugged-6c14439c-9307-476c-bb5a-484f35b38659 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:39:56 user nova-compute[74821]: WARNING nova.compute.manager [req-5323f871-eff7-401f-a039-f8cc517f027d req-9d85ec6d-6f55-413c-9377-009869c2997f service nova] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Received unexpected event network-vif-plugged-6c14439c-9307-476c-bb5a-484f35b38659 for instance with vm_state building and task_state spawning.
Nov 06 13:39:56 user nova-compute[74821]: INFO nova.compute.manager [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Took 5.02 seconds to spawn the instance on the hypervisor.
Nov 06 13:39:56 user nova-compute[74821]: DEBUG nova.compute.manager [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:39:56 user nova-compute[74821]: INFO nova.compute.manager [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Took 26.76 seconds to build instance.
Nov 06 13:39:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-eb5d1506-cca0-4132-a8bc-ac85a02c4cf2 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "754e8314-2f91-4aa4-83d0-2ce9b94db4cc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.868s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:39:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:40:00 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:40:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:40:03 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:40:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:40:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:40:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:40:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:40:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:40:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:40:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:40:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:40:16 user nova-compute[74821]: DEBUG nova.compute.manager [req-b542b0f8-4e1b-4179-b998-a3404304e092 req-06ee1e08-e9e8-45f1-a797-d981a9ecdbe5 service nova] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Received event network-changed-0997f4aa-17bc-4f72-b43a-63eb00bd4a71 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:40:16 user nova-compute[74821]: DEBUG nova.compute.manager [req-b542b0f8-4e1b-4179-b998-a3404304e092 req-06ee1e08-e9e8-45f1-a797-d981a9ecdbe5 service nova] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Refreshing instance network info cache due to event network-changed-0997f4aa-17bc-4f72-b43a-63eb00bd4a71. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:40:16 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b542b0f8-4e1b-4179-b998-a3404304e092 req-06ee1e08-e9e8-45f1-a797-d981a9ecdbe5 service nova] Acquiring lock "refresh_cache-db04d895-338b-46fb-af08-779ad5d1181d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:40:16 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b542b0f8-4e1b-4179-b998-a3404304e092 req-06ee1e08-e9e8-45f1-a797-d981a9ecdbe5 service nova] Acquired lock "refresh_cache-db04d895-338b-46fb-af08-779ad5d1181d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:40:16 user nova-compute[74821]: DEBUG nova.network.neutron [req-b542b0f8-4e1b-4179-b998-a3404304e092 req-06ee1e08-e9e8-45f1-a797-d981a9ecdbe5 service nova] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Refreshing network info cache for port 0997f4aa-17bc-4f72-b43a-63eb00bd4a71 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:40:17 user nova-compute[74821]: DEBUG nova.network.neutron [req-b542b0f8-4e1b-4179-b998-a3404304e092 req-06ee1e08-e9e8-45f1-a797-d981a9ecdbe5 service nova] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Updated VIF entry in instance network info cache for port 0997f4aa-17bc-4f72-b43a-63eb00bd4a71. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:40:17 user nova-compute[74821]: DEBUG nova.network.neutron [req-b542b0f8-4e1b-4179-b998-a3404304e092 req-06ee1e08-e9e8-45f1-a797-d981a9ecdbe5 service nova] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Updating instance_info_cache with network_info: [{"id": "0997f4aa-17bc-4f72-b43a-63eb00bd4a71", "address": "fa:16:3e:46:dc:53", "network": {"id": "9dfb5db2-5cef-4f79-a41d-af4ae6967c09", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1976265278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a79b69221f742dc9f128dd708d1b9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0997f4aa-17", "ovs_interfaceid": "0997f4aa-17bc-4f72-b43a-63eb00bd4a71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:40:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b542b0f8-4e1b-4179-b998-a3404304e092 req-06ee1e08-e9e8-45f1-a797-d981a9ecdbe5 service nova] Releasing lock "refresh_cache-db04d895-338b-46fb-af08-779ad5d1181d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:40:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:40:20 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:40:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:40:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Acquiring lock "db04d895-338b-46fb-af08-779ad5d1181d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:40:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "db04d895-338b-46fb-af08-779ad5d1181d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:40:23 user nova-compute[74821]: DEBUG nova.objects.instance [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lazy-loading 'flavor' on Instance uuid db04d895-338b-46fb-af08-779ad5d1181d {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:40:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "db04d895-338b-46fb-af08-779ad5d1181d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:40:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Acquiring lock "db04d895-338b-46fb-af08-779ad5d1181d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:40:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "db04d895-338b-46fb-af08-779ad5d1181d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:40:23 user nova-compute[74821]: INFO nova.compute.manager [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Attaching volume bf552cc9-135c-443d-9f3a-1c0927af2301 to /dev/vdb
Nov 06 13:40:23 user nova-compute[74821]: DEBUG os_brick.utils [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:40:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:24 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4047b401-0161-4d81-9923-293c847fe34c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:40:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:24 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0887d696-06ee-41f2-a927-36ee4e07fb1a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:40:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:24 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[058f3335-611a-4f4f-b872-844ce8e45d9f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:40:24 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d56386-696e-471c-b5b1-e0f70bc1b1af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:40:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:40:24 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:40:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:40:24 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:40:24 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1db161-9d2b-41d2-93a2-6393e66a2596]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:40:24 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:40:24 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:40:24 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:40:24 user nova-compute[74821]: DEBUG os_brick.utils [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:40:24 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Updating existing volume attachment record: 252e2f7e-5764-4d40-aaed-a2cc0463f18f {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:40:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:40:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:40:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:40:25 user nova-compute[74821]: DEBUG nova.objects.instance [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lazy-loading 'flavor' on Instance uuid 929e1e7d-3abf-4c2f-b792-16b0ef970d88 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:40:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:40:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:40:25 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:40:25 user nova-compute[74821]: INFO nova.compute.manager [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Attaching volume 90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c to /dev/vdb
Nov 06 13:40:25 user nova-compute[74821]: DEBUG os_brick.utils [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:40:25 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:25 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:25 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[463276e4-f391-412a-8d74-a9e2cbf3f586]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:40:25 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:25 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:25 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c73bfdc-9ae0-4e73-939d-0ddf21df1086]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:40:25 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:25 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:25 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9567e073-0cce-4cc0-a76c-c421015ab1f1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:40:25 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdf3b23-fbbd-4014-ba84-c51f9a6c74fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:40:25 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:25 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:40:25 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:40:25 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:25 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:40:25 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:40:25 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[66601c0a-3d4c-4b20-9396-627890d06baf]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:40:25 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:40:25 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:40:25 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:40:25 user nova-compute[74821]: DEBUG os_brick.utils [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:40:25 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Updating existing volume attachment record: bc876cec-a8c2-485d-8f4e-8ffc7d693388 {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:40:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:40:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:40:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "727cdc17-f58c-4cfc-a00c-d4651dc1e9eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:40:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "727cdc17-f58c-4cfc-a00c-d4651dc1e9eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:40:32 user nova-compute[74821]: DEBUG nova.compute.manager [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:40:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:40:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:40:32 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:40:32 user nova-compute[74821]: INFO nova.compute.claims [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Claim successful on node user
Nov 06 13:40:32 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:40:32 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:40:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.278s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:40:32 user nova-compute[74821]: DEBUG nova.compute.manager [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:40:32 user nova-compute[74821]: DEBUG nova.compute.manager [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:40:32 user nova-compute[74821]: DEBUG nova.network.neutron [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:40:32 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:40:32 user nova-compute[74821]: DEBUG nova.compute.manager [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:40:32 user nova-compute[74821]: DEBUG nova.compute.manager [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:40:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:40:32 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Creating image(s)
Nov 06 13:40:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "/opt/stack/data/nova/instances/727cdc17-f58c-4cfc-a00c-d4651dc1e9eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:40:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "/opt/stack/data/nova/instances/727cdc17-f58c-4cfc-a00c-d4651dc1e9eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:40:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "/opt/stack/data/nova/instances/727cdc17-f58c-4cfc-a00c-d4651dc1e9eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:40:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:32 user nova-compute[74821]: DEBUG nova.policy [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5ffddfc972374f6aa7d81288d34690cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6d2ded0b1d4af09f1e05582bcbd3ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:40:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:40:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.176s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:40:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:40:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.201s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/727cdc17-f58c-4cfc-a00c-d4651dc1e9eb/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/727cdc17-f58c-4cfc-a00c-d4651dc1e9eb/disk 1073741824" returned: 0 in 0.052s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:40:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.175s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:33 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Checking if we can resize image /opt/stack/data/nova/instances/727cdc17-f58c-4cfc-a00c-d4651dc1e9eb/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:40:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/727cdc17-f58c-4cfc-a00c-d4651dc1e9eb/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:33 user nova-compute[74821]: DEBUG nova.network.neutron [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Successfully created port: 57183466-2952-4bd9-b1a5-35e9bb976887 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:40:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/727cdc17-f58c-4cfc-a00c-d4651dc1e9eb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:33 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Cannot resize image /opt/stack/data/nova/instances/727cdc17-f58c-4cfc-a00c-d4651dc1e9eb/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:40:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:40:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Ensure instance console log exists: /opt/stack/data/nova/instances/727cdc17-f58c-4cfc-a00c-d4651dc1e9eb/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:40:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:40:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:40:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.network.neutron [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Successfully updated port: 57183466-2952-4bd9-b1a5-35e9bb976887 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "refresh_cache-727cdc17-f58c-4cfc-a00c-d4651dc1e9eb" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquired lock "refresh_cache-727cdc17-f58c-4cfc-a00c-d4651dc1e9eb" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.network.neutron [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.compute.manager [req-86e4735c-2943-4d47-ac9d-508fed0d4a71 req-1586614d-62ba-4a5a-bf79-400382061fe7 service nova] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Received event network-changed-57183466-2952-4bd9-b1a5-35e9bb976887 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.compute.manager [req-86e4735c-2943-4d47-ac9d-508fed0d4a71 req-1586614d-62ba-4a5a-bf79-400382061fe7 service nova] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Refreshing instance network info cache due to event network-changed-57183466-2952-4bd9-b1a5-35e9bb976887. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-86e4735c-2943-4d47-ac9d-508fed0d4a71 req-1586614d-62ba-4a5a-bf79-400382061fe7 service nova] Acquiring lock "refresh_cache-727cdc17-f58c-4cfc-a00c-d4651dc1e9eb" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.network.neutron [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.network.neutron [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Updating instance_info_cache with network_info: [{"id": "57183466-2952-4bd9-b1a5-35e9bb976887", "address": "fa:16:3e:27:3a:ad", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57183466-29", "ovs_interfaceid": "57183466-2952-4bd9-b1a5-35e9bb976887", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Releasing lock "refresh_cache-727cdc17-f58c-4cfc-a00c-d4651dc1e9eb" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.compute.manager [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Instance network_info: |[{"id": "57183466-2952-4bd9-b1a5-35e9bb976887", "address": "fa:16:3e:27:3a:ad", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57183466-29", "ovs_interfaceid": "57183466-2952-4bd9-b1a5-35e9bb976887", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-86e4735c-2943-4d47-ac9d-508fed0d4a71 req-1586614d-62ba-4a5a-bf79-400382061fe7 service nova] Acquired lock "refresh_cache-727cdc17-f58c-4cfc-a00c-d4651dc1e9eb" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.network.neutron [req-86e4735c-2943-4d47-ac9d-508fed0d4a71 req-1586614d-62ba-4a5a-bf79-400382061fe7 service nova] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Refreshing network info cache for port 57183466-2952-4bd9-b1a5-35e9bb976887 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Start _get_guest_xml network_info=[{"id": "57183466-2952-4bd9-b1a5-35e9bb976887", "address": "fa:16:3e:27:3a:ad", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57183466-29", "ovs_interfaceid": "57183466-2952-4bd9-b1a5-35e9bb976887", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:40:34 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:40:34 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:40:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1503797919',display_name='tempest-AttachVolumeNegativeTest-server-1503797919',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1503797919',id=47,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxI7Icbv9uU7fvDLpo3eLhHtnq5tvZGS7ZoExDwQkq7a9xtmCA0zfjdwySgoEVCJflw6N3JqOa+xn1npLYe+9bcxZyxMDGqtOREA+EJFVTCDDiW7kcooMhVhpbLY2OzDQ==',key_name='tempest-keypair-1648743256',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c6d2ded0b1d4af09f1e05582bcbd3ae',ramdisk_id='',reservation_id='r-wi43mzk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1164383705',owner_user_name='tempest-AttachVolumeNegativeTest-1164383705-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:40:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ffddfc972374f6aa7d81288d34690cf',uuid=727cdc17-f58c-4cfc-a00c-d4651dc1e9eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57183466-2952-4bd9-b1a5-35e9bb976887", "address": "fa:16:3e:27:3a:ad", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57183466-29", "ovs_interfaceid": "57183466-2952-4bd9-b1a5-35e9bb976887", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Converting VIF {"id": "57183466-2952-4bd9-b1a5-35e9bb976887", "address": "fa:16:3e:27:3a:ad", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57183466-29", "ovs_interfaceid": "57183466-2952-4bd9-b1a5-35e9bb976887", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:3a:ad,bridge_name='br-int',has_traffic_filtering=True,id=57183466-2952-4bd9-b1a5-35e9bb976887,network=Network(3e1f6a20-5316-4c49-93a5-deabb70d8608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57183466-29') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.objects.instance [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lazy-loading 'pci_devices' on Instance uuid 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:40:34 user nova-compute[74821]:   <uuid>727cdc17-f58c-4cfc-a00c-d4651dc1e9eb</uuid>
Nov 06 13:40:34 user nova-compute[74821]:   <name>instance-0000002f</name>
Nov 06 13:40:34 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:40:34 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:40:34 user nova-compute[74821]:   <metadata>
Nov 06 13:40:34 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:40:34 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:40:34 user nova-compute[74821]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1503797919</nova:name>
Nov 06 13:40:34 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:40:34</nova:creationTime>
Nov 06 13:40:34 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:40:34 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:40:34 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:40:34 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:40:34 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:40:34 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:40:34 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:40:34 user nova-compute[74821]:       <nova:owner>
Nov 06 13:40:34 user nova-compute[74821]:         <nova:user uuid="5ffddfc972374f6aa7d81288d34690cf">tempest-AttachVolumeNegativeTest-1164383705-project-member</nova:user>
Nov 06 13:40:34 user nova-compute[74821]:         <nova:project uuid="4c6d2ded0b1d4af09f1e05582bcbd3ae">tempest-AttachVolumeNegativeTest-1164383705</nova:project>
Nov 06 13:40:34 user nova-compute[74821]:       </nova:owner>
Nov 06 13:40:34 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:40:34 user nova-compute[74821]:       <nova:ports>
Nov 06 13:40:34 user nova-compute[74821]:         <nova:port uuid="57183466-2952-4bd9-b1a5-35e9bb976887">
Nov 06 13:40:34 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 06 13:40:34 user nova-compute[74821]:         </nova:port>
Nov 06 13:40:34 user nova-compute[74821]:       </nova:ports>
Nov 06 13:40:34 user nova-compute[74821]:     </nova:instance>
Nov 06 13:40:34 user nova-compute[74821]:   </metadata>
Nov 06 13:40:34 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:40:34 user nova-compute[74821]:     <system>
Nov 06 13:40:34 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:40:34 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:40:34 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:40:34 user nova-compute[74821]:       <entry name="serial">727cdc17-f58c-4cfc-a00c-d4651dc1e9eb</entry>
Nov 06 13:40:34 user nova-compute[74821]:       <entry name="uuid">727cdc17-f58c-4cfc-a00c-d4651dc1e9eb</entry>
Nov 06 13:40:34 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:40:34 user nova-compute[74821]:     </system>
Nov 06 13:40:34 user nova-compute[74821]:   </sysinfo>
Nov 06 13:40:34 user nova-compute[74821]:   <os>
Nov 06 13:40:34 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:40:34 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:40:34 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:40:34 user nova-compute[74821]:   </os>
Nov 06 13:40:34 user nova-compute[74821]:   <features>
Nov 06 13:40:34 user nova-compute[74821]:     <acpi/>
Nov 06 13:40:34 user nova-compute[74821]:     <apic/>
Nov 06 13:40:34 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:40:34 user nova-compute[74821]:   </features>
Nov 06 13:40:34 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:40:34 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:40:34 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:40:34 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:40:34 user nova-compute[74821]:   </clock>
Nov 06 13:40:34 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:40:34 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:40:34 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:40:34 user nova-compute[74821]:   </cpu>
Nov 06 13:40:34 user nova-compute[74821]:   <devices>
Nov 06 13:40:34 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:40:34 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:40:34 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/727cdc17-f58c-4cfc-a00c-d4651dc1e9eb/disk"/>
Nov 06 13:40:34 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:40:34 user nova-compute[74821]:     </disk>
Nov 06 13:40:34 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:40:34 user nova-compute[74821]:       <mac address="fa:16:3e:27:3a:ad"/>
Nov 06 13:40:34 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:40:34 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:40:34 user nova-compute[74821]:       <target dev="tap57183466-29"/>
Nov 06 13:40:34 user nova-compute[74821]:     </interface>
Nov 06 13:40:34 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:40:34 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/727cdc17-f58c-4cfc-a00c-d4651dc1e9eb/console.log" append="off"/>
Nov 06 13:40:34 user nova-compute[74821]:     </serial>
Nov 06 13:40:34 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:40:34 user nova-compute[74821]:     <video>
Nov 06 13:40:34 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:40:34 user nova-compute[74821]:     </video>
Nov 06 13:40:34 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:40:34 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:40:34 user nova-compute[74821]:     </rng>
Nov 06 13:40:34 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:40:34 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:40:34 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:40:34 user nova-compute[74821]:     </memballoon>
Nov 06 13:40:34 user nova-compute[74821]:   </devices>
Nov 06 13:40:34 user nova-compute[74821]: </domain>
Nov 06 13:40:34 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:40:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1503797919',display_name='tempest-AttachVolumeNegativeTest-server-1503797919',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1503797919',id=47,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxI7Icbv9uU7fvDLpo3eLhHtnq5tvZGS7ZoExDwQkq7a9xtmCA0zfjdwySgoEVCJflw6N3JqOa+xn1npLYe+9bcxZyxMDGqtOREA+EJFVTCDDiW7kcooMhVhpbLY2OzDQ==',key_name='tempest-keypair-1648743256',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c6d2ded0b1d4af09f1e05582bcbd3ae',ramdisk_id='',reservation_id='r-wi43mzk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1164383705',owner_user_name='tempest-AttachVolumeNegativeTest-1164383705-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:40:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ffddfc972374f6aa7d81288d34690cf',uuid=727cdc17-f58c-4cfc-a00c-d4651dc1e9eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57183466-2952-4bd9-b1a5-35e9bb976887", "address": "fa:16:3e:27:3a:ad", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57183466-29", "ovs_interfaceid": "57183466-2952-4bd9-b1a5-35e9bb976887", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Converting VIF {"id": "57183466-2952-4bd9-b1a5-35e9bb976887", "address": "fa:16:3e:27:3a:ad", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57183466-29", "ovs_interfaceid": "57183466-2952-4bd9-b1a5-35e9bb976887", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:3a:ad,bridge_name='br-int',has_traffic_filtering=True,id=57183466-2952-4bd9-b1a5-35e9bb976887,network=Network(3e1f6a20-5316-4c49-93a5-deabb70d8608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57183466-29') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG os_vif [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:3a:ad,bridge_name='br-int',has_traffic_filtering=True,id=57183466-2952-4bd9-b1a5-35e9bb976887,network=Network(3e1f6a20-5316-4c49-93a5-deabb70d8608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57183466-29') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '220dcf19-c48a-5dd3-8497-dc06d6f6e77a', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57183466-29, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap57183466-29, col_values=(('qos', UUID('8cac1e50-e0f1-41d0-937f-edcfb70b6c80')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap57183466-29, col_values=(('external_ids', {'iface-id': '57183466-2952-4bd9-b1a5-35e9bb976887', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:3a:ad', 'vm-uuid': '727cdc17-f58c-4cfc-a00c-d4651dc1e9eb'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:40:34 user nova-compute[74821]: INFO os_vif [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:3a:ad,bridge_name='br-int',has_traffic_filtering=True,id=57183466-2952-4bd9-b1a5-35e9bb976887,network=Network(3e1f6a20-5316-4c49-93a5-deabb70d8608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57183466-29')
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] No VIF found with MAC fa:16:3e:27:3a:ad, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.network.neutron [req-86e4735c-2943-4d47-ac9d-508fed0d4a71 req-1586614d-62ba-4a5a-bf79-400382061fe7 service nova] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Updated VIF entry in instance network info cache for port 57183466-2952-4bd9-b1a5-35e9bb976887. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG nova.network.neutron [req-86e4735c-2943-4d47-ac9d-508fed0d4a71 req-1586614d-62ba-4a5a-bf79-400382061fe7 service nova] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Updating instance_info_cache with network_info: [{"id": "57183466-2952-4bd9-b1a5-35e9bb976887", "address": "fa:16:3e:27:3a:ad", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57183466-29", "ovs_interfaceid": "57183466-2952-4bd9-b1a5-35e9bb976887", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:40:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-86e4735c-2943-4d47-ac9d-508fed0d4a71 req-1586614d-62ba-4a5a-bf79-400382061fe7 service nova] Releasing lock "refresh_cache-727cdc17-f58c-4cfc-a00c-d4651dc1e9eb" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:40:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:40:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:40:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:40:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:40:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:40:36 user nova-compute[74821]: DEBUG nova.compute.manager [req-f64f046d-b0be-4bfc-bc6a-3662e7990ac2 req-0bc176df-df4d-4610-99e7-8c876316c6b2 service nova] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Received event network-vif-plugged-57183466-2952-4bd9-b1a5-35e9bb976887 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:40:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f64f046d-b0be-4bfc-bc6a-3662e7990ac2 req-0bc176df-df4d-4610-99e7-8c876316c6b2 service nova] Acquiring lock "727cdc17-f58c-4cfc-a00c-d4651dc1e9eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:40:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f64f046d-b0be-4bfc-bc6a-3662e7990ac2 req-0bc176df-df4d-4610-99e7-8c876316c6b2 service nova] Lock "727cdc17-f58c-4cfc-a00c-d4651dc1e9eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:40:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f64f046d-b0be-4bfc-bc6a-3662e7990ac2 req-0bc176df-df4d-4610-99e7-8c876316c6b2 service nova] Lock "727cdc17-f58c-4cfc-a00c-d4651dc1e9eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:40:36 user nova-compute[74821]: DEBUG nova.compute.manager [req-f64f046d-b0be-4bfc-bc6a-3662e7990ac2 req-0bc176df-df4d-4610-99e7-8c876316c6b2 service nova] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] No waiting events found dispatching network-vif-plugged-57183466-2952-4bd9-b1a5-35e9bb976887 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:40:36 user nova-compute[74821]: WARNING nova.compute.manager [req-f64f046d-b0be-4bfc-bc6a-3662e7990ac2 req-0bc176df-df4d-4610-99e7-8c876316c6b2 service nova] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Received unexpected event network-vif-plugged-57183466-2952-4bd9-b1a5-35e9bb976887 for instance with vm_state building and task_state spawning.
Nov 06 13:40:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:40:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:40:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:40:38 user nova-compute[74821]: DEBUG nova.compute.manager [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:40:38 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:40:38 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Instance spawned successfully.
Nov 06 13:40:38 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:40:38 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:40:38 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:40:38 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:40:38 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:40:38 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:40:38 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:40:38 user nova-compute[74821]: INFO nova.compute.manager [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Took 5.48 seconds to spawn the instance on the hypervisor.
Nov 06 13:40:38 user nova-compute[74821]: DEBUG nova.compute.manager [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:40:38 user nova-compute[74821]: DEBUG nova.compute.manager [req-c0773f33-84f6-4c34-a49a-fa5abcf4f972 req-3976fdd1-c722-4d2a-860a-8a027d2e6668 service nova] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Received event network-vif-plugged-57183466-2952-4bd9-b1a5-35e9bb976887 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:40:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c0773f33-84f6-4c34-a49a-fa5abcf4f972 req-3976fdd1-c722-4d2a-860a-8a027d2e6668 service nova] Acquiring lock "727cdc17-f58c-4cfc-a00c-d4651dc1e9eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:40:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c0773f33-84f6-4c34-a49a-fa5abcf4f972 req-3976fdd1-c722-4d2a-860a-8a027d2e6668 service nova] Lock "727cdc17-f58c-4cfc-a00c-d4651dc1e9eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:40:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c0773f33-84f6-4c34-a49a-fa5abcf4f972 req-3976fdd1-c722-4d2a-860a-8a027d2e6668 service nova] Lock "727cdc17-f58c-4cfc-a00c-d4651dc1e9eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:40:38 user nova-compute[74821]: DEBUG nova.compute.manager [req-c0773f33-84f6-4c34-a49a-fa5abcf4f972 req-3976fdd1-c722-4d2a-860a-8a027d2e6668 service nova] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] No waiting events found dispatching network-vif-plugged-57183466-2952-4bd9-b1a5-35e9bb976887 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:40:38 user nova-compute[74821]: WARNING nova.compute.manager [req-c0773f33-84f6-4c34-a49a-fa5abcf4f972 req-3976fdd1-c722-4d2a-860a-8a027d2e6668 service nova] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Received unexpected event network-vif-plugged-57183466-2952-4bd9-b1a5-35e9bb976887 for instance with vm_state building and task_state spawning.
Nov 06 13:40:38 user nova-compute[74821]: INFO nova.compute.manager [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Took 6.23 seconds to build instance.
Nov 06 13:40:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-09f787de-89f6-4b0d-b977-fa876438abc8 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "727cdc17-f58c-4cfc-a00c-d4651dc1e9eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.328s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:40:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:40:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:40:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:40:45 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:40:45 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:40:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-929e1e7d-3abf-4c2f-b792-16b0ef970d88" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:40:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-929e1e7d-3abf-4c2f-b792-16b0ef970d88" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:40:46 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JgvIcCYb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:40:47 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:40:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:40:47 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:40:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:40:47 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:40:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Updating instance_info_cache with network_info: [{"id": "f0259675-f417-4927-993f-769bab8f0086", "address": "fa:16:3e:de:27:55", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0259675-f4", "ovs_interfaceid": "f0259675-f417-4927-993f-769bab8f0086", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d3e125-81d2-4a00-b174-b1a08c75c507]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:40:47 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-929e1e7d-3abf-4c2f-b792-16b0ef970d88" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[157529c7-5448-4d7d-8eea-f94e82db20cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301] added
Nov 06 13:40:47 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6860d5ba-0b26-4bc7-81fa-92d374f4d134]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a9da32-7661-4593-a026-07d2ecdd6b5a]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JgvIcCYb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JgvIcCYb" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1ce62f-bf6a-4088-8192-091e5991da25]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JgvIcCYb'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[04452550-3f95-43d8-bd03-c9586bab412b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e288c7d3-d917-403d-92c0-c8605782cabd]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:40:47 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:40:47 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2090c3d8-c1c1-4275-8825-0fbd54d63424]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301, portal: 172.16.0.220,3260]
Nov 06 13:40:47 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301, portal: 172.16.0.220,3260] successful.
Nov 06 13:40:47 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b05908-10ba-4ae5-be5c-c7393d88cb51]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[870452f2-da33-4a60-ab02-f22b5638f2dc]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:40:47 user nova-compute[74821]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 (non-flash)
Nov 06 13:40:47 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:40:47 user nova-compute[74821]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 (non-flash)
Nov 06 13:40:47 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.029s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[088fccb8-9e53-4b02-ad0b-a2bd814b66e6]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:40:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JgvIcCYb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MbWtCvdT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:40:48 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:40:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '26435383066666531', 'path': '/dev/sdc'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435383066666531', 'path': '/dev/sdc'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.398s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:40:48 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:40:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:40:48 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:40:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG nova.objects.instance [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lazy-loading 'flavor' on Instance uuid db04d895-338b-46fb-af08-779ad5d1181d {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c01aa44-222d-4c44-b21b-2a9a89470899]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:40:48 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 13:40:48 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:40:48 user nova-compute[74821]:   <source dev="/dev/sdc"/>
Nov 06 13:40:48 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:40:48 user nova-compute[74821]:   <serial>bf552cc9-135c-443d-9f3a-1c0927af2301</serial>
Nov 06 13:40:48 user nova-compute[74821]: </disk>
Nov 06 13:40:48 user nova-compute[74821]:  {{(pid=74821) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88028e5-3cbc-4942-baab-01e3b3f6ac10]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c] added
Nov 06 13:40:48 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a51439-d01f-481d-830a-2e3756c50885]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bf9210-9d33-45af-9769-28859f2a2771]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MbWtCvdT {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MbWtCvdT" returned: 0 in 0.035s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35c7277-dbdf-45d5-842f-a6aed811a224]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MbWtCvdT'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[486f2833-0b01-45a2-96b5-1c9f1ea1cf6a]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e20d8b-dda9-4a6f-8d81-2f6fb78b4b50]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:40:48 user nova-compute[74821]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 (non-flash)
Nov 06 13:40:48 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:40:48 user nova-compute[74821]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 (non-flash)
Nov 06 13:40:48 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[244b409d-e8ed-4be6-b6d4-7c0592127e96]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c, portal: 172.16.0.220,3260]
Nov 06 13:40:48 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c, portal: 172.16.0.220,3260] successful.
Nov 06 13:40:48 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d595a96f-78ed-4a6e-8146-e412f2a59bc2]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[835e5757-359d-4f6a-b176-33f252112429]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:40:48 user nova-compute[74821]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 (non-flash)
Nov 06 13:40:48 user nova-compute[74821]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c (non-flash)
Nov 06 13:40:48 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:40:48 user nova-compute[74821]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 (non-flash)
Nov 06 13:40:48 user nova-compute[74821]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c (non-flash)
Nov 06 13:40:48 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5893b00a-74e6-4f56-be6b-f01816b7d9b4]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:40:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MbWtCvdT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:40:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:40:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:40:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] No VIF found with MAC fa:16:3e:46:dc:53, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:40:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c017f246-6c8d-4372-876c-1ec2423d0ffb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "db04d895-338b-46fb-af08-779ad5d1181d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.237s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:40:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:40:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:40:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] <== connect_volume: return (1762ms) {'type': 'block', 'scsi_wwn': '23966333138663062', 'path': '/dev/sdd'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:40:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966333138663062', 'path': '/dev/sdd'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:40:49 user nova-compute[74821]: DEBUG nova.objects.instance [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lazy-loading 'flavor' on Instance uuid 929e1e7d-3abf-4c2f-b792-16b0ef970d88 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:40:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 13:40:49 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:40:49 user nova-compute[74821]:   <source dev="/dev/sdd"/>
Nov 06 13:40:49 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:40:49 user nova-compute[74821]:   <serial>90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c</serial>
Nov 06 13:40:49 user nova-compute[74821]: </disk>
Nov 06 13:40:49 user nova-compute[74821]:  {{(pid=74821) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 13:40:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:40:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:40:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:40:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] No VIF found with MAC fa:16:3e:de:27:55, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:40:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4d85bb9f-0d0b-4626-b79e-81ca572b618a tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.835s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:40:51 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:40:51 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:40:51 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:40:51 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:40:52 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:40:52 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:40:53 user nova-compute[74821]: DEBUG nova.compute.manager [req-6dc7376e-9e14-4991-af47-125041a1c2cc req-b6cd368c-c52e-47d0-9beb-29451a3e7824 service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Received event network-changed-f0259675-f417-4927-993f-769bab8f0086 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:40:53 user nova-compute[74821]: DEBUG nova.compute.manager [req-6dc7376e-9e14-4991-af47-125041a1c2cc req-b6cd368c-c52e-47d0-9beb-29451a3e7824 service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Refreshing instance network info cache due to event network-changed-f0259675-f417-4927-993f-769bab8f0086. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:40:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6dc7376e-9e14-4991-af47-125041a1c2cc req-b6cd368c-c52e-47d0-9beb-29451a3e7824 service nova] Acquiring lock "refresh_cache-929e1e7d-3abf-4c2f-b792-16b0ef970d88" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:40:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6dc7376e-9e14-4991-af47-125041a1c2cc req-b6cd368c-c52e-47d0-9beb-29451a3e7824 service nova] Acquired lock "refresh_cache-929e1e7d-3abf-4c2f-b792-16b0ef970d88" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:40:53 user nova-compute[74821]: DEBUG nova.network.neutron [req-6dc7376e-9e14-4991-af47-125041a1c2cc req-b6cd368c-c52e-47d0-9beb-29451a3e7824 service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Refreshing network info cache for port f0259675-f417-4927-993f-769bab8f0086 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:40:53 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:40:53 user nova-compute[74821]: DEBUG nova.network.neutron [req-6dc7376e-9e14-4991-af47-125041a1c2cc req-b6cd368c-c52e-47d0-9beb-29451a3e7824 service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Updated VIF entry in instance network info cache for port f0259675-f417-4927-993f-769bab8f0086. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:40:53 user nova-compute[74821]: DEBUG nova.network.neutron [req-6dc7376e-9e14-4991-af47-125041a1c2cc req-b6cd368c-c52e-47d0-9beb-29451a3e7824 service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Updating instance_info_cache with network_info: [{"id": "f0259675-f417-4927-993f-769bab8f0086", "address": "fa:16:3e:de:27:55", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0259675-f4", "ovs_interfaceid": "f0259675-f417-4927-993f-769bab8f0086", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:40:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:40:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:40:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:40:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:40:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6dc7376e-9e14-4991-af47-125041a1c2cc req-b6cd368c-c52e-47d0-9beb-29451a3e7824 service nova] Releasing lock "refresh_cache-929e1e7d-3abf-4c2f-b792-16b0ef970d88" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:40:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:40:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e1e7d-3abf-4c2f-b792-16b0ef970d88/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:40:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e1e7d-3abf-4c2f-b792-16b0ef970d88/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e1e7d-3abf-4c2f-b792-16b0ef970d88/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e1e7d-3abf-4c2f-b792-16b0ef970d88/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:40:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:40:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:40:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/727cdc17-f58c-4cfc-a00c-d4651dc1e9eb/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/727cdc17-f58c-4cfc-a00c-d4651dc1e9eb/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/727cdc17-f58c-4cfc-a00c-d4651dc1e9eb/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:40:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/727cdc17-f58c-4cfc-a00c-d4651dc1e9eb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:40:56 user nova-compute[74821]: DEBUG nova.compute.manager [req-49f7ee84-823a-41c2-85bd-8796c1937124 req-2f6f3bcc-957b-4e70-a89e-9845edfe0860 service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Received event network-changed-f0259675-f417-4927-993f-769bab8f0086 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:40:56 user nova-compute[74821]: DEBUG nova.compute.manager [req-49f7ee84-823a-41c2-85bd-8796c1937124 req-2f6f3bcc-957b-4e70-a89e-9845edfe0860 service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Refreshing instance network info cache due to event network-changed-f0259675-f417-4927-993f-769bab8f0086. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:40:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-49f7ee84-823a-41c2-85bd-8796c1937124 req-2f6f3bcc-957b-4e70-a89e-9845edfe0860 service nova] Acquiring lock "refresh_cache-929e1e7d-3abf-4c2f-b792-16b0ef970d88" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:40:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-49f7ee84-823a-41c2-85bd-8796c1937124 req-2f6f3bcc-957b-4e70-a89e-9845edfe0860 service nova] Acquired lock "refresh_cache-929e1e7d-3abf-4c2f-b792-16b0ef970d88" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:40:56 user nova-compute[74821]: DEBUG nova.network.neutron [req-49f7ee84-823a-41c2-85bd-8796c1937124 req-2f6f3bcc-957b-4e70-a89e-9845edfe0860 service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Refreshing network info cache for port f0259675-f417-4927-993f-769bab8f0086 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:40:56 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:40:56 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:40:56 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=8348MB free_disk=25.036090850830078GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:40:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:40:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:40:56 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance db04d895-338b-46fb-af08-779ad5d1181d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:40:56 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 929e1e7d-3abf-4c2f-b792-16b0ef970d88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:40:56 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance c3293c45-e843-4d6b-bc15-a10010a24ea6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:40:56 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 754e8314-2f91-4aa4-83d0-2ce9b94db4cc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:40:56 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:40:56 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:40:56 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:40:56 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:40:56 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:40:56 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:40:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.355s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:40:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-95416eff-0b91-487c-b6d5-eaead7116197 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:40:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-95416eff-0b91-487c-b6d5-eaead7116197 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:40:56 user nova-compute[74821]: INFO nova.compute.manager [None req-95416eff-0b91-487c-b6d5-eaead7116197 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Rebooting instance
Nov 06 13:40:56 user nova-compute[74821]: DEBUG nova.network.neutron [req-49f7ee84-823a-41c2-85bd-8796c1937124 req-2f6f3bcc-957b-4e70-a89e-9845edfe0860 service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Updated VIF entry in instance network info cache for port f0259675-f417-4927-993f-769bab8f0086. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:40:56 user nova-compute[74821]: DEBUG nova.network.neutron [req-49f7ee84-823a-41c2-85bd-8796c1937124 req-2f6f3bcc-957b-4e70-a89e-9845edfe0860 service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Updating instance_info_cache with network_info: [{"id": "f0259675-f417-4927-993f-769bab8f0086", "address": "fa:16:3e:de:27:55", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0259675-f4", "ovs_interfaceid": "f0259675-f417-4927-993f-769bab8f0086", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:40:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-49f7ee84-823a-41c2-85bd-8796c1937124 req-2f6f3bcc-957b-4e70-a89e-9845edfe0860 service nova] Releasing lock "refresh_cache-929e1e7d-3abf-4c2f-b792-16b0ef970d88" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:40:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-95416eff-0b91-487c-b6d5-eaead7116197 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "refresh_cache-929e1e7d-3abf-4c2f-b792-16b0ef970d88" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:40:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-95416eff-0b91-487c-b6d5-eaead7116197 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquired lock "refresh_cache-929e1e7d-3abf-4c2f-b792-16b0ef970d88" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:40:56 user nova-compute[74821]: DEBUG nova.network.neutron [None req-95416eff-0b91-487c-b6d5-eaead7116197 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:40:57 user nova-compute[74821]: DEBUG nova.network.neutron [None req-95416eff-0b91-487c-b6d5-eaead7116197 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Updating instance_info_cache with network_info: [{"id": "f0259675-f417-4927-993f-769bab8f0086", "address": "fa:16:3e:de:27:55", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0259675-f4", "ovs_interfaceid": "f0259675-f417-4927-993f-769bab8f0086", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:40:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-95416eff-0b91-487c-b6d5-eaead7116197 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Releasing lock "refresh_cache-929e1e7d-3abf-4c2f-b792-16b0ef970d88" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:40:57 user nova-compute[74821]: DEBUG nova.compute.manager [None req-95416eff-0b91-487c-b6d5-eaead7116197 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:40:58 user nova-compute[74821]: DEBUG nova.compute.manager [req-b403ecb1-c734-492a-9926-9250190816be req-3f16ba06-f884-4d33-bbde-038c66c6cb7d service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Received event network-changed-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:40:58 user nova-compute[74821]: DEBUG nova.compute.manager [req-b403ecb1-c734-492a-9926-9250190816be req-3f16ba06-f884-4d33-bbde-038c66c6cb7d service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Refreshing instance network info cache due to event network-changed-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:40:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b403ecb1-c734-492a-9926-9250190816be req-3f16ba06-f884-4d33-bbde-038c66c6cb7d service nova] Acquiring lock "refresh_cache-c3293c45-e843-4d6b-bc15-a10010a24ea6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:40:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b403ecb1-c734-492a-9926-9250190816be req-3f16ba06-f884-4d33-bbde-038c66c6cb7d service nova] Acquired lock "refresh_cache-c3293c45-e843-4d6b-bc15-a10010a24ea6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:40:58 user nova-compute[74821]: DEBUG nova.network.neutron [req-b403ecb1-c734-492a-9926-9250190816be req-3f16ba06-f884-4d33-bbde-038c66c6cb7d service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Refreshing network info cache for port 4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:40:58 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:40:58 user nova-compute[74821]: DEBUG nova.network.neutron [req-b403ecb1-c734-492a-9926-9250190816be req-3f16ba06-f884-4d33-bbde-038c66c6cb7d service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Updated VIF entry in instance network info cache for port 4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:40:58 user nova-compute[74821]: DEBUG nova.network.neutron [req-b403ecb1-c734-492a-9926-9250190816be req-3f16ba06-f884-4d33-bbde-038c66c6cb7d service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Updating instance_info_cache with network_info: [{"id": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "address": "fa:16:3e:87:40:ab", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da3ffbf-3f", "ovs_interfaceid": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:40:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b403ecb1-c734-492a-9926-9250190816be req-3f16ba06-f884-4d33-bbde-038c66c6cb7d service nova] Releasing lock "refresh_cache-c3293c45-e843-4d6b-bc15-a10010a24ea6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:40:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:40:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:40:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:40:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:41:00 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:41:00 user nova-compute[74821]: DEBUG nova.compute.manager [req-f5affa45-e67a-4f92-ba34-2088ceb0fef0 req-62f7fd67-8123-4278-a61e-fd75c3f0845d service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Received event network-vif-unplugged-f0259675-f417-4927-993f-769bab8f0086 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:41:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f5affa45-e67a-4f92-ba34-2088ceb0fef0 req-62f7fd67-8123-4278-a61e-fd75c3f0845d service nova] Acquiring lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:41:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f5affa45-e67a-4f92-ba34-2088ceb0fef0 req-62f7fd67-8123-4278-a61e-fd75c3f0845d service nova] Lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:41:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f5affa45-e67a-4f92-ba34-2088ceb0fef0 req-62f7fd67-8123-4278-a61e-fd75c3f0845d service nova] Lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:41:00 user nova-compute[74821]: DEBUG nova.compute.manager [req-f5affa45-e67a-4f92-ba34-2088ceb0fef0 req-62f7fd67-8123-4278-a61e-fd75c3f0845d service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] No waiting events found dispatching network-vif-unplugged-f0259675-f417-4927-993f-769bab8f0086 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:41:00 user nova-compute[74821]: WARNING nova.compute.manager [req-f5affa45-e67a-4f92-ba34-2088ceb0fef0 req-62f7fd67-8123-4278-a61e-fd75c3f0845d service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Received unexpected event network-vif-unplugged-f0259675-f417-4927-993f-769bab8f0086 for instance with vm_state active and task_state reboot_started.
Nov 06 13:41:00 user nova-compute[74821]: DEBUG nova.compute.manager [req-f5affa45-e67a-4f92-ba34-2088ceb0fef0 req-62f7fd67-8123-4278-a61e-fd75c3f0845d service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Received event network-vif-plugged-f0259675-f417-4927-993f-769bab8f0086 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:41:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f5affa45-e67a-4f92-ba34-2088ceb0fef0 req-62f7fd67-8123-4278-a61e-fd75c3f0845d service nova] Acquiring lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:41:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f5affa45-e67a-4f92-ba34-2088ceb0fef0 req-62f7fd67-8123-4278-a61e-fd75c3f0845d service nova] Lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:41:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f5affa45-e67a-4f92-ba34-2088ceb0fef0 req-62f7fd67-8123-4278-a61e-fd75c3f0845d service nova] Lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:41:00 user nova-compute[74821]: DEBUG nova.compute.manager [req-f5affa45-e67a-4f92-ba34-2088ceb0fef0 req-62f7fd67-8123-4278-a61e-fd75c3f0845d service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] No waiting events found dispatching network-vif-plugged-f0259675-f417-4927-993f-769bab8f0086 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:41:00 user nova-compute[74821]: WARNING nova.compute.manager [req-f5affa45-e67a-4f92-ba34-2088ceb0fef0 req-62f7fd67-8123-4278-a61e-fd75c3f0845d service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Received unexpected event network-vif-plugged-f0259675-f417-4927-993f-769bab8f0086 for instance with vm_state active and task_state reboot_started.
Nov 06 13:41:00 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-95416eff-0b91-487c-b6d5-eaead7116197 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Instance shutdown successfully.
Nov 06 13:41:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:41:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:41:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:41:02 user nova-compute[74821]: DEBUG nova.compute.manager [req-bea450b2-e4b0-4070-9c5d-e4874245c002 req-c7acf96e-5022-4dab-8a27-cacc1b28ebb9 service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Received event network-vif-plugged-f0259675-f417-4927-993f-769bab8f0086 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:41:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-bea450b2-e4b0-4070-9c5d-e4874245c002 req-c7acf96e-5022-4dab-8a27-cacc1b28ebb9 service nova] Acquiring lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:41:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-bea450b2-e4b0-4070-9c5d-e4874245c002 req-c7acf96e-5022-4dab-8a27-cacc1b28ebb9 service nova] Lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:41:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-bea450b2-e4b0-4070-9c5d-e4874245c002 req-c7acf96e-5022-4dab-8a27-cacc1b28ebb9 service nova] Lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:41:02 user nova-compute[74821]: DEBUG nova.compute.manager [req-bea450b2-e4b0-4070-9c5d-e4874245c002 req-c7acf96e-5022-4dab-8a27-cacc1b28ebb9 service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] No waiting events found dispatching network-vif-plugged-f0259675-f417-4927-993f-769bab8f0086 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:41:02 user nova-compute[74821]: WARNING nova.compute.manager [req-bea450b2-e4b0-4070-9c5d-e4874245c002 req-c7acf96e-5022-4dab-8a27-cacc1b28ebb9 service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Received unexpected event network-vif-plugged-f0259675-f417-4927-993f-769bab8f0086 for instance with vm_state active and task_state reboot_started.
Nov 06 13:41:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:41:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:41:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:41:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "c3293c45-e843-4d6b-bc15-a10010a24ea6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:41:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:41:02 user nova-compute[74821]: DEBUG nova.objects.instance [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lazy-loading 'flavor' on Instance uuid c3293c45-e843-4d6b-bc15-a10010a24ea6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:41:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:41:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "c3293c45-e843-4d6b-bc15-a10010a24ea6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:41:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:41:02 user nova-compute[74821]: INFO nova.compute.manager [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Attaching volume 6e8f395f-5111-45d2-8cb4-6a2aced821d4 to /dev/vdb
Nov 06 13:41:03 user nova-compute[74821]: DEBUG os_brick.utils [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:41:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:41:03 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[018bd078-b220-484b-b1fd-b992b893e1ab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:41:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:41:03 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7e2328-8584-42bc-b614-7d894a9d00f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:41:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:41:03 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f78763-34cd-461b-85ec-e3abd1969073]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:41:03 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[81785379-cdbc-4f91-b851-7570e40967ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:41:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:41:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:41:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:41:03 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:41:03 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f140e9aa-ba9e-4e87-874a-ed2d96ddea8b]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:41:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:41:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:41:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:41:03 user nova-compute[74821]: DEBUG os_brick.utils [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:41:03 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Updating existing volume attachment record: ed771829-3228-414c-acf9-a9224985896b {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:41:03 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:41:04 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Instance running successfully.
Nov 06 13:41:04 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-95416eff-0b91-487c-b6d5-eaead7116197 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Instance soft rebooted successfully.
Nov 06 13:41:04 user nova-compute[74821]: DEBUG nova.compute.manager [None req-95416eff-0b91-487c-b6d5-eaead7116197 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:41:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-95416eff-0b91-487c-b6d5-eaead7116197 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.575s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:41:04 user nova-compute[74821]: DEBUG nova.compute.manager [req-5f0143f1-c914-40f1-b0cb-133c4244681b req-463f75e7-36f2-4285-995d-39d3bb694429 service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Received event network-vif-plugged-f0259675-f417-4927-993f-769bab8f0086 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:41:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5f0143f1-c914-40f1-b0cb-133c4244681b req-463f75e7-36f2-4285-995d-39d3bb694429 service nova] Acquiring lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:41:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5f0143f1-c914-40f1-b0cb-133c4244681b req-463f75e7-36f2-4285-995d-39d3bb694429 service nova] Lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:41:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5f0143f1-c914-40f1-b0cb-133c4244681b req-463f75e7-36f2-4285-995d-39d3bb694429 service nova] Lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:41:04 user nova-compute[74821]: DEBUG nova.compute.manager [req-5f0143f1-c914-40f1-b0cb-133c4244681b req-463f75e7-36f2-4285-995d-39d3bb694429 service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] No waiting events found dispatching network-vif-plugged-f0259675-f417-4927-993f-769bab8f0086 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:41:04 user nova-compute[74821]: WARNING nova.compute.manager [req-5f0143f1-c914-40f1-b0cb-133c4244681b req-463f75e7-36f2-4285-995d-39d3bb694429 service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Received unexpected event network-vif-plugged-f0259675-f417-4927-993f-769bab8f0086 for instance with vm_state active and task_state None.
Nov 06 13:41:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:41:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:41:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:41:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:41:14 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:41:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:41:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:41:20 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:41:20 user nova-compute[74821]: DEBUG nova.compute.manager [req-d81e3b79-268a-417d-a8f1-38391f558402 req-a7b2eb52-8755-47dd-a7ad-209ce52c6689 service nova] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Received event network-changed-6c14439c-9307-476c-bb5a-484f35b38659 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:41:20 user nova-compute[74821]: DEBUG nova.compute.manager [req-d81e3b79-268a-417d-a8f1-38391f558402 req-a7b2eb52-8755-47dd-a7ad-209ce52c6689 service nova] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Refreshing instance network info cache due to event network-changed-6c14439c-9307-476c-bb5a-484f35b38659. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:41:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d81e3b79-268a-417d-a8f1-38391f558402 req-a7b2eb52-8755-47dd-a7ad-209ce52c6689 service nova] Acquiring lock "refresh_cache-754e8314-2f91-4aa4-83d0-2ce9b94db4cc" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:41:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d81e3b79-268a-417d-a8f1-38391f558402 req-a7b2eb52-8755-47dd-a7ad-209ce52c6689 service nova] Acquired lock "refresh_cache-754e8314-2f91-4aa4-83d0-2ce9b94db4cc" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:41:20 user nova-compute[74821]: DEBUG nova.network.neutron [req-d81e3b79-268a-417d-a8f1-38391f558402 req-a7b2eb52-8755-47dd-a7ad-209ce52c6689 service nova] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Refreshing network info cache for port 6c14439c-9307-476c-bb5a-484f35b38659 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:41:21 user nova-compute[74821]: DEBUG nova.network.neutron [req-d81e3b79-268a-417d-a8f1-38391f558402 req-a7b2eb52-8755-47dd-a7ad-209ce52c6689 service nova] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Updated VIF entry in instance network info cache for port 6c14439c-9307-476c-bb5a-484f35b38659. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:41:21 user nova-compute[74821]: DEBUG nova.network.neutron [req-d81e3b79-268a-417d-a8f1-38391f558402 req-a7b2eb52-8755-47dd-a7ad-209ce52c6689 service nova] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Updating instance_info_cache with network_info: [{"id": "6c14439c-9307-476c-bb5a-484f35b38659", "address": "fa:16:3e:e4:d9:3e", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c14439c-93", "ovs_interfaceid": "6c14439c-9307-476c-bb5a-484f35b38659", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:41:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d81e3b79-268a-417d-a8f1-38391f558402 req-a7b2eb52-8755-47dd-a7ad-209ce52c6689 service nova] Releasing lock "refresh_cache-754e8314-2f91-4aa4-83d0-2ce9b94db4cc" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:41:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:41:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:41:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Acquiring lock "db04d895-338b-46fb-af08-779ad5d1181d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:41:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "db04d895-338b-46fb-af08-779ad5d1181d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:41:28 user nova-compute[74821]: INFO nova.compute.manager [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Detaching volume bf552cc9-135c-443d-9f3a-1c0927af2301
Nov 06 13:41:28 user nova-compute[74821]: INFO nova.virt.block_device [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Attempting to driver detach volume bf552cc9-135c-443d-9f3a-1c0927af2301 from mountpoint /dev/vdb
Nov 06 13:41:28 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Attempting to detach device vdb from instance db04d895-338b-46fb-af08-779ad5d1181d from the persistent domain config. {{(pid=74821) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 13:41:28 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:41:28 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:41:28 user nova-compute[74821]:   <source dev="/dev/sdc"/>
Nov 06 13:41:28 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:41:28 user nova-compute[74821]:   <serial>bf552cc9-135c-443d-9f3a-1c0927af2301</serial>
Nov 06 13:41:28 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:41:28 user nova-compute[74821]: </disk>
Nov 06 13:41:28 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:41:28 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Successfully detached device vdb from instance db04d895-338b-46fb-af08-779ad5d1181d from the persistent domain config.
Nov 06 13:41:28 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance db04d895-338b-46fb-af08-779ad5d1181d from the live domain config. {{(pid=74821) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 13:41:28 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:41:28 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:41:28 user nova-compute[74821]:   <source dev="/dev/sdc"/>
Nov 06 13:41:28 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:41:28 user nova-compute[74821]:   <serial>bf552cc9-135c-443d-9f3a-1c0927af2301</serial>
Nov 06 13:41:28 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:41:28 user nova-compute[74821]: </disk>
Nov 06 13:41:28 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:41:28 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance db04d895-338b-46fb-af08-779ad5d1181d {{(pid=74821) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 13:41:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:41:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:41:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:41:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "eaa80098-14d8-4b64-b45c-242988ad18ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:41:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "eaa80098-14d8-4b64-b45c-242988ad18ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:41:35 user nova-compute[74821]: DEBUG nova.compute.manager [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:41:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:41:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:41:35 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:41:35 user nova-compute[74821]: INFO nova.compute.claims [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Claim successful on node user
Nov 06 13:41:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:41:35 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:41:35 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:41:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.296s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:41:35 user nova-compute[74821]: DEBUG nova.compute.manager [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:41:35 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:41:35 user nova-compute[74821]: DEBUG nova.compute.manager [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:41:35 user nova-compute[74821]: DEBUG nova.network.neutron [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:41:35 user nova-compute[74821]: DEBUG nova.compute.manager [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:41:35 user nova-compute[74821]: INFO nova.virt.block_device [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Booting with volume snapshot eac2a0d2-eb64-4551-98cb-fb15a768188a at /dev/vda
Nov 06 13:41:35 user nova-compute[74821]: DEBUG nova.policy [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3bb6a168d90a4795a72b8ac69eeadcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e811a3a30417a8dc6ccad03f2f8e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:41:35 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:41:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvPQSnqr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:41:35 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:41:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:41:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:41:35 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:41:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:41:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:41:35 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:41:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:41:35 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edbe972-aa39-4e16-8e9a-843599a0b672]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:41:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:41:35 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:41:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.133s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:41:35 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8f397e-baf6-44bf-998d-e27060d18efb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:41:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4] added
Nov 06 13:41:35 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:41:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:41:35 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ad803e-3649-4fcf-8239-280c017f60bd]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:41:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:41:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:41:35 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5623556-8b49-4b51-822b-0cca8c079c09]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:41:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:41:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uvPQSnqr {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uvPQSnqr" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:41:35 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d20678-8d26-47a2-8d0f-a9ab83ea39bb]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:41:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uvPQSnqr'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:41:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:41:36 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b641d802-93a9-444a-ba1d-a2931b10825b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:41:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:41:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:41:36 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19d73a6-de79-42bf-9c0b-f6fa2fe248eb]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:41:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:41:36 user nova-compute[74821]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 (non-flash)
Nov 06 13:41:36 user nova-compute[74821]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c (non-flash)
Nov 06 13:41:36 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:41:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:41:36 user nova-compute[74821]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 (non-flash)
Nov 06 13:41:36 user nova-compute[74821]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c (non-flash)
Nov 06 13:41:36 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:41:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:41:36 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7624f8d-d690-498a-a5b6-09155d03efca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:41:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4, portal: 172.16.0.220,3260]
Nov 06 13:41:36 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4, portal: 172.16.0.220,3260] successful.
Nov 06 13:41:36 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:41:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:41:36 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[48226df4-78c4-4b66-b981-1b7d53aff3d3]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:41:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:41:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:41:36 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5308d3d1-63e9-4b54-9d62-8da0937f07e8]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:41:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:41:36 user nova-compute[74821]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 (non-flash)
Nov 06 13:41:36 user nova-compute[74821]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c (non-flash)
Nov 06 13:41:36 user nova-compute[74821]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:41:36 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:41:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:41:36 user nova-compute[74821]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 (non-flash)
Nov 06 13:41:36 user nova-compute[74821]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c (non-flash)
Nov 06 13:41:36 user nova-compute[74821]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:41:36 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:41:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.439s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:41:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:41:36 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] HCTL ('36', '-', '-', 0) found on session 47 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:41:36 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:41:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:41:36 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0620e4eb-a091-48a9-bb4a-62f1fd6777a2]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:41:36 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Searching for a device in session 47 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:41:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvPQSnqr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:41:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:41:36 user nova-compute[74821]: DEBUG nova.network.neutron [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Successfully created port: ee2b1b16-4137-4414-89eb-b0e60c4dce97 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:41:37 user nova-compute[74821]: DEBUG nova.network.neutron [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Successfully updated port: ee2b1b16-4137-4414-89eb-b0e60c4dce97 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:41:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.482s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:41:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] <== connect_volume: return (1484ms) {'type': 'block', 'scsi_wwn': '23934393661383964', 'path': '/dev/sde'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:41:37 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934393661383964', 'path': '/dev/sde'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:41:37 user nova-compute[74821]: DEBUG nova.objects.instance [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lazy-loading 'flavor' on Instance uuid c3293c45-e843-4d6b-bc15-a10010a24ea6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:41:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "refresh_cache-eaa80098-14d8-4b64-b45c-242988ad18ec" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:41:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquired lock "refresh_cache-eaa80098-14d8-4b64-b45c-242988ad18ec" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:41:37 user nova-compute[74821]: DEBUG nova.network.neutron [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:41:37 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 13:41:37 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:41:37 user nova-compute[74821]:   <source dev="/dev/sde"/>
Nov 06 13:41:37 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:41:37 user nova-compute[74821]:   <serial>6e8f395f-5111-45d2-8cb4-6a2aced821d4</serial>
Nov 06 13:41:37 user nova-compute[74821]: </disk>
Nov 06 13:41:37 user nova-compute[74821]:  {{(pid=74821) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 13:41:37 user nova-compute[74821]: DEBUG nova.compute.manager [req-6e1d4826-9d09-4bb2-8d22-ac3027139ef4 req-00c78545-30c1-4692-a009-c8e948e65d93 service nova] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Received event network-changed-ee2b1b16-4137-4414-89eb-b0e60c4dce97 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:41:37 user nova-compute[74821]: DEBUG nova.compute.manager [req-6e1d4826-9d09-4bb2-8d22-ac3027139ef4 req-00c78545-30c1-4692-a009-c8e948e65d93 service nova] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Refreshing instance network info cache due to event network-changed-ee2b1b16-4137-4414-89eb-b0e60c4dce97. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:41:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6e1d4826-9d09-4bb2-8d22-ac3027139ef4 req-00c78545-30c1-4692-a009-c8e948e65d93 service nova] Acquiring lock "refresh_cache-eaa80098-14d8-4b64-b45c-242988ad18ec" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:41:37 user nova-compute[74821]: DEBUG nova.network.neutron [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:41:37 user nova-compute[74821]: DEBUG nova.network.neutron [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Updating instance_info_cache with network_info: [{"id": "ee2b1b16-4137-4414-89eb-b0e60c4dce97", "address": "fa:16:3e:5f:a0:d9", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee2b1b16-41", "ovs_interfaceid": "ee2b1b16-4137-4414-89eb-b0e60c4dce97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:41:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Releasing lock "refresh_cache-eaa80098-14d8-4b64-b45c-242988ad18ec" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:41:37 user nova-compute[74821]: DEBUG nova.compute.manager [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Instance network_info: |[{"id": "ee2b1b16-4137-4414-89eb-b0e60c4dce97", "address": "fa:16:3e:5f:a0:d9", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee2b1b16-41", "ovs_interfaceid": "ee2b1b16-4137-4414-89eb-b0e60c4dce97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:41:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6e1d4826-9d09-4bb2-8d22-ac3027139ef4 req-00c78545-30c1-4692-a009-c8e948e65d93 service nova] Acquired lock "refresh_cache-eaa80098-14d8-4b64-b45c-242988ad18ec" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:41:37 user nova-compute[74821]: DEBUG nova.network.neutron [req-6e1d4826-9d09-4bb2-8d22-ac3027139ef4 req-00c78545-30c1-4692-a009-c8e948e65d93 service nova] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Refreshing network info cache for port ee2b1b16-4137-4414-89eb-b0e60c4dce97 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:41:37 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:41:37 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:41:37 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] No VIF found with MAC fa:16:3e:87:40:ab, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:41:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a357af06-2954-4daa-91be-73f9572bf2af tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 34.800s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:41:37 user nova-compute[74821]: DEBUG nova.network.neutron [req-6e1d4826-9d09-4bb2-8d22-ac3027139ef4 req-00c78545-30c1-4692-a009-c8e948e65d93 service nova] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Updated VIF entry in instance network info cache for port ee2b1b16-4137-4414-89eb-b0e60c4dce97. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:41:37 user nova-compute[74821]: DEBUG nova.network.neutron [req-6e1d4826-9d09-4bb2-8d22-ac3027139ef4 req-00c78545-30c1-4692-a009-c8e948e65d93 service nova] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Updating instance_info_cache with network_info: [{"id": "ee2b1b16-4137-4414-89eb-b0e60c4dce97", "address": "fa:16:3e:5f:a0:d9", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee2b1b16-41", "ovs_interfaceid": "ee2b1b16-4137-4414-89eb-b0e60c4dce97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:41:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6e1d4826-9d09-4bb2-8d22-ac3027139ef4 req-00c78545-30c1-4692-a009-c8e948e65d93 service nova] Releasing lock "refresh_cache-eaa80098-14d8-4b64-b45c-242988ad18ec" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:41:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-717dd79b-2484-4f72-aa73-f88a20e1eaf1 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "c3293c45-e843-4d6b-bc15-a10010a24ea6" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:41:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-717dd79b-2484-4f72-aa73-f88a20e1eaf1 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:41:38 user nova-compute[74821]: DEBUG nova.compute.manager [None req-717dd79b-2484-4f72-aa73-f88a20e1eaf1 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:41:38 user nova-compute[74821]: DEBUG nova.compute.manager [None req-717dd79b-2484-4f72-aa73-f88a20e1eaf1 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74821) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 06 13:41:38 user nova-compute[74821]: DEBUG nova.objects.instance [None req-717dd79b-2484-4f72-aa73-f88a20e1eaf1 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lazy-loading 'flavor' on Instance uuid c3293c45-e843-4d6b-bc15-a10010a24ea6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:41:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:41:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:41:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:41:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:41:39 user nova-compute[74821]: DEBUG nova.compute.manager [req-b87d2f9f-660c-4f41-b881-fa2b24bc3b90 req-47632861-71ff-4daa-a4b4-293febd9c8e5 service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Received event network-vif-unplugged-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:41:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b87d2f9f-660c-4f41-b881-fa2b24bc3b90 req-47632861-71ff-4daa-a4b4-293febd9c8e5 service nova] Acquiring lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:41:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b87d2f9f-660c-4f41-b881-fa2b24bc3b90 req-47632861-71ff-4daa-a4b4-293febd9c8e5 service nova] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:41:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b87d2f9f-660c-4f41-b881-fa2b24bc3b90 req-47632861-71ff-4daa-a4b4-293febd9c8e5 service nova] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:41:39 user nova-compute[74821]: DEBUG nova.compute.manager [req-b87d2f9f-660c-4f41-b881-fa2b24bc3b90 req-47632861-71ff-4daa-a4b4-293febd9c8e5 service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] No waiting events found dispatching network-vif-unplugged-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:41:39 user nova-compute[74821]: WARNING nova.compute.manager [req-b87d2f9f-660c-4f41-b881-fa2b24bc3b90 req-47632861-71ff-4daa-a4b4-293febd9c8e5 service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Received unexpected event network-vif-unplugged-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec for instance with vm_state active and task_state powering-off.
Nov 06 13:41:39 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Instance destroyed successfully.
Nov 06 13:41:39 user nova-compute[74821]: DEBUG nova.compute.manager [None req-717dd79b-2484-4f72-aa73-f88a20e1eaf1 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:41:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-717dd79b-2484-4f72-aa73-f88a20e1eaf1 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.831s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:41:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:41:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:41:41 user nova-compute[74821]: DEBUG nova.compute.manager [req-8f0463aa-e6a1-4933-9dde-72c94ca58478 req-e68e46fc-af52-4264-b19c-bcbda8cc6cff service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Received event network-vif-plugged-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:41:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8f0463aa-e6a1-4933-9dde-72c94ca58478 req-e68e46fc-af52-4264-b19c-bcbda8cc6cff service nova] Acquiring lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:41:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8f0463aa-e6a1-4933-9dde-72c94ca58478 req-e68e46fc-af52-4264-b19c-bcbda8cc6cff service nova] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:41:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8f0463aa-e6a1-4933-9dde-72c94ca58478 req-e68e46fc-af52-4264-b19c-bcbda8cc6cff service nova] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:41:41 user nova-compute[74821]: DEBUG nova.compute.manager [req-8f0463aa-e6a1-4933-9dde-72c94ca58478 req-e68e46fc-af52-4264-b19c-bcbda8cc6cff service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] No waiting events found dispatching network-vif-plugged-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:41:41 user nova-compute[74821]: WARNING nova.compute.manager [req-8f0463aa-e6a1-4933-9dde-72c94ca58478 req-e68e46fc-af52-4264-b19c-bcbda8cc6cff service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Received unexpected event network-vif-plugged-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec for instance with vm_state stopped and task_state None.
Nov 06 13:41:41 user nova-compute[74821]: DEBUG os_brick.utils [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:41:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:41:41 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8321498-cefc-484b-a623-b37e7ef057b2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:41:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:41:41 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35e172b-ad99-4808-9b2d-c9ef1f6399dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:41:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:41:41 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbee89b-82ab-4329-aff1-76fd3edd6775]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:41:41 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[886d481c-fda4-48b9-a3f4-21268a0e9e9b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:41:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:41:41 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:41:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:41:41 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:41:41 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12b03fc-dc80-4b7d-b782-f945b73a525b]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:41:41 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:41:41 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:41:41 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:41:41 user nova-compute[74821]: DEBUG os_brick.utils [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:41:41 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Updating existing volume attachment record: baa7a9d1-b2d7-4f91-951c-1dbb0945c5cc {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:41:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:41:47 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:41:47 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:41:47 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Rebuilding the list of instances to heal {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 13:41:47 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Skipping network cache update for instance because it is Building. {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-db04d895-338b-46fb-af08-779ad5d1181d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-db04d895-338b-46fb-af08-779ad5d1181d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG nova.objects.instance [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lazy-loading 'info_cache' on Instance uuid db04d895-338b-46fb-af08-779ad5d1181d {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Updating instance_info_cache with network_info: [{"id": "0997f4aa-17bc-4f72-b43a-63eb00bd4a71", "address": "fa:16:3e:46:dc:53", "network": {"id": "9dfb5db2-5cef-4f79-a41d-af4ae6967c09", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1976265278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a79b69221f742dc9f128dd708d1b9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0997f4aa-17", "ovs_interfaceid": "0997f4aa-17bc-4f72-b43a-63eb00bd4a71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-db04d895-338b-46fb-af08-779ad5d1181d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:41:48 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance db04d895-338b-46fb-af08-779ad5d1181d is timed out.
Nov 06 13:41:48 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Successfully detached device vdb from instance db04d895-338b-46fb-af08-779ad5d1181d from the live domain config.
Nov 06 13:41:48 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JgvIcCYb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:41:48 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:41:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d53b7d-1adc-461d-9eca-e3f8b7644163]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:41:48 user nova-compute[74821]: No targets found.
Nov 06 13:41:48 user nova-compute[74821]: iSNS:
Nov 06 13:41:48 user nova-compute[74821]: No targets found.
Nov 06 13:41:48 user nova-compute[74821]: STATIC:
Nov 06 13:41:48 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4
Nov 06 13:41:48 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:41:48 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:41:48 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c
Nov 06 13:41:48 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:41:48 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:41:48 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301
Nov 06 13:41:48 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:41:48 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:41:48 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07
Nov 06 13:41:48 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:41:48 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:41:48 user nova-compute[74821]: FIRMWARE:
Nov 06 13:41:48 user nova-compute[74821]: No targets found.
Nov 06 13:41:48 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:41:48 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:41:48 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b550d675-d781-4e22-9051-5a37783c62a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d92ce37-7a7c-4a1b-aacd-122662612c0a]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:41:48 user nova-compute[74821]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 (non-flash)
Nov 06 13:41:48 user nova-compute[74821]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c (non-flash)
Nov 06 13:41:48 user nova-compute[74821]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:41:48 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:41:48 user nova-compute[74821]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 (non-flash)
Nov 06 13:41:48 user nova-compute[74821]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c (non-flash)
Nov 06 13:41:48 user nova-compute[74821]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:41:48 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e5039f400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301'): ({'sdc'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Removing single pathed devices sdc {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d10be04-7f90-4d24-8e55-2e4c1263cf36]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[218ee377-ba15-4462-bae4-bb7a67d5cab8]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Flushing IO for device /dev/sdc {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ee10d6-ed55-49f1-b727-208909227d74]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9b97d5-b5f0-4992-850a-e69de123d31f]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] SCSI volumes sdc have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0cdf17-94e3-489e-a5dd-6455373c70be]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd40548-8a30-4379-9fee-df97e9542fb4]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301, portal: 172.16.0.220,3260]
Nov 06 13:41:48 user nova-compute[74821]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301, portal: 172.16.0.220,3260] successful.
Nov 06 13:41:48 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf552cc9-135c-443d-9f3a-1c0927af2301 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e67f9a-3860-4697-86aa-240d262fd7ff]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] <== disconnect_volume: return (325ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:41:48 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:41:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:41:49 user nova-compute[74821]: DEBUG nova.objects.instance [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lazy-loading 'flavor' on Instance uuid db04d895-338b-46fb-af08-779ad5d1181d {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:41:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-4fd62f90-1299-426a-8c4f-b77d062fe388 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "db04d895-338b-46fb-af08-779ad5d1181d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.776s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:41:49 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:41:50 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:41:50 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:41:50 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:41:53 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:41:53 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:41:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:41:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:41:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:41:53 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:41:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:41:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:41:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e1e7d-3abf-4c2f-b792-16b0ef970d88/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e1e7d-3abf-4c2f-b792-16b0ef970d88/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:41:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e1e7d-3abf-4c2f-b792-16b0ef970d88/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:41:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e1e7d-3abf-4c2f-b792-16b0ef970d88/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:41:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:41:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:41:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:41:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:41:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:41:55 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:41:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/727cdc17-f58c-4cfc-a00c-d4651dc1e9eb/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/727cdc17-f58c-4cfc-a00c-d4651dc1e9eb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:41:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/727cdc17-f58c-4cfc-a00c-d4651dc1e9eb/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:41:55 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/727cdc17-f58c-4cfc-a00c-d4651dc1e9eb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:41:55 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:41:55 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:41:55 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=8473MB free_disk=25.030990600585938GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:41:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:41:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:41:56 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance db04d895-338b-46fb-af08-779ad5d1181d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:41:56 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 929e1e7d-3abf-4c2f-b792-16b0ef970d88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:41:56 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance c3293c45-e843-4d6b-bc15-a10010a24ea6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:41:56 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 754e8314-2f91-4aa4-83d0-2ce9b94db4cc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:41:56 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:41:56 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance eaa80098-14d8-4b64-b45c-242988ad18ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:41:56 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:41:56 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:41:56 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:41:56 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:41:56 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:41:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.331s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:41:56 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:41:56 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Cleaning up deleted instances {{(pid=74821) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 13:41:56 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] There are 0 instances to clean {{(pid=74821) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 13:41:57 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:41:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG nova.compute.manager [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:42:03 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Creating image(s)
Nov 06 13:42:03 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Did not create local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Ensure instance console log exists: /opt/stack/data/nova/instances/eaa80098-14d8-4b64-b45c-242988ad18ec/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Start _get_guest_xml network_info=[{"id": "ee2b1b16-4137-4414-89eb-b0e60c4dce97", "address": "fa:16:3e:5f:a0:d9", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee2b1b16-41", "ovs_interfaceid": "ee2b1b16-4137-4414-89eb-b0e60c4dce97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-06T13:41:23Z,direct_url=<?>,disk_format='qcow2',id=c61f09b9-7d7d-46b5-b44c-312fe9467cd1,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1793848510',owner='2c8e811a3a30417a8dc6ccad03f2f8e0',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-06T13:41:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TLWrRdSn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'eaa80098-14d8-4b64-b45c-242988ad18ec', 'attached_at': '', 'detached_at': '', 'volume_id': '39e3466b-419e-4dd3-84e6-a44ea934cf13', 'serial': '39e3466b-419e-4dd3-84e6-a44ea934cf13'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': True, 'attachment_id': 'baa7a9d1-b2d7-4f91-951c-1dbb0945c5cc', 'volume_type': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:42:03 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:42:03 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:42:03 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-06T13:41:23Z,direct_url=<?>,disk_format='qcow2',id=c61f09b9-7d7d-46b5-b44c-312fe9467cd1,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1793848510',owner='2c8e811a3a30417a8dc6ccad03f2f8e0',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-06T13:41:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TLWrRdSn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:42:03 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:42:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:42:03 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:42:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:42:03 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:42:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[463d6ce2-3d0e-46bf-b014-f3223740c3e2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:42:03 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[52583e8d-f71d-47dc-b096-8bc3be7e76cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13] added
Nov 06 13:42:03 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[487d2b9a-f894-477d-bbba-f6d55b98fecb]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd899aca-5a4c-4ec4-a60b-bb46f585a074]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TLWrRdSn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TLWrRdSn" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8ecbd0-61ab-4bf4-814f-6de5f69516b9]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TLWrRdSn'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd48294-90d5-4eef-b623-ea8e66bac7a5]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[48177980-be12-46f7-be39-964a8162796f]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:42:03 user nova-compute[74821]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c (non-flash)
Nov 06 13:42:03 user nova-compute[74821]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:42:03 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:42:03 user nova-compute[74821]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c (non-flash)
Nov 06 13:42:03 user nova-compute[74821]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:42:03 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb1451c-6ffe-47cd-9ad9-691af7947e0f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13, portal: 172.16.0.220,3260]
Nov 06 13:42:03 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13, portal: 172.16.0.220,3260] successful.
Nov 06 13:42:03 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[85feef74-3dc6-43cb-8012-41c99fe89222]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b615d3b-0b32-4a25-8cf9-b5090d870a3d]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:42:03 user nova-compute[74821]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c (non-flash)
Nov 06 13:42:03 user nova-compute[74821]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:42:03 user nova-compute[74821]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 (non-flash)
Nov 06 13:42:03 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:42:03 user nova-compute[74821]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c (non-flash)
Nov 06 13:42:03 user nova-compute[74821]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:42:03 user nova-compute[74821]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 (non-flash)
Nov 06 13:42:03 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a887df30-8ab5-43a3-9813-e3f16d9eafc2]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:42:03 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TLWrRdSn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:42:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:42:04 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23566633834333638', 'path': '/dev/sdc'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:42:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566633834333638', 'path': '/dev/sdc'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:42:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:41:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-543545268',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-543545268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-543545268',id=48,image_ref='c61f09b9-7d7d-46b5-b44c-312fe9467cd1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlzXQ1hqyJ4swpgKdfYHqekj6t29llZ5gv7HcgRYOnAoyYyg5Yya3irNAkvxnJh/hYZA1rJxNpBTiX7gxwiscwlrbH4F6IUfRuJy89tZlaAt01OXs3yx+361HJjCchIFA==',key_name='tempest-keypair-1867060567',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c8e811a3a30417a8dc6ccad03f2f8e0',ramdisk_id='',reservation_id='r-nlffa02q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1930796442',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1930796442-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1930796442',owner_user_name='tempest-TestVolumeBootPattern-1930796442-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:41:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bb6a168d90a4795a72b8ac69eeadcc9',uuid=eaa80098-14d8-4b64-b45c-242988ad18ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee2b1b16-4137-4414-89eb-b0e60c4dce97", "address": "fa:16:3e:5f:a0:d9", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee2b1b16-41", "ovs_interfaceid": "ee2b1b16-4137-4414-89eb-b0e60c4dce97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:42:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Converting VIF {"id": "ee2b1b16-4137-4414-89eb-b0e60c4dce97", "address": "fa:16:3e:5f:a0:d9", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee2b1b16-41", "ovs_interfaceid": "ee2b1b16-4137-4414-89eb-b0e60c4dce97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:42:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:a0:d9,bridge_name='br-int',has_traffic_filtering=True,id=ee2b1b16-4137-4414-89eb-b0e60c4dce97,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee2b1b16-41') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:42:04 user nova-compute[74821]: DEBUG nova.objects.instance [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lazy-loading 'pci_devices' on Instance uuid eaa80098-14d8-4b64-b45c-242988ad18ec {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:42:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:42:04 user nova-compute[74821]:   <uuid>eaa80098-14d8-4b64-b45c-242988ad18ec</uuid>
Nov 06 13:42:04 user nova-compute[74821]:   <name>instance-00000030</name>
Nov 06 13:42:04 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:42:04 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:42:04 user nova-compute[74821]:   <metadata>
Nov 06 13:42:04 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:42:04 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:42:04 user nova-compute[74821]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-543545268</nova:name>
Nov 06 13:42:04 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:42:03</nova:creationTime>
Nov 06 13:42:04 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:42:04 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:42:04 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:42:04 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:42:04 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:42:04 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:42:04 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:42:04 user nova-compute[74821]:       <nova:owner>
Nov 06 13:42:04 user nova-compute[74821]:         <nova:user uuid="3bb6a168d90a4795a72b8ac69eeadcc9">tempest-TestVolumeBootPattern-1930796442-project-member</nova:user>
Nov 06 13:42:04 user nova-compute[74821]:         <nova:project uuid="2c8e811a3a30417a8dc6ccad03f2f8e0">tempest-TestVolumeBootPattern-1930796442</nova:project>
Nov 06 13:42:04 user nova-compute[74821]:       </nova:owner>
Nov 06 13:42:04 user nova-compute[74821]:       <nova:root type="image" uuid="c61f09b9-7d7d-46b5-b44c-312fe9467cd1"/>
Nov 06 13:42:04 user nova-compute[74821]:       <nova:ports>
Nov 06 13:42:04 user nova-compute[74821]:         <nova:port uuid="ee2b1b16-4137-4414-89eb-b0e60c4dce97">
Nov 06 13:42:04 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 13:42:04 user nova-compute[74821]:         </nova:port>
Nov 06 13:42:04 user nova-compute[74821]:       </nova:ports>
Nov 06 13:42:04 user nova-compute[74821]:     </nova:instance>
Nov 06 13:42:04 user nova-compute[74821]:   </metadata>
Nov 06 13:42:04 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:42:04 user nova-compute[74821]:     <system>
Nov 06 13:42:04 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:42:04 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:42:04 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:42:04 user nova-compute[74821]:       <entry name="serial">eaa80098-14d8-4b64-b45c-242988ad18ec</entry>
Nov 06 13:42:04 user nova-compute[74821]:       <entry name="uuid">eaa80098-14d8-4b64-b45c-242988ad18ec</entry>
Nov 06 13:42:04 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:42:04 user nova-compute[74821]:     </system>
Nov 06 13:42:04 user nova-compute[74821]:   </sysinfo>
Nov 06 13:42:04 user nova-compute[74821]:   <os>
Nov 06 13:42:04 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:42:04 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:42:04 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:42:04 user nova-compute[74821]:   </os>
Nov 06 13:42:04 user nova-compute[74821]:   <features>
Nov 06 13:42:04 user nova-compute[74821]:     <acpi/>
Nov 06 13:42:04 user nova-compute[74821]:     <apic/>
Nov 06 13:42:04 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:42:04 user nova-compute[74821]:   </features>
Nov 06 13:42:04 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:42:04 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:42:04 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:42:04 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:42:04 user nova-compute[74821]:   </clock>
Nov 06 13:42:04 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:42:04 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:42:04 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:42:04 user nova-compute[74821]:   </cpu>
Nov 06 13:42:04 user nova-compute[74821]:   <devices>
Nov 06 13:42:04 user nova-compute[74821]:     <disk type="block" device="disk">
Nov 06 13:42:04 user nova-compute[74821]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:42:04 user nova-compute[74821]:       <source dev="/dev/sdc"/>
Nov 06 13:42:04 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:42:04 user nova-compute[74821]:       <serial>39e3466b-419e-4dd3-84e6-a44ea934cf13</serial>
Nov 06 13:42:04 user nova-compute[74821]:     </disk>
Nov 06 13:42:04 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:42:04 user nova-compute[74821]:       <mac address="fa:16:3e:5f:a0:d9"/>
Nov 06 13:42:04 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:42:04 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:42:04 user nova-compute[74821]:       <target dev="tapee2b1b16-41"/>
Nov 06 13:42:04 user nova-compute[74821]:     </interface>
Nov 06 13:42:04 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:42:04 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/eaa80098-14d8-4b64-b45c-242988ad18ec/console.log" append="off"/>
Nov 06 13:42:04 user nova-compute[74821]:     </serial>
Nov 06 13:42:04 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:42:04 user nova-compute[74821]:     <video>
Nov 06 13:42:04 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:42:04 user nova-compute[74821]:     </video>
Nov 06 13:42:04 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:42:04 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:42:04 user nova-compute[74821]:     </rng>
Nov 06 13:42:04 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:42:04 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:42:04 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:42:04 user nova-compute[74821]:     </memballoon>
Nov 06 13:42:04 user nova-compute[74821]:   </devices>
Nov 06 13:42:04 user nova-compute[74821]: </domain>
Nov 06 13:42:04 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:42:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:41:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-543545268',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-543545268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-543545268',id=48,image_ref='c61f09b9-7d7d-46b5-b44c-312fe9467cd1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlzXQ1hqyJ4swpgKdfYHqekj6t29llZ5gv7HcgRYOnAoyYyg5Yya3irNAkvxnJh/hYZA1rJxNpBTiX7gxwiscwlrbH4F6IUfRuJy89tZlaAt01OXs3yx+361HJjCchIFA==',key_name='tempest-keypair-1867060567',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c8e811a3a30417a8dc6ccad03f2f8e0',ramdisk_id='',reservation_id='r-nlffa02q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1930796442',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1930796442-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1930796442',owner_user_name='tempest-TestVolumeBootPattern-1930796442-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:41:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bb6a168d90a4795a72b8ac69eeadcc9',uuid=eaa80098-14d8-4b64-b45c-242988ad18ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee2b1b16-4137-4414-89eb-b0e60c4dce97", "address": "fa:16:3e:5f:a0:d9", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee2b1b16-41", "ovs_interfaceid": "ee2b1b16-4137-4414-89eb-b0e60c4dce97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:42:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Converting VIF {"id": "ee2b1b16-4137-4414-89eb-b0e60c4dce97", "address": "fa:16:3e:5f:a0:d9", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee2b1b16-41", "ovs_interfaceid": "ee2b1b16-4137-4414-89eb-b0e60c4dce97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:42:04 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:a0:d9,bridge_name='br-int',has_traffic_filtering=True,id=ee2b1b16-4137-4414-89eb-b0e60c4dce97,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee2b1b16-41') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:42:04 user nova-compute[74821]: DEBUG os_vif [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:a0:d9,bridge_name='br-int',has_traffic_filtering=True,id=ee2b1b16-4137-4414-89eb-b0e60c4dce97,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee2b1b16-41') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:42:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:42:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:42:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:42:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:42:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8fa90707-bf88-5c08-baa4-7d52bff59da1', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:42:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:42:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:42:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:42:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:42:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee2b1b16-41, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:42:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapee2b1b16-41, col_values=(('qos', UUID('ff73c851-dea1-42ed-93eb-a74e0005eb2b')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:42:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapee2b1b16-41, col_values=(('external_ids', {'iface-id': 'ee2b1b16-4137-4414-89eb-b0e60c4dce97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:a0:d9', 'vm-uuid': 'eaa80098-14d8-4b64-b45c-242988ad18ec'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:42:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:42:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:42:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:42:04 user nova-compute[74821]: INFO os_vif [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:a0:d9,bridge_name='br-int',has_traffic_filtering=True,id=ee2b1b16-4137-4414-89eb-b0e60c4dce97,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee2b1b16-41')
Nov 06 13:42:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:42:04 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] No VIF found with MAC fa:16:3e:5f:a0:d9, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:42:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:42:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:42:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:42:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:42:05 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:42:05 user nova-compute[74821]: DEBUG nova.compute.manager [req-055e52c2-3b0e-4b7d-9fe6-9d650dc9173a req-66447cc3-b693-403e-b09a-7da17b77ae3d service nova] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Received event network-vif-plugged-ee2b1b16-4137-4414-89eb-b0e60c4dce97 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:42:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-055e52c2-3b0e-4b7d-9fe6-9d650dc9173a req-66447cc3-b693-403e-b09a-7da17b77ae3d service nova] Acquiring lock "eaa80098-14d8-4b64-b45c-242988ad18ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:42:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-055e52c2-3b0e-4b7d-9fe6-9d650dc9173a req-66447cc3-b693-403e-b09a-7da17b77ae3d service nova] Lock "eaa80098-14d8-4b64-b45c-242988ad18ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:42:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-055e52c2-3b0e-4b7d-9fe6-9d650dc9173a req-66447cc3-b693-403e-b09a-7da17b77ae3d service nova] Lock "eaa80098-14d8-4b64-b45c-242988ad18ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:42:05 user nova-compute[74821]: DEBUG nova.compute.manager [req-055e52c2-3b0e-4b7d-9fe6-9d650dc9173a req-66447cc3-b693-403e-b09a-7da17b77ae3d service nova] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] No waiting events found dispatching network-vif-plugged-ee2b1b16-4137-4414-89eb-b0e60c4dce97 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:42:05 user nova-compute[74821]: WARNING nova.compute.manager [req-055e52c2-3b0e-4b7d-9fe6-9d650dc9173a req-66447cc3-b693-403e-b09a-7da17b77ae3d service nova] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Received unexpected event network-vif-plugged-ee2b1b16-4137-4414-89eb-b0e60c4dce97 for instance with vm_state building and task_state spawning.
Nov 06 13:42:06 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:42:06 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:42:06 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:42:06 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Cleaning up deleted instances with incomplete migration  {{(pid=74821) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 13:42:07 user nova-compute[74821]: DEBUG nova.compute.manager [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:42:07 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:42:07 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Instance spawned successfully.
Nov 06 13:42:07 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:42:07 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:42:07 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:42:08 user nova-compute[74821]: INFO nova.compute.manager [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Took 4.99 seconds to spawn the instance on the hypervisor.
Nov 06 13:42:08 user nova-compute[74821]: DEBUG nova.compute.manager [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:42:08 user nova-compute[74821]: DEBUG nova.compute.manager [req-c230357e-9b73-4eae-aeb4-cdf98a06ec15 req-6574d3ef-bfa4-4de9-a785-db7fae6f07b3 service nova] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Received event network-vif-plugged-ee2b1b16-4137-4414-89eb-b0e60c4dce97 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:42:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c230357e-9b73-4eae-aeb4-cdf98a06ec15 req-6574d3ef-bfa4-4de9-a785-db7fae6f07b3 service nova] Acquiring lock "eaa80098-14d8-4b64-b45c-242988ad18ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:42:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c230357e-9b73-4eae-aeb4-cdf98a06ec15 req-6574d3ef-bfa4-4de9-a785-db7fae6f07b3 service nova] Lock "eaa80098-14d8-4b64-b45c-242988ad18ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:42:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c230357e-9b73-4eae-aeb4-cdf98a06ec15 req-6574d3ef-bfa4-4de9-a785-db7fae6f07b3 service nova] Lock "eaa80098-14d8-4b64-b45c-242988ad18ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:42:08 user nova-compute[74821]: DEBUG nova.compute.manager [req-c230357e-9b73-4eae-aeb4-cdf98a06ec15 req-6574d3ef-bfa4-4de9-a785-db7fae6f07b3 service nova] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] No waiting events found dispatching network-vif-plugged-ee2b1b16-4137-4414-89eb-b0e60c4dce97 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:42:08 user nova-compute[74821]: WARNING nova.compute.manager [req-c230357e-9b73-4eae-aeb4-cdf98a06ec15 req-6574d3ef-bfa4-4de9-a785-db7fae6f07b3 service nova] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Received unexpected event network-vif-plugged-ee2b1b16-4137-4414-89eb-b0e60c4dce97 for instance with vm_state building and task_state spawning.
Nov 06 13:42:08 user nova-compute[74821]: INFO nova.compute.manager [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Took 33.01 seconds to build instance.
Nov 06 13:42:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9238d2e4-dee6-4080-9ba9-3b09e0ee9667 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "eaa80098-14d8-4b64-b45c-242988ad18ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.106s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:42:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:42:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:42:14 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:42:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:42:21 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:42:23 user nova-compute[74821]: DEBUG nova.compute.manager [req-017677c6-d782-4ac0-889f-df7a5fffa2cc req-5558ac70-4d9b-4ecb-949b-e9786ab328e9 service nova] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Received event network-changed-57183466-2952-4bd9-b1a5-35e9bb976887 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:42:23 user nova-compute[74821]: DEBUG nova.compute.manager [req-017677c6-d782-4ac0-889f-df7a5fffa2cc req-5558ac70-4d9b-4ecb-949b-e9786ab328e9 service nova] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Refreshing instance network info cache due to event network-changed-57183466-2952-4bd9-b1a5-35e9bb976887. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:42:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-017677c6-d782-4ac0-889f-df7a5fffa2cc req-5558ac70-4d9b-4ecb-949b-e9786ab328e9 service nova] Acquiring lock "refresh_cache-727cdc17-f58c-4cfc-a00c-d4651dc1e9eb" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:42:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-017677c6-d782-4ac0-889f-df7a5fffa2cc req-5558ac70-4d9b-4ecb-949b-e9786ab328e9 service nova] Acquired lock "refresh_cache-727cdc17-f58c-4cfc-a00c-d4651dc1e9eb" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:42:23 user nova-compute[74821]: DEBUG nova.network.neutron [req-017677c6-d782-4ac0-889f-df7a5fffa2cc req-5558ac70-4d9b-4ecb-949b-e9786ab328e9 service nova] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Refreshing network info cache for port 57183466-2952-4bd9-b1a5-35e9bb976887 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:42:23 user nova-compute[74821]: DEBUG nova.network.neutron [req-017677c6-d782-4ac0-889f-df7a5fffa2cc req-5558ac70-4d9b-4ecb-949b-e9786ab328e9 service nova] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Updated VIF entry in instance network info cache for port 57183466-2952-4bd9-b1a5-35e9bb976887. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:42:23 user nova-compute[74821]: DEBUG nova.network.neutron [req-017677c6-d782-4ac0-889f-df7a5fffa2cc req-5558ac70-4d9b-4ecb-949b-e9786ab328e9 service nova] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Updating instance_info_cache with network_info: [{"id": "57183466-2952-4bd9-b1a5-35e9bb976887", "address": "fa:16:3e:27:3a:ad", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57183466-29", "ovs_interfaceid": "57183466-2952-4bd9-b1a5-35e9bb976887", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:42:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-017677c6-d782-4ac0-889f-df7a5fffa2cc req-5558ac70-4d9b-4ecb-949b-e9786ab328e9 service nova] Releasing lock "refresh_cache-727cdc17-f58c-4cfc-a00c-d4651dc1e9eb" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:42:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Acquiring lock "db04d895-338b-46fb-af08-779ad5d1181d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:42:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "db04d895-338b-46fb-af08-779ad5d1181d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:42:24 user nova-compute[74821]: DEBUG nova.objects.instance [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lazy-loading 'flavor' on Instance uuid db04d895-338b-46fb-af08-779ad5d1181d {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:42:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "db04d895-338b-46fb-af08-779ad5d1181d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:42:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Acquiring lock "db04d895-338b-46fb-af08-779ad5d1181d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:42:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "db04d895-338b-46fb-af08-779ad5d1181d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:42:24 user nova-compute[74821]: INFO nova.compute.manager [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Attaching volume 796af53b-b07b-4ab9-8a88-768ceaf369d4 to /dev/vdb
Nov 06 13:42:24 user nova-compute[74821]: DEBUG os_brick.utils [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:42:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:42:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:24 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ed5a44-92e0-4710-8bb7-f4e17cc194a0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:24 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a52e24a-2533-416a-8941-3a20fa3be0e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:24 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f95022-5519-4b7a-8122-889781c62111]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:24 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a1c7ba-489e-491a-bf09-23b4c172fb28]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:42:24 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:42:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:24 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:42:24 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:42:24 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16332ee-7f7e-4962-b3b0-695e46d3f41f]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:24 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:42:24 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:42:24 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:42:24 user nova-compute[74821]: DEBUG os_brick.utils [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:42:24 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Updating existing volume attachment record: 4f1026e7-58cb-469a-9a76-7fab5b55a4dd {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:42:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:42:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "727cdc17-f58c-4cfc-a00c-d4651dc1e9eb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:42:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "727cdc17-f58c-4cfc-a00c-d4651dc1e9eb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:42:29 user nova-compute[74821]: DEBUG nova.objects.instance [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lazy-loading 'flavor' on Instance uuid 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:42:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "727cdc17-f58c-4cfc-a00c-d4651dc1e9eb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:42:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "727cdc17-f58c-4cfc-a00c-d4651dc1e9eb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:42:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "727cdc17-f58c-4cfc-a00c-d4651dc1e9eb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:42:29 user nova-compute[74821]: INFO nova.compute.manager [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Attaching volume 5aa22918-b35c-4e4e-bc74-a58673722d5c to /dev/vdb
Nov 06 13:42:29 user nova-compute[74821]: DEBUG os_brick.utils [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:42:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:29 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e3ba08-39c1-4613-97fe-ed0c0df395dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:29 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5770c08f-ec27-4c52-9647-f9d623124888]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:29 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0e9c30-18c3-4c4a-9216-e59a4ad1a9e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:29 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66bc704-5cfd-46b6-8920-0612d52966e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:42:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:42:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:42:29 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:42:29 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4644fc5a-6fc0-4260-aef7-093f043686de]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:42:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:42:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:42:29 user nova-compute[74821]: DEBUG os_brick.utils [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:42:29 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Updating existing volume attachment record: 6197f2bd-17a7-4e8d-984c-a78a4092f226 {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:42:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:42:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:42:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:42:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:42:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:42:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:42:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LdweZVTa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:42:47 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:42:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:42:47 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:42:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:42:47 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:42:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ea923d-8a34-4c76-ba25-ada6c1c2a0c8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:42:47 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae9b82c-c856-45dd-b4fb-883cdc54c1c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4] added
Nov 06 13:42:47 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[798cf208-3db9-4cf3-b765-660ca0de8c2b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfc6e69-4721-4ca2-a01a-26b9aa0bdbc9]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LdweZVTa {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LdweZVTa" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fd476c-47f8-4d7c-8d7e-f7a21461568e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LdweZVTa'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fddad76-9294-4c46-9655-62eadf544ae1]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c1e2fc-cd43-4bb5-bc69-d0d855b0be15]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:42:47 user nova-compute[74821]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c (non-flash)
Nov 06 13:42:47 user nova-compute[74821]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:42:47 user nova-compute[74821]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 (non-flash)
Nov 06 13:42:47 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:42:47 user nova-compute[74821]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c (non-flash)
Nov 06 13:42:47 user nova-compute[74821]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:42:47 user nova-compute[74821]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 (non-flash)
Nov 06 13:42:47 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9743848-6ef3-4454-bd29-981b1dfbe2e3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4, portal: 172.16.0.220,3260]
Nov 06 13:42:47 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4, portal: 172.16.0.220,3260] successful.
Nov 06 13:42:47 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9583787-47ac-4ee0-be05-05a41e39cf18]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c1fffe-360d-48a4-9898-20fc03794a81]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:42:47 user nova-compute[74821]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c (non-flash)
Nov 06 13:42:47 user nova-compute[74821]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:42:47 user nova-compute[74821]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 (non-flash)
Nov 06 13:42:47 user nova-compute[74821]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 (non-flash)
Nov 06 13:42:47 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:42:47 user nova-compute[74821]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c (non-flash)
Nov 06 13:42:47 user nova-compute[74821]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:42:47 user nova-compute[74821]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 (non-flash)
Nov 06 13:42:47 user nova-compute[74821]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 (non-flash)
Nov 06 13:42:47 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] HCTL ('37', '-', '-', 0) found on session 49 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[351b9152-e009-41ef-a953-e0b97b8cf1bb]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:47 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Searching for a device in session 49 and hctl ['37', '*', '*', 0] yield: None {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:42:48 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:42:48 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Searching for a device in session 49 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:42:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LdweZVTa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:42:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:42:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '26137373834653830', 'path': '/dev/sdf'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:42:48 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137373834653830', 'path': '/dev/sdf'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:42:48 user nova-compute[74821]: DEBUG nova.objects.instance [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lazy-loading 'flavor' on Instance uuid db04d895-338b-46fb-af08-779ad5d1181d {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:42:48 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 13:42:48 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:42:48 user nova-compute[74821]:   <source dev="/dev/sdf"/>
Nov 06 13:42:48 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:42:48 user nova-compute[74821]:   <serial>796af53b-b07b-4ab9-8a88-768ceaf369d4</serial>
Nov 06 13:42:48 user nova-compute[74821]: </disk>
Nov 06 13:42:48 user nova-compute[74821]:  {{(pid=74821) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 13:42:48 user nova-compute[74821]: DEBUG nova.compute.manager [req-5542625f-df94-491e-9576-9c37bcf0d22b req-7f9cdd7a-c677-437c-a26b-306f7f9a34ad service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Received event network-changed-f0259675-f417-4927-993f-769bab8f0086 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:42:48 user nova-compute[74821]: DEBUG nova.compute.manager [req-5542625f-df94-491e-9576-9c37bcf0d22b req-7f9cdd7a-c677-437c-a26b-306f7f9a34ad service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Refreshing instance network info cache due to event network-changed-f0259675-f417-4927-993f-769bab8f0086. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:42:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5542625f-df94-491e-9576-9c37bcf0d22b req-7f9cdd7a-c677-437c-a26b-306f7f9a34ad service nova] Acquiring lock "refresh_cache-929e1e7d-3abf-4c2f-b792-16b0ef970d88" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:42:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5542625f-df94-491e-9576-9c37bcf0d22b req-7f9cdd7a-c677-437c-a26b-306f7f9a34ad service nova] Acquired lock "refresh_cache-929e1e7d-3abf-4c2f-b792-16b0ef970d88" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:42:48 user nova-compute[74821]: DEBUG nova.network.neutron [req-5542625f-df94-491e-9576-9c37bcf0d22b req-7f9cdd7a-c677-437c-a26b-306f7f9a34ad service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Refreshing network info cache for port f0259675-f417-4927-993f-769bab8f0086 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:42:48 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:42:48 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:42:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-929e1e7d-3abf-4c2f-b792-16b0ef970d88" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:42:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:42:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:42:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] No VIF found with MAC fa:16:3e:46:dc:53, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:42:49 user nova-compute[74821]: DEBUG nova.network.neutron [req-5542625f-df94-491e-9576-9c37bcf0d22b req-7f9cdd7a-c677-437c-a26b-306f7f9a34ad service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Updated VIF entry in instance network info cache for port f0259675-f417-4927-993f-769bab8f0086. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:42:49 user nova-compute[74821]: DEBUG nova.network.neutron [req-5542625f-df94-491e-9576-9c37bcf0d22b req-7f9cdd7a-c677-437c-a26b-306f7f9a34ad service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Updating instance_info_cache with network_info: [{"id": "f0259675-f417-4927-993f-769bab8f0086", "address": "fa:16:3e:de:27:55", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0259675-f4", "ovs_interfaceid": "f0259675-f417-4927-993f-769bab8f0086", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:42:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5542625f-df94-491e-9576-9c37bcf0d22b req-7f9cdd7a-c677-437c-a26b-306f7f9a34ad service nova] Releasing lock "refresh_cache-929e1e7d-3abf-4c2f-b792-16b0ef970d88" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:42:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-929e1e7d-3abf-4c2f-b792-16b0ef970d88" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:42:49 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:42:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-67c4ba45-718f-452d-b973-bcbdd8f7a0ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "db04d895-338b-46fb-af08-779ad5d1181d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.991s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:42:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:42:49 user nova-compute[74821]: DEBUG nova.compute.manager [req-a4b27701-f414-4f3f-a796-da6aaf3f86ef req-4623781d-bba2-4e12-acc9-aaf800bb6951 service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Received event network-changed-f0259675-f417-4927-993f-769bab8f0086 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:42:49 user nova-compute[74821]: DEBUG nova.compute.manager [req-a4b27701-f414-4f3f-a796-da6aaf3f86ef req-4623781d-bba2-4e12-acc9-aaf800bb6951 service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Refreshing instance network info cache due to event network-changed-f0259675-f417-4927-993f-769bab8f0086. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:42:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-a4b27701-f414-4f3f-a796-da6aaf3f86ef req-4623781d-bba2-4e12-acc9-aaf800bb6951 service nova] Acquiring lock "refresh_cache-929e1e7d-3abf-4c2f-b792-16b0ef970d88" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:42:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:42:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:42:49 user nova-compute[74821]: INFO nova.compute.manager [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Detaching volume 90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c
Nov 06 13:42:49 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Updating instance_info_cache with network_info: [{"id": "f0259675-f417-4927-993f-769bab8f0086", "address": "fa:16:3e:de:27:55", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0259675-f4", "ovs_interfaceid": "f0259675-f417-4927-993f-769bab8f0086", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:42:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-929e1e7d-3abf-4c2f-b792-16b0ef970d88" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:42:49 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:42:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-a4b27701-f414-4f3f-a796-da6aaf3f86ef req-4623781d-bba2-4e12-acc9-aaf800bb6951 service nova] Acquired lock "refresh_cache-929e1e7d-3abf-4c2f-b792-16b0ef970d88" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:42:49 user nova-compute[74821]: DEBUG nova.network.neutron [req-a4b27701-f414-4f3f-a796-da6aaf3f86ef req-4623781d-bba2-4e12-acc9-aaf800bb6951 service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Refreshing network info cache for port f0259675-f417-4927-993f-769bab8f0086 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:42:49 user nova-compute[74821]: INFO nova.virt.block_device [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Attempting to driver detach volume 90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c from mountpoint /dev/vdb
Nov 06 13:42:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Attempting to detach device vdb from instance 929e1e7d-3abf-4c2f-b792-16b0ef970d88 from the persistent domain config. {{(pid=74821) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 13:42:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:42:49 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:42:49 user nova-compute[74821]:   <source dev="/dev/sdd"/>
Nov 06 13:42:49 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:42:49 user nova-compute[74821]:   <serial>90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c</serial>
Nov 06 13:42:49 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:42:49 user nova-compute[74821]: </disk>
Nov 06 13:42:49 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:42:49 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Successfully detached device vdb from instance 929e1e7d-3abf-4c2f-b792-16b0ef970d88 from the persistent domain config.
Nov 06 13:42:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 929e1e7d-3abf-4c2f-b792-16b0ef970d88 from the live domain config. {{(pid=74821) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 13:42:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:42:49 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:42:49 user nova-compute[74821]:   <source dev="/dev/sdd"/>
Nov 06 13:42:49 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:42:49 user nova-compute[74821]:   <serial>90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c</serial>
Nov 06 13:42:49 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:42:49 user nova-compute[74821]: </disk>
Nov 06 13:42:49 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:42:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:42:50 user nova-compute[74821]: DEBUG nova.network.neutron [req-a4b27701-f414-4f3f-a796-da6aaf3f86ef req-4623781d-bba2-4e12-acc9-aaf800bb6951 service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Updated VIF entry in instance network info cache for port f0259675-f417-4927-993f-769bab8f0086. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:42:50 user nova-compute[74821]: DEBUG nova.network.neutron [req-a4b27701-f414-4f3f-a796-da6aaf3f86ef req-4623781d-bba2-4e12-acc9-aaf800bb6951 service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Updating instance_info_cache with network_info: [{"id": "f0259675-f417-4927-993f-769bab8f0086", "address": "fa:16:3e:de:27:55", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0259675-f4", "ovs_interfaceid": "f0259675-f417-4927-993f-769bab8f0086", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:42:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-a4b27701-f414-4f3f-a796-da6aaf3f86ef req-4623781d-bba2-4e12-acc9-aaf800bb6951 service nova] Releasing lock "refresh_cache-929e1e7d-3abf-4c2f-b792-16b0ef970d88" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:42:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 929e1e7d-3abf-4c2f-b792-16b0ef970d88 {{(pid=74821) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 13:42:50 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:42:50 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:42:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Acquiring lock "db04d895-338b-46fb-af08-779ad5d1181d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:42:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "db04d895-338b-46fb-af08-779ad5d1181d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:42:51 user nova-compute[74821]: INFO nova.compute.manager [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Detaching volume 796af53b-b07b-4ab9-8a88-768ceaf369d4
Nov 06 13:42:51 user nova-compute[74821]: INFO nova.virt.block_device [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Attempting to driver detach volume 796af53b-b07b-4ab9-8a88-768ceaf369d4 from mountpoint /dev/vdb
Nov 06 13:42:51 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:42:51 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:42:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Attempting to detach device vdb from instance db04d895-338b-46fb-af08-779ad5d1181d from the persistent domain config. {{(pid=74821) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 13:42:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:42:51 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:42:51 user nova-compute[74821]:   <source dev="/dev/sdf"/>
Nov 06 13:42:51 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:42:51 user nova-compute[74821]:   <serial>796af53b-b07b-4ab9-8a88-768ceaf369d4</serial>
Nov 06 13:42:51 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:42:51 user nova-compute[74821]: </disk>
Nov 06 13:42:51 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:42:51 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Successfully detached device vdb from instance db04d895-338b-46fb-af08-779ad5d1181d from the persistent domain config.
Nov 06 13:42:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance db04d895-338b-46fb-af08-779ad5d1181d from the live domain config. {{(pid=74821) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 13:42:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:42:51 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:42:51 user nova-compute[74821]:   <source dev="/dev/sdf"/>
Nov 06 13:42:51 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:42:51 user nova-compute[74821]:   <serial>796af53b-b07b-4ab9-8a88-768ceaf369d4</serial>
Nov 06 13:42:51 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:42:51 user nova-compute[74821]: </disk>
Nov 06 13:42:51 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'doDygJUR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:42:52 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:42:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:42:52 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:42:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:42:52 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:42:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c85651-6a00-474d-a27c-ccf87ccbae20]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:42:52 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance db04d895-338b-46fb-af08-779ad5d1181d {{(pid=74821) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b655f9d-bd95-4b6f-a9a4-c98cfb4fa99c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c] added
Nov 06 13:42:52 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5950f37-9bad-4f24-8b7f-e13d232c7c67]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bb1b2a-da67-4ab1-8b7d-dae139469b67]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v doDygJUR {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v doDygJUR" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c48b97-0763-4fe0-828a-4f174210364b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'doDygJUR'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afc68dd-c4b6-442e-9fd1-540fce388759]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d96f00-7c85-447b-896a-4fc2c4673655]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:42:52 user nova-compute[74821]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c (non-flash)
Nov 06 13:42:52 user nova-compute[74821]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:42:52 user nova-compute[74821]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 (non-flash)
Nov 06 13:42:52 user nova-compute[74821]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 (non-flash)
Nov 06 13:42:52 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:42:52 user nova-compute[74821]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c (non-flash)
Nov 06 13:42:52 user nova-compute[74821]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:42:52 user nova-compute[74821]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 (non-flash)
Nov 06 13:42:52 user nova-compute[74821]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 (non-flash)
Nov 06 13:42:52 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[807ce840-71c7-4a52-b6c5-308f3a51ce9d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c, portal: 172.16.0.220,3260]
Nov 06 13:42:52 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c, portal: 172.16.0.220,3260] successful.
Nov 06 13:42:52 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[728a4399-4286-457a-b5d8-f37cc9766f2c]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0478413-f4e5-4d2f-bcbb-3279660a1ff2]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:42:52 user nova-compute[74821]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c (non-flash)
Nov 06 13:42:52 user nova-compute[74821]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:42:52 user nova-compute[74821]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 (non-flash)
Nov 06 13:42:52 user nova-compute[74821]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 (non-flash)
Nov 06 13:42:52 user nova-compute[74821]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c (non-flash)
Nov 06 13:42:52 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:42:52 user nova-compute[74821]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c (non-flash)
Nov 06 13:42:52 user nova-compute[74821]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:42:52 user nova-compute[74821]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 (non-flash)
Nov 06 13:42:52 user nova-compute[74821]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 (non-flash)
Nov 06 13:42:52 user nova-compute[74821]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c (non-flash)
Nov 06 13:42:52 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] HCTL ('38', '-', '-', 0) found on session 50 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[96198f25-69fe-4678-8541-ec4dd5e3b599]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Searching for a device in session 50 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'doDygJUR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:42:52 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:42:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:42:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '26332346465383330', 'path': '/dev/sdg'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:42:53 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332346465383330', 'path': '/dev/sdg'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:42:53 user nova-compute[74821]: DEBUG nova.objects.instance [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lazy-loading 'flavor' on Instance uuid 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:42:53 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 13:42:53 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:42:53 user nova-compute[74821]:   <source dev="/dev/sdg"/>
Nov 06 13:42:53 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:42:53 user nova-compute[74821]:   <serial>5aa22918-b35c-4e4e-bc74-a58673722d5c</serial>
Nov 06 13:42:53 user nova-compute[74821]: </disk>
Nov 06 13:42:53 user nova-compute[74821]:  {{(pid=74821) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 13:42:53 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:42:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:42:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:42:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] No VIF found with MAC fa:16:3e:27:3a:ad, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:42:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-101cbbea-6d67-4f9d-bee8-c03ea48320f2 tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "727cdc17-f58c-4cfc-a00c-d4651dc1e9eb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.029s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:42:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:42:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:42:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "727cdc17-f58c-4cfc-a00c-d4651dc1e9eb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:42:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "727cdc17-f58c-4cfc-a00c-d4651dc1e9eb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:42:55 user nova-compute[74821]: INFO nova.compute.manager [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Detaching volume 5aa22918-b35c-4e4e-bc74-a58673722d5c
Nov 06 13:42:55 user nova-compute[74821]: INFO nova.virt.block_device [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Attempting to driver detach volume 5aa22918-b35c-4e4e-bc74-a58673722d5c from mountpoint /dev/vdb
Nov 06 13:42:55 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Attempting to detach device vdb from instance 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb from the persistent domain config. {{(pid=74821) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 13:42:55 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:42:55 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:42:55 user nova-compute[74821]:   <source dev="/dev/sdg"/>
Nov 06 13:42:55 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:42:55 user nova-compute[74821]:   <serial>5aa22918-b35c-4e4e-bc74-a58673722d5c</serial>
Nov 06 13:42:55 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:42:55 user nova-compute[74821]: </disk>
Nov 06 13:42:55 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:42:55 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Successfully detached device vdb from instance 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb from the persistent domain config.
Nov 06 13:42:55 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb from the live domain config. {{(pid=74821) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 13:42:55 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:42:55 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:42:55 user nova-compute[74821]:   <source dev="/dev/sdg"/>
Nov 06 13:42:55 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:42:55 user nova-compute[74821]:   <serial>5aa22918-b35c-4e4e-bc74-a58673722d5c</serial>
Nov 06 13:42:55 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:42:55 user nova-compute[74821]: </disk>
Nov 06 13:42:55 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:42:55 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb {{(pid=74821) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 13:42:55 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:42:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:42:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:42:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:42:55 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:42:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:42:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e1e7d-3abf-4c2f-b792-16b0ef970d88/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e1e7d-3abf-4c2f-b792-16b0ef970d88/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e1e7d-3abf-4c2f-b792-16b0ef970d88/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/929e1e7d-3abf-4c2f-b792-16b0ef970d88/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:42:56 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:42:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/727cdc17-f58c-4cfc-a00c-d4651dc1e9eb/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/727cdc17-f58c-4cfc-a00c-d4651dc1e9eb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/727cdc17-f58c-4cfc-a00c-d4651dc1e9eb/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:42:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/727cdc17-f58c-4cfc-a00c-d4651dc1e9eb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:42:57 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:42:57 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:42:57 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=8419MB free_disk=25.028350830078125GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:42:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:42:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:42:58 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance db04d895-338b-46fb-af08-779ad5d1181d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:42:58 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 929e1e7d-3abf-4c2f-b792-16b0ef970d88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:42:58 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance c3293c45-e843-4d6b-bc15-a10010a24ea6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:42:58 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 754e8314-2f91-4aa4-83d0-2ce9b94db4cc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:42:58 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:42:58 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance eaa80098-14d8-4b64-b45c-242988ad18ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:42:58 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:42:58 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:42:58 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Refreshing inventories for resource provider a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 13:42:58 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Updating ProviderTree inventory for provider a45ec519-15f5-48fe-877b-466db09f8afe from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 13:42:58 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Updating inventory in ProviderTree for provider a45ec519-15f5-48fe-877b-466db09f8afe with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 13:42:58 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Refreshing aggregate associations for resource provider a45ec519-15f5-48fe-877b-466db09f8afe, aggregates: None {{(pid=74821) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 13:42:58 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Refreshing trait associations for resource provider a45ec519-15f5-48fe-877b-466db09f8afe, traits: COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42 {{(pid=74821) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 13:42:58 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:42:58 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:42:58 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:42:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.600s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:42:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:42:59 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:42:59 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:43:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:43:06 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:43:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:43:10 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 929e1e7d-3abf-4c2f-b792-16b0ef970d88 is timed out.
Nov 06 13:43:10 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Successfully detached device vdb from instance 929e1e7d-3abf-4c2f-b792-16b0ef970d88 from the live domain config.
Nov 06 13:43:10 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MbWtCvdT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:43:10 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:43:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a21bc04-8249-4d15-a531-aa656f9acf35]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:43:10 user nova-compute[74821]: No targets found.
Nov 06 13:43:10 user nova-compute[74821]: iSNS:
Nov 06 13:43:10 user nova-compute[74821]: No targets found.
Nov 06 13:43:10 user nova-compute[74821]: STATIC:
Nov 06 13:43:10 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4
Nov 06 13:43:10 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:43:10 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:43:10 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4
Nov 06 13:43:10 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:43:10 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:43:10 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c
Nov 06 13:43:10 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:43:10 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:43:10 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07
Nov 06 13:43:10 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:43:10 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:43:10 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13
Nov 06 13:43:10 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:43:10 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:43:10 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c
Nov 06 13:43:10 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:43:10 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:43:10 user nova-compute[74821]: FIRMWARE:
Nov 06 13:43:10 user nova-compute[74821]: No targets found.
Nov 06 13:43:10 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:43:10 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:43:10 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[10aa045a-83c3-48be-8060-d815cee37534]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[386dda86-e98b-477f-8204-4112f367a5e0]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:43:10 user nova-compute[74821]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c (non-flash)
Nov 06 13:43:10 user nova-compute[74821]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:43:10 user nova-compute[74821]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 (non-flash)
Nov 06 13:43:10 user nova-compute[74821]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 (non-flash)
Nov 06 13:43:10 user nova-compute[74821]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c (non-flash)
Nov 06 13:43:10 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:43:10 user nova-compute[74821]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c (non-flash)
Nov 06 13:43:10 user nova-compute[74821]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:43:10 user nova-compute[74821]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 (non-flash)
Nov 06 13:43:10 user nova-compute[74821]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 (non-flash)
Nov 06 13:43:10 user nova-compute[74821]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c (non-flash)
Nov 06 13:43:10 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e58112f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c'): ({'sdd'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Removing single pathed devices sdd {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4eb4846-cd47-4512-8792-e38c286bbdb7]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a46ade-0bd5-405e-870c-50c65e2516a5]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Flushing IO for device /dev/sdd {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00df596-3480-4392-9e4a-ff4be5938799]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6c4a36-c68c-4f14-87f0-1d083f98cfe4]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] SCSI volumes sdd have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca96f7f8-09d9-4be5-80b1-2f5b8f2dd039]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67d5988-9ef9-4099-b994-e77679eed0d2]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c, portal: 172.16.0.220,3260]
Nov 06 13:43:10 user nova-compute[74821]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c, portal: 172.16.0.220,3260] successful.
Nov 06 13:43:10 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90ce8bc0-f2ee-42b5-a6bd-e5cdfaf0351c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[475cc2f4-088b-4ea9-8424-89972eadc0cd]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] <== disconnect_volume: return (342ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:43:10 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:43:11 user nova-compute[74821]: DEBUG nova.objects.instance [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lazy-loading 'flavor' on Instance uuid 929e1e7d-3abf-4c2f-b792-16b0ef970d88 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:43:11 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-180f29a9-9915-4631-bb37-5f934da826f2 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.087s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:43:12 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance db04d895-338b-46fb-af08-779ad5d1181d is timed out.
Nov 06 13:43:12 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Successfully detached device vdb from instance db04d895-338b-46fb-af08-779ad5d1181d from the live domain config.
Nov 06 13:43:12 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LdweZVTa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:43:12 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:43:12 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbc46f0-52d6-4927-89f2-b25a873d60e4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:43:12 user nova-compute[74821]: No targets found.
Nov 06 13:43:12 user nova-compute[74821]: iSNS:
Nov 06 13:43:12 user nova-compute[74821]: No targets found.
Nov 06 13:43:12 user nova-compute[74821]: STATIC:
Nov 06 13:43:12 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4
Nov 06 13:43:12 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:43:12 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:43:12 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4
Nov 06 13:43:12 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:43:12 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:43:12 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07
Nov 06 13:43:12 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:43:12 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:43:12 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13
Nov 06 13:43:12 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:43:12 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:43:12 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c
Nov 06 13:43:12 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:43:12 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:43:12 user nova-compute[74821]: FIRMWARE:
Nov 06 13:43:12 user nova-compute[74821]: No targets found.
Nov 06 13:43:12 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:43:12 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:43:12 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[423029fb-d851-4f77-b6e4-90882c9fd207]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[da86226b-279b-4893-bdf0-2d020bda4cb9]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:43:12 user nova-compute[74821]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:43:12 user nova-compute[74821]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 (non-flash)
Nov 06 13:43:12 user nova-compute[74821]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 (non-flash)
Nov 06 13:43:12 user nova-compute[74821]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c (non-flash)
Nov 06 13:43:12 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:43:12 user nova-compute[74821]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:43:12 user nova-compute[74821]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 (non-flash)
Nov 06 13:43:12 user nova-compute[74821]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 (non-flash)
Nov 06 13:43:12 user nova-compute[74821]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c (non-flash)
Nov 06 13:43:12 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e40632560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4'): ({'sdf'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Removing single pathed devices sdf {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0ba89a-2012-4c3d-b01f-f17bf627c73d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc81b52-8822-4b7f-aedf-69e07ea11b5b]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Flushing IO for device /dev/sdf {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7f172f-4184-4da7-9bd7-06325802b897]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.035s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[988a3d65-75dc-443a-8edd-e04429fab9fb]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] SCSI volumes sdf have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[03268164-7fe1-4d23-82c4-2388ec6040de]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58fd33f-528d-4b9e-9783-568e85d29680]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4, portal: 172.16.0.220,3260]
Nov 06 13:43:12 user nova-compute[74821]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4, portal: 172.16.0.220,3260] successful.
Nov 06 13:43:12 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:796af53b-b07b-4ab9-8a88-768ceaf369d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2eb34f8-38bb-4df4-9059-91d9b06a51f3]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] <== disconnect_volume: return (311ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:43:12 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:43:13 user nova-compute[74821]: DEBUG nova.objects.instance [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lazy-loading 'flavor' on Instance uuid db04d895-338b-46fb-af08-779ad5d1181d {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:43:13 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-7a75a4f9-ff17-48d1-9351-5eea350127c5 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "db04d895-338b-46fb-af08-779ad5d1181d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.751s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:43:14 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:43:15 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb is timed out.
Nov 06 13:43:15 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Successfully detached device vdb from instance 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb from the live domain config.
Nov 06 13:43:15 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:43:15 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'doDygJUR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:43:15 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:43:15 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:43:15 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:43:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:15 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0690e86-764c-42ea-b87a-2066a23c018d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:15 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:43:15 user nova-compute[74821]: No targets found.
Nov 06 13:43:15 user nova-compute[74821]: iSNS:
Nov 06 13:43:15 user nova-compute[74821]: No targets found.
Nov 06 13:43:15 user nova-compute[74821]: STATIC:
Nov 06 13:43:15 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4
Nov 06 13:43:15 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:43:15 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:43:15 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07
Nov 06 13:43:15 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:43:15 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:43:15 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13
Nov 06 13:43:15 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:43:15 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:43:15 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c
Nov 06 13:43:15 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:43:15 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:43:15 user nova-compute[74821]: FIRMWARE:
Nov 06 13:43:15 user nova-compute[74821]: No targets found.
Nov 06 13:43:15 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:43:15 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:43:15 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:43:15 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:43:15 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:43:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:15 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ff9a09-92f4-404b-b9bd-0ff3928bfdac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:15 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[437e82e1-0d51-464a-bf30-f5fde9165cdf]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:15 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:43:15 user nova-compute[74821]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:43:15 user nova-compute[74821]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 (non-flash)
Nov 06 13:43:15 user nova-compute[74821]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c (non-flash)
Nov 06 13:43:15 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:43:15 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:43:15 user nova-compute[74821]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:43:15 user nova-compute[74821]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 (non-flash)
Nov 06 13:43:15 user nova-compute[74821]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c (non-flash)
Nov 06 13:43:15 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:43:15 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e40633130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c'): ({'sdg'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:43:15 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Removing single pathed devices sdg {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:43:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:15 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d985ad-b9a3-4909-a59e-e179a1680f5d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:15 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3639a34e-22a3-4138-b63b-13779acb267c]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:15 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Flushing IO for device /dev/sdg {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:43:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:15 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5de873-1181-48e9-88e6-488093b41e79]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:15 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:43:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.033s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:15 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84a6d89-ce25-4a51-aa91-00dbaf214b42]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:15 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:43:15 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] SCSI volumes sdg have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:43:15 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:43:15 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1fca93-d9e7-463b-832e-132fb364196c]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:43:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3cf748-b7cd-4978-86bf-e5db0afe6147]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c, portal: 172.16.0.220,3260]
Nov 06 13:43:16 user nova-compute[74821]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c, portal: 172.16.0.220,3260] successful.
Nov 06 13:43:16 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:43:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:16 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa22918-b35c-4e4e-bc74-a58673722d5c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:16 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1286d4-3661-4e27-94b8-82abb7731e3c]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:43:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:43:16 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] <== disconnect_volume: return (314ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:43:16 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:43:16 user nova-compute[74821]: DEBUG nova.objects.instance [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lazy-loading 'flavor' on Instance uuid 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:43:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-d04b95b6-4372-4d62-9f02-a7b4d2190abd tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "727cdc17-f58c-4cfc-a00c-d4651dc1e9eb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.714s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:43:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:43:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:43:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:43:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:43:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:43:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:43:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:43:26 user nova-compute[74821]: DEBUG nova.compute.manager [req-2bad7652-0153-46a3-b85a-1c27efffe87c req-4169eb09-19ef-4b3a-aefa-8bcc7110567b service nova] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Received event network-changed-ee2b1b16-4137-4414-89eb-b0e60c4dce97 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:43:26 user nova-compute[74821]: DEBUG nova.compute.manager [req-2bad7652-0153-46a3-b85a-1c27efffe87c req-4169eb09-19ef-4b3a-aefa-8bcc7110567b service nova] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Refreshing instance network info cache due to event network-changed-ee2b1b16-4137-4414-89eb-b0e60c4dce97. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:43:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2bad7652-0153-46a3-b85a-1c27efffe87c req-4169eb09-19ef-4b3a-aefa-8bcc7110567b service nova] Acquiring lock "refresh_cache-eaa80098-14d8-4b64-b45c-242988ad18ec" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:43:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2bad7652-0153-46a3-b85a-1c27efffe87c req-4169eb09-19ef-4b3a-aefa-8bcc7110567b service nova] Acquired lock "refresh_cache-eaa80098-14d8-4b64-b45c-242988ad18ec" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:43:26 user nova-compute[74821]: DEBUG nova.network.neutron [req-2bad7652-0153-46a3-b85a-1c27efffe87c req-4169eb09-19ef-4b3a-aefa-8bcc7110567b service nova] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Refreshing network info cache for port ee2b1b16-4137-4414-89eb-b0e60c4dce97 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:43:26 user nova-compute[74821]: DEBUG nova.network.neutron [req-2bad7652-0153-46a3-b85a-1c27efffe87c req-4169eb09-19ef-4b3a-aefa-8bcc7110567b service nova] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Updated VIF entry in instance network info cache for port ee2b1b16-4137-4414-89eb-b0e60c4dce97. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:43:26 user nova-compute[74821]: DEBUG nova.network.neutron [req-2bad7652-0153-46a3-b85a-1c27efffe87c req-4169eb09-19ef-4b3a-aefa-8bcc7110567b service nova] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Updating instance_info_cache with network_info: [{"id": "ee2b1b16-4137-4414-89eb-b0e60c4dce97", "address": "fa:16:3e:5f:a0:d9", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee2b1b16-41", "ovs_interfaceid": "ee2b1b16-4137-4414-89eb-b0e60c4dce97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:43:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2bad7652-0153-46a3-b85a-1c27efffe87c req-4169eb09-19ef-4b3a-aefa-8bcc7110567b service nova] Releasing lock "refresh_cache-eaa80098-14d8-4b64-b45c-242988ad18ec" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:43:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "eaa80098-14d8-4b64-b45c-242988ad18ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:43:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "eaa80098-14d8-4b64-b45c-242988ad18ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:43:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "eaa80098-14d8-4b64-b45c-242988ad18ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:43:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "eaa80098-14d8-4b64-b45c-242988ad18ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:43:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "eaa80098-14d8-4b64-b45c-242988ad18ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:43:26 user nova-compute[74821]: INFO nova.compute.manager [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Terminating instance
Nov 06 13:43:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:43:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG nova.compute.manager [req-3219e4b0-20ea-4748-bd6b-77a177bcee46 req-a21d2772-d6f6-4a2d-8f1f-6e0589ba3a30 service nova] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Received event network-vif-unplugged-ee2b1b16-4137-4414-89eb-b0e60c4dce97 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3219e4b0-20ea-4748-bd6b-77a177bcee46 req-a21d2772-d6f6-4a2d-8f1f-6e0589ba3a30 service nova] Acquiring lock "eaa80098-14d8-4b64-b45c-242988ad18ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3219e4b0-20ea-4748-bd6b-77a177bcee46 req-a21d2772-d6f6-4a2d-8f1f-6e0589ba3a30 service nova] Lock "eaa80098-14d8-4b64-b45c-242988ad18ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3219e4b0-20ea-4748-bd6b-77a177bcee46 req-a21d2772-d6f6-4a2d-8f1f-6e0589ba3a30 service nova] Lock "eaa80098-14d8-4b64-b45c-242988ad18ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG nova.compute.manager [req-3219e4b0-20ea-4748-bd6b-77a177bcee46 req-a21d2772-d6f6-4a2d-8f1f-6e0589ba3a30 service nova] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] No waiting events found dispatching network-vif-unplugged-ee2b1b16-4137-4414-89eb-b0e60c4dce97 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG nova.compute.manager [req-3219e4b0-20ea-4748-bd6b-77a177bcee46 req-a21d2772-d6f6-4a2d-8f1f-6e0589ba3a30 service nova] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Received event network-vif-unplugged-ee2b1b16-4137-4414-89eb-b0e60c4dce97 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:27 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Instance destroyed successfully.
Nov 06 13:43:27 user nova-compute[74821]: DEBUG nova.objects.instance [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lazy-loading 'resources' on Instance uuid eaa80098-14d8-4b64-b45c-242988ad18ec {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:41:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-543545268',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-543545268',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-543545268',id=48,image_ref='c61f09b9-7d7d-46b5-b44c-312fe9467cd1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlzXQ1hqyJ4swpgKdfYHqekj6t29llZ5gv7HcgRYOnAoyYyg5Yya3irNAkvxnJh/hYZA1rJxNpBTiX7gxwiscwlrbH4F6IUfRuJy89tZlaAt01OXs3yx+361HJjCchIFA==',key_name='tempest-keypair-1867060567',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:42:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c8e811a3a30417a8dc6ccad03f2f8e0',ramdisk_id='',reservation_id='r-nlffa02q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1930796442',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1930796442-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1930796442',owner_user_name='tempest-TestVolumeBootPattern-1930796442-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:42:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bb6a168d90a4795a72b8ac69eeadcc9',uuid=eaa80098-14d8-4b64-b45c-242988ad18ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee2b1b16-4137-4414-89eb-b0e60c4dce97", "address": "fa:16:3e:5f:a0:d9", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee2b1b16-41", "ovs_interfaceid": "ee2b1b16-4137-4414-89eb-b0e60c4dce97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Converting VIF {"id": "ee2b1b16-4137-4414-89eb-b0e60c4dce97", "address": "fa:16:3e:5f:a0:d9", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee2b1b16-41", "ovs_interfaceid": "ee2b1b16-4137-4414-89eb-b0e60c4dce97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:a0:d9,bridge_name='br-int',has_traffic_filtering=True,id=ee2b1b16-4137-4414-89eb-b0e60c4dce97,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee2b1b16-41') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG os_vif [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:a0:d9,bridge_name='br-int',has_traffic_filtering=True,id=ee2b1b16-4137-4414-89eb-b0e60c4dce97,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee2b1b16-41') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee2b1b16-41, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff73c851-dea1-42ed-93eb-a74e0005eb2b) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:27 user nova-compute[74821]: INFO os_vif [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:a0:d9,bridge_name='br-int',has_traffic_filtering=True,id=ee2b1b16-4137-4414-89eb-b0e60c4dce97,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee2b1b16-41')
Nov 06 13:43:27 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TLWrRdSn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:43:27 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:43:27 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbeb4a61-bf98-41e9-9a3a-cb6d4e8112f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:43:27 user nova-compute[74821]: No targets found.
Nov 06 13:43:27 user nova-compute[74821]: iSNS:
Nov 06 13:43:27 user nova-compute[74821]: No targets found.
Nov 06 13:43:27 user nova-compute[74821]: STATIC:
Nov 06 13:43:27 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4
Nov 06 13:43:27 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:43:27 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:43:27 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07
Nov 06 13:43:27 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:43:27 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:43:27 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13
Nov 06 13:43:27 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:43:27 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:43:27 user nova-compute[74821]: FIRMWARE:
Nov 06 13:43:27 user nova-compute[74821]: No targets found.
Nov 06 13:43:27 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:43:27 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:43:27 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb2c3f0-21ab-41a2-959a-c08dcfec9dec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea18329b-6905-420b-8076-d2c01c15967e]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:43:27 user nova-compute[74821]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:43:27 user nova-compute[74821]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 (non-flash)
Nov 06 13:43:27 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:43:27 user nova-compute[74821]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:43:27 user nova-compute[74821]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 (non-flash)
Nov 06 13:43:27 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e40587eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13'): ({'sdc'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Removing single pathed devices sdc {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cbfc9e-9bc5-4c55-9a89-816c15d1881a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0ac090-1fe2-4753-b783-947ae09ff355]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Flushing IO for device /dev/sdc {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c756f082-598e-434c-b3df-9c6968b80567]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b674ef9-517f-4d52-9202-d9b3bb581e8a]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] SCSI volumes sdc have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO28b6ffa6-5fc8436863833529', '/dev/disk/by-id/scsi-23566633834333638', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_28b6ffa6') {{(pid=85818) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1115ca-8e0b-4c0d-8d29-7fbc46991117]: (4, None) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e404521-c022-453f-9ef5-a14bacc42119]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c61547-066d-443d-94f7-a9208c365cf9]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13, portal: 172.16.0.220,3260]
Nov 06 13:43:27 user nova-compute[74821]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13, portal: 172.16.0.220,3260] successful.
Nov 06 13:43:27 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e3466b-419e-4dd3-84e6-a44ea934cf13 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[521ab1ce-8aff-4ce1-bb2e-a05676b8bc1e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] <== disconnect_volume: return (325ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:43:27 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:43:27 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Deleting instance files /opt/stack/data/nova/instances/eaa80098-14d8-4b64-b45c-242988ad18ec_del
Nov 06 13:43:27 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Deletion of /opt/stack/data/nova/instances/eaa80098-14d8-4b64-b45c-242988ad18ec_del complete
Nov 06 13:43:28 user nova-compute[74821]: INFO nova.compute.manager [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 06 13:43:28 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:43:28 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:43:28 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:43:28 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:43:28 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Took 0.61 seconds to deallocate network for instance.
Nov 06 13:43:29 user nova-compute[74821]: DEBUG nova.compute.manager [req-43e0cbe2-1662-4982-ae41-6f3c3e5c6e62 req-bc50b8c4-2c91-4015-98ba-c2a66d1b6d69 service nova] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Received event network-vif-plugged-ee2b1b16-4137-4414-89eb-b0e60c4dce97 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:43:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-43e0cbe2-1662-4982-ae41-6f3c3e5c6e62 req-bc50b8c4-2c91-4015-98ba-c2a66d1b6d69 service nova] Acquiring lock "eaa80098-14d8-4b64-b45c-242988ad18ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:43:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-43e0cbe2-1662-4982-ae41-6f3c3e5c6e62 req-bc50b8c4-2c91-4015-98ba-c2a66d1b6d69 service nova] Lock "eaa80098-14d8-4b64-b45c-242988ad18ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:43:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-43e0cbe2-1662-4982-ae41-6f3c3e5c6e62 req-bc50b8c4-2c91-4015-98ba-c2a66d1b6d69 service nova] Lock "eaa80098-14d8-4b64-b45c-242988ad18ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:43:29 user nova-compute[74821]: DEBUG nova.compute.manager [req-43e0cbe2-1662-4982-ae41-6f3c3e5c6e62 req-bc50b8c4-2c91-4015-98ba-c2a66d1b6d69 service nova] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] No waiting events found dispatching network-vif-plugged-ee2b1b16-4137-4414-89eb-b0e60c4dce97 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:43:29 user nova-compute[74821]: WARNING nova.compute.manager [req-43e0cbe2-1662-4982-ae41-6f3c3e5c6e62 req-bc50b8c4-2c91-4015-98ba-c2a66d1b6d69 service nova] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Received unexpected event network-vif-plugged-ee2b1b16-4137-4414-89eb-b0e60c4dce97 for instance with vm_state active and task_state deleting.
Nov 06 13:43:29 user nova-compute[74821]: DEBUG nova.compute.manager [req-43e0cbe2-1662-4982-ae41-6f3c3e5c6e62 req-bc50b8c4-2c91-4015-98ba-c2a66d1b6d69 service nova] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Received event network-vif-deleted-ee2b1b16-4137-4414-89eb-b0e60c4dce97 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:43:29 user nova-compute[74821]: INFO nova.compute.manager [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Took 0.87 seconds to detach 1 volumes for instance.
Nov 06 13:43:29 user nova-compute[74821]: DEBUG nova.compute.manager [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: eaa80098-14d8-4b64-b45c-242988ad18ec] Deleting volume: 39e3466b-419e-4dd3-84e6-a44ea934cf13 {{(pid=74821) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 06 13:43:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:43:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:43:29 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:43:29 user nova-compute[74821]: DEBUG nova.objects.instance [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lazy-loading 'flavor' on Instance uuid c3293c45-e843-4d6b-bc15-a10010a24ea6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:43:29 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:43:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "refresh_cache-c3293c45-e843-4d6b-bc15-a10010a24ea6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:43:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquired lock "refresh_cache-c3293c45-e843-4d6b-bc15-a10010a24ea6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:43:29 user nova-compute[74821]: DEBUG nova.network.neutron [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:43:29 user nova-compute[74821]: DEBUG nova.objects.instance [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lazy-loading 'info_cache' on Instance uuid c3293c45-e843-4d6b-bc15-a10010a24ea6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:43:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:43:29 user nova-compute[74821]: DEBUG nova.objects.base [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Object Instance<c3293c45-e843-4d6b-bc15-a10010a24ea6> lazy-loaded attributes: flavor,info_cache {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:43:29 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Deleted allocations for instance eaa80098-14d8-4b64-b45c-242988ad18ec
Nov 06 13:43:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-404daec9-d670-4845-992b-0b4008a97a76 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "eaa80098-14d8-4b64-b45c-242988ad18ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.169s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG nova.network.neutron [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Updating instance_info_cache with network_info: [{"id": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "address": "fa:16:3e:87:40:ab", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da3ffbf-3f", "ovs_interfaceid": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Releasing lock "refresh_cache-c3293c45-e843-4d6b-bc15-a10010a24ea6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:43:30 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Instance destroyed successfully.
Nov 06 13:43:30 user nova-compute[74821]: DEBUG nova.objects.instance [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lazy-loading 'resources' on Instance uuid c3293c45-e843-4d6b-bc15-a10010a24ea6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG nova.objects.base [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Object Instance<c3293c45-e843-4d6b-bc15-a10010a24ea6> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:39:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1993604917',display_name='tempest-AttachVolumeTestJSON-server-1993604917',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1993604917',id=45,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVB62RpV7sb/k2zRM/ERNI4ujnBhy7CTod4Pfx14PprgP+C8QSul7cOBioxpJJqMn0wC1iI7xPCkFVcTSwGlIE5o2jmZYDIM/eqmdyMBPfuKA5g8IgRvnLBPlG3P7M+Gw==',key_name='tempest-keypair-2114445980',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:39:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9f3e02b312774fffa90b9aea7611b7d2',ramdisk_id='',reservation_id='r-e3xww6ds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1920917363',owner_user_name='tempest-AttachVolumeTestJSON-1920917363-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:41:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88ff13567ecb4157898a278d3ae6e0d0',uuid=c3293c45-e843-4d6b-bc15-a10010a24ea6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "address": "fa:16:3e:87:40:ab", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da3ffbf-3f", "ovs_interfaceid": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Converting VIF {"id": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "address": "fa:16:3e:87:40:ab", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da3ffbf-3f", "ovs_interfaceid": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:40:ab,bridge_name='br-int',has_traffic_filtering=True,id=4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec,network=Network(a2ec52e9-7476-4ced-9810-d58d3f9eec4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4da3ffbf-3f') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG os_vif [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:40:ab,bridge_name='br-int',has_traffic_filtering=True,id=4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec,network=Network(a2ec52e9-7476-4ced-9810-d58d3f9eec4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4da3ffbf-3f') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4da3ffbf-3f, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6b05cbda-bab2-4e1f-bd89-1cd528b66b7a) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:43:30 user nova-compute[74821]: INFO os_vif [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:40:ab,bridge_name='br-int',has_traffic_filtering=True,id=4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec,network=Network(a2ec52e9-7476-4ced-9810-d58d3f9eec4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4da3ffbf-3f')
Nov 06 13:43:30 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvPQSnqr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:43:30 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:43:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5660b247-525b-4cdb-b5c5-e99ab9467f3e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:43:30 user nova-compute[74821]: No targets found.
Nov 06 13:43:30 user nova-compute[74821]: iSNS:
Nov 06 13:43:30 user nova-compute[74821]: No targets found.
Nov 06 13:43:30 user nova-compute[74821]: STATIC:
Nov 06 13:43:30 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4
Nov 06 13:43:30 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:43:30 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:43:30 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07
Nov 06 13:43:30 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:43:30 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:43:30 user nova-compute[74821]: FIRMWARE:
Nov 06 13:43:30 user nova-compute[74821]: No targets found.
Nov 06 13:43:30 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:43:30 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:43:30 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe5eaad-b481-41e7-965a-921b91a2d761]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7d8dc7-997a-46f3-bca0-19a76381d0a8]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:43:30 user nova-compute[74821]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:43:30 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:43:30 user nova-compute[74821]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:43:30 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e4040caf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4'): ({'sde'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Removing single pathed devices sde {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[90817630-458d-4e9d-8ae6-f0b27fdae5e4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74ee2a4-1011-43d5-9db8-1da599ff025a]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Flushing IO for device /dev/sde {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.037s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3844372e-14be-43bd-8c8e-ac3a04957340]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83ee36b-6556-415f-a0c4-0882f8a0c936]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] SCSI volumes sde have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf796059-a8c6-485b-8f07-ae0bd2a9b4c0]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[87eeee59-e64d-4918-8135-7d06d49e6467]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4, portal: 172.16.0.220,3260]
Nov 06 13:43:30 user nova-compute[74821]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4, portal: 172.16.0.220,3260] successful.
Nov 06 13:43:30 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4ad1b3-52ed-4b81-b301-06d2b9c6d51f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.449s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] <== disconnect_volume: return (450ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Start _get_guest_xml network_info=[{"id": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "address": "fa:16:3e:87:40:ab", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da3ffbf-3f", "ovs_interfaceid": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvPQSnqr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'c3293c45-e843-4d6b-bc15-a10010a24ea6', 'attached_at': '', 'detached_at': '', 'volume_id': '6e8f395f-5111-45d2-8cb4-6a2aced821d4', 'serial': '6e8f395f-5111-45d2-8cb4-6a2aced821d4'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': 'ed771829-3228-414c-acf9-a9224985896b', 'volume_type': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG nova.objects.instance [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lazy-loading 'numa_topology' on Instance uuid c3293c45-e843-4d6b-bc15-a10010a24ea6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG nova.objects.base [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Object Instance<c3293c45-e843-4d6b-bc15-a10010a24ea6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:43:30 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:43:30 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:43:30 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG nova.objects.instance [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lazy-loading 'vcpu_model' on Instance uuid c3293c45-e843-4d6b-bc15-a10010a24ea6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:43:30 user nova-compute[74821]: DEBUG nova.objects.base [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Object Instance<c3293c45-e843-4d6b-bc15-a10010a24ea6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvPQSnqr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:43:31 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:43:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:43:31 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:43:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:43:31 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:43:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d8dac4-9513-4146-b174-d28d17dac8a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:43:31 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45688ef-8a82-4fc7-b5a7-a1c45a8255fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4] added
Nov 06 13:43:31 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3da171-90a6-46b4-85c4-3df9249ae134]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf8a9e8-66fb-4c79-a5bf-45810019bc68]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uvPQSnqr {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uvPQSnqr" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0497bc-ec90-471a-b9f6-1da7f93f449c]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uvPQSnqr'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01b259c-b722-4f5c-8d35-d27f927e517c]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[00561352-dd67-402b-ac05-389076d722e2]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:43:31 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:43:31 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[97df0364-61e0-4213-afcf-6c311940ac8f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4, portal: 172.16.0.220,3260]
Nov 06 13:43:31 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4, portal: 172.16.0.220,3260] successful.
Nov 06 13:43:31 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[439321f3-ee2a-4ebd-833f-7351f4143a34]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc0c6b6-51bd-4b36-95a8-a28a9860a194]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:43:31 user nova-compute[74821]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:43:31 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:43:31 user nova-compute[74821]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:43:31 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[da20d3fe-6e32-4ee0-a82b-c838b6476c53]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:31 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: None {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:43:32 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:43:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvPQSnqr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:43:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:43:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23934393661383964', 'path': '/dev/sdc'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:43:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934393661383964', 'path': '/dev/sdc'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:43:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:39:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1993604917',display_name='tempest-AttachVolumeTestJSON-server-1993604917',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1993604917',id=45,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVB62RpV7sb/k2zRM/ERNI4ujnBhy7CTod4Pfx14PprgP+C8QSul7cOBioxpJJqMn0wC1iI7xPCkFVcTSwGlIE5o2jmZYDIM/eqmdyMBPfuKA5g8IgRvnLBPlG3P7M+Gw==',key_name='tempest-keypair-2114445980',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:39:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9f3e02b312774fffa90b9aea7611b7d2',ramdisk_id='',reservation_id='r-e3xww6ds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1920917363',owner_user_name='tempest-AttachVolumeTestJSON-1920917363-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:41:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88ff13567ecb4157898a278d3ae6e0d0',uuid=c3293c45-e843-4d6b-bc15-a10010a24ea6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "address": "fa:16:3e:87:40:ab", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da3ffbf-3f", "ovs_interfaceid": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:43:32 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Converting VIF {"id": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "address": "fa:16:3e:87:40:ab", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da3ffbf-3f", "ovs_interfaceid": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:43:32 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:40:ab,bridge_name='br-int',has_traffic_filtering=True,id=4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec,network=Network(a2ec52e9-7476-4ced-9810-d58d3f9eec4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4da3ffbf-3f') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:43:32 user nova-compute[74821]: DEBUG nova.objects.instance [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lazy-loading 'pci_devices' on Instance uuid c3293c45-e843-4d6b-bc15-a10010a24ea6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:43:32 user nova-compute[74821]: DEBUG nova.objects.base [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Object Instance<c3293c45-e843-4d6b-bc15-a10010a24ea6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:43:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:43:32 user nova-compute[74821]:   <uuid>c3293c45-e843-4d6b-bc15-a10010a24ea6</uuid>
Nov 06 13:43:32 user nova-compute[74821]:   <name>instance-0000002d</name>
Nov 06 13:43:32 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:43:32 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:43:32 user nova-compute[74821]:   <metadata>
Nov 06 13:43:32 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:43:32 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:43:32 user nova-compute[74821]:       <nova:name>tempest-AttachVolumeTestJSON-server-1993604917</nova:name>
Nov 06 13:43:32 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:43:30</nova:creationTime>
Nov 06 13:43:32 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:43:32 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:43:32 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:43:32 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:43:32 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:43:32 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:43:32 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:43:32 user nova-compute[74821]:       <nova:owner>
Nov 06 13:43:32 user nova-compute[74821]:         <nova:user uuid="88ff13567ecb4157898a278d3ae6e0d0">tempest-AttachVolumeTestJSON-1920917363-project-member</nova:user>
Nov 06 13:43:32 user nova-compute[74821]:         <nova:project uuid="9f3e02b312774fffa90b9aea7611b7d2">tempest-AttachVolumeTestJSON-1920917363</nova:project>
Nov 06 13:43:32 user nova-compute[74821]:       </nova:owner>
Nov 06 13:43:32 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:43:32 user nova-compute[74821]:       <nova:ports>
Nov 06 13:43:32 user nova-compute[74821]:         <nova:port uuid="4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec">
Nov 06 13:43:32 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 06 13:43:32 user nova-compute[74821]:         </nova:port>
Nov 06 13:43:32 user nova-compute[74821]:       </nova:ports>
Nov 06 13:43:32 user nova-compute[74821]:     </nova:instance>
Nov 06 13:43:32 user nova-compute[74821]:   </metadata>
Nov 06 13:43:32 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:43:32 user nova-compute[74821]:     <system>
Nov 06 13:43:32 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:43:32 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:43:32 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:43:32 user nova-compute[74821]:       <entry name="serial">c3293c45-e843-4d6b-bc15-a10010a24ea6</entry>
Nov 06 13:43:32 user nova-compute[74821]:       <entry name="uuid">c3293c45-e843-4d6b-bc15-a10010a24ea6</entry>
Nov 06 13:43:32 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:43:32 user nova-compute[74821]:     </system>
Nov 06 13:43:32 user nova-compute[74821]:   </sysinfo>
Nov 06 13:43:32 user nova-compute[74821]:   <os>
Nov 06 13:43:32 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:43:32 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:43:32 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:43:32 user nova-compute[74821]:   </os>
Nov 06 13:43:32 user nova-compute[74821]:   <features>
Nov 06 13:43:32 user nova-compute[74821]:     <acpi/>
Nov 06 13:43:32 user nova-compute[74821]:     <apic/>
Nov 06 13:43:32 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:43:32 user nova-compute[74821]:   </features>
Nov 06 13:43:32 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:43:32 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:43:32 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:43:32 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:43:32 user nova-compute[74821]:   </clock>
Nov 06 13:43:32 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:43:32 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:43:32 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:43:32 user nova-compute[74821]:   </cpu>
Nov 06 13:43:32 user nova-compute[74821]:   <devices>
Nov 06 13:43:32 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:43:32 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:43:32 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk"/>
Nov 06 13:43:32 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:43:32 user nova-compute[74821]:     </disk>
Nov 06 13:43:32 user nova-compute[74821]:     <disk type="block" device="disk">
Nov 06 13:43:32 user nova-compute[74821]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:43:32 user nova-compute[74821]:       <source dev="/dev/sdc"/>
Nov 06 13:43:32 user nova-compute[74821]:       <target dev="vdb" bus="virtio"/>
Nov 06 13:43:32 user nova-compute[74821]:       <serial>6e8f395f-5111-45d2-8cb4-6a2aced821d4</serial>
Nov 06 13:43:32 user nova-compute[74821]:     </disk>
Nov 06 13:43:32 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:43:32 user nova-compute[74821]:       <mac address="fa:16:3e:87:40:ab"/>
Nov 06 13:43:32 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:43:32 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:43:32 user nova-compute[74821]:       <target dev="tap4da3ffbf-3f"/>
Nov 06 13:43:32 user nova-compute[74821]:     </interface>
Nov 06 13:43:32 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:43:32 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/console.log" append="off"/>
Nov 06 13:43:32 user nova-compute[74821]:     </serial>
Nov 06 13:43:32 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:43:32 user nova-compute[74821]:     <video>
Nov 06 13:43:32 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:43:32 user nova-compute[74821]:     </video>
Nov 06 13:43:32 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:43:32 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:43:32 user nova-compute[74821]:     </rng>
Nov 06 13:43:32 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:43:32 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:43:32 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:43:32 user nova-compute[74821]:     </memballoon>
Nov 06 13:43:32 user nova-compute[74821]:   </devices>
Nov 06 13:43:32 user nova-compute[74821]: </domain>
Nov 06 13:43:32 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:43:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:43:32 user nova-compute[74821]: DEBUG nova.objects.instance [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lazy-loading 'trusted_certs' on Instance uuid c3293c45-e843-4d6b-bc15-a10010a24ea6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:43:32 user nova-compute[74821]: DEBUG nova.objects.base [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Object Instance<c3293c45-e843-4d6b-bc15-a10010a24ea6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:43:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.190s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:32 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:43:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:33 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:33 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Cannot resize image /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:43:33 user nova-compute[74821]: DEBUG nova.objects.instance [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lazy-loading 'migration_context' on Instance uuid c3293c45-e843-4d6b-bc15-a10010a24ea6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:43:33 user nova-compute[74821]: DEBUG nova.objects.base [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Object Instance<c3293c45-e843-4d6b-bc15-a10010a24ea6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:43:33 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:39:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1993604917',display_name='tempest-AttachVolumeTestJSON-server-1993604917',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1993604917',id=45,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVB62RpV7sb/k2zRM/ERNI4ujnBhy7CTod4Pfx14PprgP+C8QSul7cOBioxpJJqMn0wC1iI7xPCkFVcTSwGlIE5o2jmZYDIM/eqmdyMBPfuKA5g8IgRvnLBPlG3P7M+Gw==',key_name='tempest-keypair-2114445980',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:39:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='9f3e02b312774fffa90b9aea7611b7d2',ramdisk_id='',reservation_id='r-e3xww6ds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1920917363',owner_user_name='tempest-AttachVolumeTestJSON-1920917363-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:41:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88ff13567ecb4157898a278d3ae6e0d0',uuid=c3293c45-e843-4d6b-bc15-a10010a24ea6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "address": "fa:16:3e:87:40:ab", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da3ffbf-3f", "ovs_interfaceid": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:43:33 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Converting VIF {"id": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "address": "fa:16:3e:87:40:ab", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da3ffbf-3f", "ovs_interfaceid": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:43:33 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:40:ab,bridge_name='br-int',has_traffic_filtering=True,id=4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec,network=Network(a2ec52e9-7476-4ced-9810-d58d3f9eec4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4da3ffbf-3f') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:43:33 user nova-compute[74821]: DEBUG os_vif [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:40:ab,bridge_name='br-int',has_traffic_filtering=True,id=4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec,network=Network(a2ec52e9-7476-4ced-9810-d58d3f9eec4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4da3ffbf-3f') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:43:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:43:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:43:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e06a90f1-fdc0-5ef6-969e-1e527b1fdc96', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:43:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:43:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4da3ffbf-3f, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:43:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4da3ffbf-3f, col_values=(('qos', UUID('42596340-c50e-414e-af6d-946d664fc5c4')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:43:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4da3ffbf-3f, col_values=(('external_ids', {'iface-id': '4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:40:ab', 'vm-uuid': 'c3293c45-e843-4d6b-bc15-a10010a24ea6'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:43:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:43:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:33 user nova-compute[74821]: INFO os_vif [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:40:ab,bridge_name='br-int',has_traffic_filtering=True,id=4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec,network=Network(a2ec52e9-7476-4ced-9810-d58d3f9eec4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4da3ffbf-3f')
Nov 06 13:43:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:34 user nova-compute[74821]: DEBUG nova.compute.manager [req-5aecd0ec-0caf-4d3c-836a-d699c0fe0805 req-6d900ece-a5b5-42f5-a3ad-cdc67b336bcc service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Received event network-vif-plugged-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:43:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5aecd0ec-0caf-4d3c-836a-d699c0fe0805 req-6d900ece-a5b5-42f5-a3ad-cdc67b336bcc service nova] Acquiring lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:43:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5aecd0ec-0caf-4d3c-836a-d699c0fe0805 req-6d900ece-a5b5-42f5-a3ad-cdc67b336bcc service nova] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:43:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5aecd0ec-0caf-4d3c-836a-d699c0fe0805 req-6d900ece-a5b5-42f5-a3ad-cdc67b336bcc service nova] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:43:34 user nova-compute[74821]: DEBUG nova.compute.manager [req-5aecd0ec-0caf-4d3c-836a-d699c0fe0805 req-6d900ece-a5b5-42f5-a3ad-cdc67b336bcc service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] No waiting events found dispatching network-vif-plugged-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:43:34 user nova-compute[74821]: WARNING nova.compute.manager [req-5aecd0ec-0caf-4d3c-836a-d699c0fe0805 req-6d900ece-a5b5-42f5-a3ad-cdc67b336bcc service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Received unexpected event network-vif-plugged-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec for instance with vm_state stopped and task_state powering-on.
Nov 06 13:43:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:36 user nova-compute[74821]: DEBUG nova.compute.manager [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:43:36 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Instance rebooted successfully.
Nov 06 13:43:36 user nova-compute[74821]: DEBUG nova.compute.manager [None req-99d3be17-9c94-4fda-9ac9-ee69f894f6a0 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:43:36 user nova-compute[74821]: DEBUG nova.compute.manager [req-8143fef5-e11b-466c-b30f-0a49df857554 req-3de158cc-c155-489e-aa4a-0029b37c17c0 service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Received event network-vif-plugged-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:43:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8143fef5-e11b-466c-b30f-0a49df857554 req-3de158cc-c155-489e-aa4a-0029b37c17c0 service nova] Acquiring lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:43:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8143fef5-e11b-466c-b30f-0a49df857554 req-3de158cc-c155-489e-aa4a-0029b37c17c0 service nova] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:43:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8143fef5-e11b-466c-b30f-0a49df857554 req-3de158cc-c155-489e-aa4a-0029b37c17c0 service nova] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:43:36 user nova-compute[74821]: DEBUG nova.compute.manager [req-8143fef5-e11b-466c-b30f-0a49df857554 req-3de158cc-c155-489e-aa4a-0029b37c17c0 service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] No waiting events found dispatching network-vif-plugged-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:43:36 user nova-compute[74821]: WARNING nova.compute.manager [req-8143fef5-e11b-466c-b30f-0a49df857554 req-3de158cc-c155-489e-aa4a-0029b37c17c0 service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Received unexpected event network-vif-plugged-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec for instance with vm_state active and task_state None.
Nov 06 13:43:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:43 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e1ca64c9-a541-4338-a882-c1af112f4eba tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "727cdc17-f58c-4cfc-a00c-d4651dc1e9eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:43:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e1ca64c9-a541-4338-a882-c1af112f4eba tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "727cdc17-f58c-4cfc-a00c-d4651dc1e9eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:43:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e1ca64c9-a541-4338-a882-c1af112f4eba tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "727cdc17-f58c-4cfc-a00c-d4651dc1e9eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:43:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e1ca64c9-a541-4338-a882-c1af112f4eba tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "727cdc17-f58c-4cfc-a00c-d4651dc1e9eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:43:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e1ca64c9-a541-4338-a882-c1af112f4eba tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "727cdc17-f58c-4cfc-a00c-d4651dc1e9eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:43:45 user nova-compute[74821]: INFO nova.compute.manager [None req-e1ca64c9-a541-4338-a882-c1af112f4eba tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Terminating instance
Nov 06 13:43:45 user nova-compute[74821]: DEBUG nova.compute.manager [None req-e1ca64c9-a541-4338-a882-c1af112f4eba tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:43:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:46 user nova-compute[74821]: DEBUG nova.compute.manager [req-04220d74-a63e-4cfc-858f-90868b2b1bd7 req-a2c72c4a-039b-480c-8bc1-a4cb8e93169a service nova] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Received event network-vif-unplugged-57183466-2952-4bd9-b1a5-35e9bb976887 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:43:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-04220d74-a63e-4cfc-858f-90868b2b1bd7 req-a2c72c4a-039b-480c-8bc1-a4cb8e93169a service nova] Acquiring lock "727cdc17-f58c-4cfc-a00c-d4651dc1e9eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:43:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-04220d74-a63e-4cfc-858f-90868b2b1bd7 req-a2c72c4a-039b-480c-8bc1-a4cb8e93169a service nova] Lock "727cdc17-f58c-4cfc-a00c-d4651dc1e9eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:43:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-04220d74-a63e-4cfc-858f-90868b2b1bd7 req-a2c72c4a-039b-480c-8bc1-a4cb8e93169a service nova] Lock "727cdc17-f58c-4cfc-a00c-d4651dc1e9eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:43:46 user nova-compute[74821]: DEBUG nova.compute.manager [req-04220d74-a63e-4cfc-858f-90868b2b1bd7 req-a2c72c4a-039b-480c-8bc1-a4cb8e93169a service nova] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] No waiting events found dispatching network-vif-unplugged-57183466-2952-4bd9-b1a5-35e9bb976887 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:43:46 user nova-compute[74821]: DEBUG nova.compute.manager [req-04220d74-a63e-4cfc-858f-90868b2b1bd7 req-a2c72c4a-039b-480c-8bc1-a4cb8e93169a service nova] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Received event network-vif-unplugged-57183466-2952-4bd9-b1a5-35e9bb976887 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:43:46 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Instance destroyed successfully.
Nov 06 13:43:46 user nova-compute[74821]: DEBUG nova.objects.instance [None req-e1ca64c9-a541-4338-a882-c1af112f4eba tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lazy-loading 'resources' on Instance uuid 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:43:46 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-e1ca64c9-a541-4338-a882-c1af112f4eba tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:40:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1503797919',display_name='tempest-AttachVolumeNegativeTest-server-1503797919',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1503797919',id=47,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxI7Icbv9uU7fvDLpo3eLhHtnq5tvZGS7ZoExDwQkq7a9xtmCA0zfjdwySgoEVCJflw6N3JqOa+xn1npLYe+9bcxZyxMDGqtOREA+EJFVTCDDiW7kcooMhVhpbLY2OzDQ==',key_name='tempest-keypair-1648743256',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:40:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c6d2ded0b1d4af09f1e05582bcbd3ae',ramdisk_id='',reservation_id='r-wi43mzk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1164383705',owner_user_name='tempest-AttachVolumeNegativeTest-1164383705-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:40:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ffddfc972374f6aa7d81288d34690cf',uuid=727cdc17-f58c-4cfc-a00c-d4651dc1e9eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57183466-2952-4bd9-b1a5-35e9bb976887", "address": "fa:16:3e:27:3a:ad", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57183466-29", "ovs_interfaceid": "57183466-2952-4bd9-b1a5-35e9bb976887", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:43:46 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-e1ca64c9-a541-4338-a882-c1af112f4eba tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Converting VIF {"id": "57183466-2952-4bd9-b1a5-35e9bb976887", "address": "fa:16:3e:27:3a:ad", "network": {"id": "3e1f6a20-5316-4c49-93a5-deabb70d8608", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1501022114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c6d2ded0b1d4af09f1e05582bcbd3ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57183466-29", "ovs_interfaceid": "57183466-2952-4bd9-b1a5-35e9bb976887", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:43:46 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-e1ca64c9-a541-4338-a882-c1af112f4eba tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:3a:ad,bridge_name='br-int',has_traffic_filtering=True,id=57183466-2952-4bd9-b1a5-35e9bb976887,network=Network(3e1f6a20-5316-4c49-93a5-deabb70d8608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57183466-29') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:43:46 user nova-compute[74821]: DEBUG os_vif [None req-e1ca64c9-a541-4338-a882-c1af112f4eba tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:3a:ad,bridge_name='br-int',has_traffic_filtering=True,id=57183466-2952-4bd9-b1a5-35e9bb976887,network=Network(3e1f6a20-5316-4c49-93a5-deabb70d8608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57183466-29') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:43:46 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:46 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57183466-29, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:43:46 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:46 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:43:46 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:46 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8cac1e50-e0f1-41d0-937f-edcfb70b6c80) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:43:46 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:46 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:43:46 user nova-compute[74821]: INFO os_vif [None req-e1ca64c9-a541-4338-a882-c1af112f4eba tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:3a:ad,bridge_name='br-int',has_traffic_filtering=True,id=57183466-2952-4bd9-b1a5-35e9bb976887,network=Network(3e1f6a20-5316-4c49-93a5-deabb70d8608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57183466-29')
Nov 06 13:43:46 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-e1ca64c9-a541-4338-a882-c1af112f4eba tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Deleting instance files /opt/stack/data/nova/instances/727cdc17-f58c-4cfc-a00c-d4651dc1e9eb_del
Nov 06 13:43:46 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-e1ca64c9-a541-4338-a882-c1af112f4eba tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Deletion of /opt/stack/data/nova/instances/727cdc17-f58c-4cfc-a00c-d4651dc1e9eb_del complete
Nov 06 13:43:46 user nova-compute[74821]: INFO nova.compute.manager [None req-e1ca64c9-a541-4338-a882-c1af112f4eba tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 06 13:43:46 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-e1ca64c9-a541-4338-a882-c1af112f4eba tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:43:46 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:43:46 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:43:47 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:43:47 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Took 0.88 seconds to deallocate network for instance.
Nov 06 13:43:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e1ca64c9-a541-4338-a882-c1af112f4eba tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:43:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e1ca64c9-a541-4338-a882-c1af112f4eba tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:43:47 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-e1ca64c9-a541-4338-a882-c1af112f4eba tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:43:47 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-e1ca64c9-a541-4338-a882-c1af112f4eba tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:43:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e1ca64c9-a541-4338-a882-c1af112f4eba tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.278s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:43:47 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-e1ca64c9-a541-4338-a882-c1af112f4eba tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Deleted allocations for instance 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb
Nov 06 13:43:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-e1ca64c9-a541-4338-a882-c1af112f4eba tempest-AttachVolumeNegativeTest-1164383705 tempest-AttachVolumeNegativeTest-1164383705-project-member] Lock "727cdc17-f58c-4cfc-a00c-d4651dc1e9eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.307s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:43:48 user nova-compute[74821]: DEBUG nova.compute.manager [req-b02df0f0-d0e7-4535-81c3-ed120118474e req-9d4829a4-92c8-417a-aa26-fd8c40db3e9d service nova] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Received event network-vif-plugged-57183466-2952-4bd9-b1a5-35e9bb976887 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:43:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b02df0f0-d0e7-4535-81c3-ed120118474e req-9d4829a4-92c8-417a-aa26-fd8c40db3e9d service nova] Acquiring lock "727cdc17-f58c-4cfc-a00c-d4651dc1e9eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:43:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b02df0f0-d0e7-4535-81c3-ed120118474e req-9d4829a4-92c8-417a-aa26-fd8c40db3e9d service nova] Lock "727cdc17-f58c-4cfc-a00c-d4651dc1e9eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:43:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b02df0f0-d0e7-4535-81c3-ed120118474e req-9d4829a4-92c8-417a-aa26-fd8c40db3e9d service nova] Lock "727cdc17-f58c-4cfc-a00c-d4651dc1e9eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:43:48 user nova-compute[74821]: DEBUG nova.compute.manager [req-b02df0f0-d0e7-4535-81c3-ed120118474e req-9d4829a4-92c8-417a-aa26-fd8c40db3e9d service nova] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] No waiting events found dispatching network-vif-plugged-57183466-2952-4bd9-b1a5-35e9bb976887 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:43:48 user nova-compute[74821]: WARNING nova.compute.manager [req-b02df0f0-d0e7-4535-81c3-ed120118474e req-9d4829a4-92c8-417a-aa26-fd8c40db3e9d service nova] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Received unexpected event network-vif-plugged-57183466-2952-4bd9-b1a5-35e9bb976887 for instance with vm_state deleted and task_state None.
Nov 06 13:43:48 user nova-compute[74821]: DEBUG nova.compute.manager [req-b02df0f0-d0e7-4535-81c3-ed120118474e req-9d4829a4-92c8-417a-aa26-fd8c40db3e9d service nova] [instance: 727cdc17-f58c-4cfc-a00c-d4651dc1e9eb] Received event network-vif-deleted-57183466-2952-4bd9-b1a5-35e9bb976887 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:43:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Acquiring lock "db04d895-338b-46fb-af08-779ad5d1181d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:43:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "db04d895-338b-46fb-af08-779ad5d1181d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:43:48 user nova-compute[74821]: DEBUG nova.objects.instance [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lazy-loading 'flavor' on Instance uuid db04d895-338b-46fb-af08-779ad5d1181d {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:43:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "db04d895-338b-46fb-af08-779ad5d1181d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:43:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Acquiring lock "db04d895-338b-46fb-af08-779ad5d1181d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:43:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "db04d895-338b-46fb-af08-779ad5d1181d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:43:48 user nova-compute[74821]: INFO nova.compute.manager [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Attaching volume f12b4b55-8dba-48a6-8e37-bae7a0df441f to /dev/vdb
Nov 06 13:43:48 user nova-compute[74821]: DEBUG os_brick.utils [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:43:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7b3577-89e1-448d-bff3-81c29b8216f5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19ea2be-3c85-4ada-b622-6a70a521dbc9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bd100a-fd2e-4034-aa62-72a8b162f122]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[378ef7ae-f9fb-49b4-a271-58260dfe2db7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:43:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:43:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:48 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:43:48 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:43:48 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2cb55a-868f-44f4-8148-581ade0f20f6]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:43:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:43:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:43:48 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:43:48 user nova-compute[74821]: DEBUG os_brick.utils [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:43:48 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Updating existing volume attachment record: 3c8ed85e-1dcb-4d1d-a15b-46e86c8c7ef5 {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:43:49 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:43:49 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:43:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-c3293c45-e843-4d6b-bc15-a10010a24ea6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:43:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-c3293c45-e843-4d6b-bc15-a10010a24ea6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:43:50 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:43:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:50 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Updating instance_info_cache with network_info: [{"id": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "address": "fa:16:3e:87:40:ab", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da3ffbf-3f", "ovs_interfaceid": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:43:50 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-c3293c45-e843-4d6b-bc15-a10010a24ea6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:43:50 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:43:50 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:43:50 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:43:51 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2f83bd7d-eb28-4dec-96e2-207021c18498 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:43:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2f83bd7d-eb28-4dec-96e2-207021c18498 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:43:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2f83bd7d-eb28-4dec-96e2-207021c18498 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:43:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2f83bd7d-eb28-4dec-96e2-207021c18498 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:43:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2f83bd7d-eb28-4dec-96e2-207021c18498 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:43:52 user nova-compute[74821]: INFO nova.compute.manager [None req-2f83bd7d-eb28-4dec-96e2-207021c18498 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Terminating instance
Nov 06 13:43:52 user nova-compute[74821]: DEBUG nova.compute.manager [None req-2f83bd7d-eb28-4dec-96e2-207021c18498 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:43:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-815f6a69-bda2-43bf-b83c-618ddf59805e req-5d2e6c0d-1035-4d02-aaa4-400b3416a484 service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Received event network-vif-unplugged-f0259675-f417-4927-993f-769bab8f0086 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:43:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-815f6a69-bda2-43bf-b83c-618ddf59805e req-5d2e6c0d-1035-4d02-aaa4-400b3416a484 service nova] Acquiring lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:43:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-815f6a69-bda2-43bf-b83c-618ddf59805e req-5d2e6c0d-1035-4d02-aaa4-400b3416a484 service nova] Lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:43:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-815f6a69-bda2-43bf-b83c-618ddf59805e req-5d2e6c0d-1035-4d02-aaa4-400b3416a484 service nova] Lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:43:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-815f6a69-bda2-43bf-b83c-618ddf59805e req-5d2e6c0d-1035-4d02-aaa4-400b3416a484 service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] No waiting events found dispatching network-vif-unplugged-f0259675-f417-4927-993f-769bab8f0086 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:43:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-815f6a69-bda2-43bf-b83c-618ddf59805e req-5d2e6c0d-1035-4d02-aaa4-400b3416a484 service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Received event network-vif-unplugged-f0259675-f417-4927-993f-769bab8f0086 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:43:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:52 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Instance destroyed successfully.
Nov 06 13:43:52 user nova-compute[74821]: DEBUG nova.objects.instance [None req-2f83bd7d-eb28-4dec-96e2-207021c18498 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lazy-loading 'resources' on Instance uuid 929e1e7d-3abf-4c2f-b792-16b0ef970d88 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:43:52 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-2f83bd7d-eb28-4dec-96e2-207021c18498 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:38:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-584527761',display_name='tempest-TestMinimumBasicScenario-server-584527761',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-584527761',id=44,image_ref='21b25f4e-5a63-4244-acb3-f39a4c13700d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJy0BO/dDw3FKfQJnWRxfcEU1+xWCTLEWzSYIFWI6XGAnsTY2LNSK10eN3A97l8XSNFtymVwEeQfrelcSe6wBru5Hleo7BiT2Og49tPTmaLlpCAr/OR2LCBG7D543Fr1Ew==',key_name='tempest-TestMinimumBasicScenario-1166531264',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:38:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2772db4aac63412fb8cfe945c89f7156',ramdisk_id='',reservation_id='r-x6kbq8o3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='21b25f4e-5a63-4244-acb3-f39a4c13700d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1779731878',owner_user_name='tempest-TestMinimumBasicScenario-1779731878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:41:04Z,user_data=None,user_id='19e457098f3242979db3fc25390965a4',uuid=929e1e7d-3abf-4c2f-b792-16b0ef970d88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0259675-f417-4927-993f-769bab8f0086", "address": "fa:16:3e:de:27:55", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0259675-f4", "ovs_interfaceid": "f0259675-f417-4927-993f-769bab8f0086", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:43:52 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-2f83bd7d-eb28-4dec-96e2-207021c18498 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Converting VIF {"id": "f0259675-f417-4927-993f-769bab8f0086", "address": "fa:16:3e:de:27:55", "network": {"id": "57870f63-b015-4453-ae32-18f642d7c4b0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-838963342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2772db4aac63412fb8cfe945c89f7156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0259675-f4", "ovs_interfaceid": "f0259675-f417-4927-993f-769bab8f0086", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:43:52 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-2f83bd7d-eb28-4dec-96e2-207021c18498 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:27:55,bridge_name='br-int',has_traffic_filtering=True,id=f0259675-f417-4927-993f-769bab8f0086,network=Network(57870f63-b015-4453-ae32-18f642d7c4b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0259675-f4') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:43:52 user nova-compute[74821]: DEBUG os_vif [None req-2f83bd7d-eb28-4dec-96e2-207021c18498 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:27:55,bridge_name='br-int',has_traffic_filtering=True,id=f0259675-f417-4927-993f-769bab8f0086,network=Network(57870f63-b015-4453-ae32-18f642d7c4b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0259675-f4') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:43:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0259675-f4, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:43:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:43:52 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:43:52 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:43:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=549018e4-3396-47d3-a2b1-845ade0fbca1) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:43:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:52 user nova-compute[74821]: INFO os_vif [None req-2f83bd7d-eb28-4dec-96e2-207021c18498 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:27:55,bridge_name='br-int',has_traffic_filtering=True,id=f0259675-f417-4927-993f-769bab8f0086,network=Network(57870f63-b015-4453-ae32-18f642d7c4b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0259675-f4')
Nov 06 13:43:52 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-2f83bd7d-eb28-4dec-96e2-207021c18498 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Deleting instance files /opt/stack/data/nova/instances/929e1e7d-3abf-4c2f-b792-16b0ef970d88_del
Nov 06 13:43:52 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-2f83bd7d-eb28-4dec-96e2-207021c18498 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Deletion of /opt/stack/data/nova/instances/929e1e7d-3abf-4c2f-b792-16b0ef970d88_del complete
Nov 06 13:43:53 user nova-compute[74821]: INFO nova.compute.manager [None req-2f83bd7d-eb28-4dec-96e2-207021c18498 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 06 13:43:53 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-2f83bd7d-eb28-4dec-96e2-207021c18498 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:43:53 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:43:53 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:43:53 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:43:53 user nova-compute[74821]: DEBUG nova.compute.manager [req-7f9d0584-35c6-4530-81d8-0d4ea75725cb req-c1032785-e87d-4336-8d93-69a1951204c7 service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Received event network-vif-deleted-f0259675-f417-4927-993f-769bab8f0086 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:43:53 user nova-compute[74821]: INFO nova.compute.manager [req-7f9d0584-35c6-4530-81d8-0d4ea75725cb req-c1032785-e87d-4336-8d93-69a1951204c7 service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Neutron deleted interface f0259675-f417-4927-993f-769bab8f0086; detaching it from the instance and deleting it from the info cache
Nov 06 13:43:53 user nova-compute[74821]: DEBUG nova.network.neutron [req-7f9d0584-35c6-4530-81d8-0d4ea75725cb req-c1032785-e87d-4336-8d93-69a1951204c7 service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:43:53 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Took 0.52 seconds to deallocate network for instance.
Nov 06 13:43:53 user nova-compute[74821]: DEBUG nova.compute.manager [req-7f9d0584-35c6-4530-81d8-0d4ea75725cb req-c1032785-e87d-4336-8d93-69a1951204c7 service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Detach interface failed, port_id=f0259675-f417-4927-993f-769bab8f0086, reason: Instance 929e1e7d-3abf-4c2f-b792-16b0ef970d88 could not be found. {{(pid=74821) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 13:43:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2f83bd7d-eb28-4dec-96e2-207021c18498 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:43:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2f83bd7d-eb28-4dec-96e2-207021c18498 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:43:53 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-2f83bd7d-eb28-4dec-96e2-207021c18498 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:43:53 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-2f83bd7d-eb28-4dec-96e2-207021c18498 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:43:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2f83bd7d-eb28-4dec-96e2-207021c18498 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.179s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:43:53 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-2f83bd7d-eb28-4dec-96e2-207021c18498 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Deleted allocations for instance 929e1e7d-3abf-4c2f-b792-16b0ef970d88
Nov 06 13:43:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2f83bd7d-eb28-4dec-96e2-207021c18498 tempest-TestMinimumBasicScenario-1779731878 tempest-TestMinimumBasicScenario-1779731878-project-member] Lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.723s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:43:53 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:43:54 user nova-compute[74821]: DEBUG nova.compute.manager [req-9ec67bb7-38e9-4521-870c-0ee37dfe93d9 req-064ac823-02b0-417f-b690-d674656b065c service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Received event network-vif-plugged-f0259675-f417-4927-993f-769bab8f0086 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:43:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-9ec67bb7-38e9-4521-870c-0ee37dfe93d9 req-064ac823-02b0-417f-b690-d674656b065c service nova] Acquiring lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:43:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-9ec67bb7-38e9-4521-870c-0ee37dfe93d9 req-064ac823-02b0-417f-b690-d674656b065c service nova] Lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:43:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-9ec67bb7-38e9-4521-870c-0ee37dfe93d9 req-064ac823-02b0-417f-b690-d674656b065c service nova] Lock "929e1e7d-3abf-4c2f-b792-16b0ef970d88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:43:54 user nova-compute[74821]: DEBUG nova.compute.manager [req-9ec67bb7-38e9-4521-870c-0ee37dfe93d9 req-064ac823-02b0-417f-b690-d674656b065c service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] No waiting events found dispatching network-vif-plugged-f0259675-f417-4927-993f-769bab8f0086 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:43:54 user nova-compute[74821]: WARNING nova.compute.manager [req-9ec67bb7-38e9-4521-870c-0ee37dfe93d9 req-064ac823-02b0-417f-b690-d674656b065c service nova] [instance: 929e1e7d-3abf-4c2f-b792-16b0ef970d88] Received unexpected event network-vif-plugged-f0259675-f417-4927-993f-769bab8f0086 for instance with vm_state deleted and task_state None.
Nov 06 13:43:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:55 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:43:56 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:43:56 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:43:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:43:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:43:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:43:56 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:43:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:43:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:43:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:43:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:43:58 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:43:58 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:43:58 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:43:58 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=8552MB free_disk=25.08194351196289GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:43:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:43:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:43:58 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance db04d895-338b-46fb-af08-779ad5d1181d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:43:58 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance c3293c45-e843-4d6b-bc15-a10010a24ea6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:43:58 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 754e8314-2f91-4aa4-83d0-2ce9b94db4cc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:43:58 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:43:58 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:43:58 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:43:58 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:43:58 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:43:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.259s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:44:00 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:44:03 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:44:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:44:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:44:09 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQaxsHKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:44:10 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:44:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:44:10 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:44:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:44:10 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:44:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b116adc-3e80-41b1-8f77-6476b9022a05]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:44:10 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1479c33-f194-4a7c-ba93-561d8b7f6610]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f] added
Nov 06 13:44:10 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c08d07c-0571-470c-9f79-a0982a4f6fb2]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f092ad5-bd02-417a-90d6-ec0f68cd2cbf]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dQaxsHKv {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dQaxsHKv" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f90641-2399-4c91-a762-9d37f603ee39]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dQaxsHKv'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d7c25f-b955-4f4b-a5a4-701ec0420848]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed12409-c505-4bca-aaea-5aea71d2c351]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:44:10 user nova-compute[74821]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:44:10 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:44:10 user nova-compute[74821]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:44:10 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfc820a-7092-40fb-ac5e-4642abaaf821]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f, portal: 172.16.0.220,3260]
Nov 06 13:44:10 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f, portal: 172.16.0.220,3260] successful.
Nov 06 13:44:10 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e58f1e-a8db-4130-8b33-76d2e1730677]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[29937efb-3cc1-4fa7-b265-ddb54d59621e]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:44:10 user nova-compute[74821]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:44:10 user nova-compute[74821]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f (non-flash)
Nov 06 13:44:10 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:44:10 user nova-compute[74821]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:44:10 user nova-compute[74821]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f (non-flash)
Nov 06 13:44:10 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[22998f48-2bd5-4a46-9852-8a516a0a6b90]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:44:10 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQaxsHKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:44:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:44:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26665386439313861', 'path': '/dev/sdd'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:44:11 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665386439313861', 'path': '/dev/sdd'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:44:11 user nova-compute[74821]: DEBUG nova.objects.instance [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lazy-loading 'flavor' on Instance uuid db04d895-338b-46fb-af08-779ad5d1181d {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:44:11 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 13:44:11 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:44:11 user nova-compute[74821]:   <source dev="/dev/sdd"/>
Nov 06 13:44:11 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:44:11 user nova-compute[74821]:   <serial>f12b4b55-8dba-48a6-8e37-bae7a0df441f</serial>
Nov 06 13:44:11 user nova-compute[74821]: </disk>
Nov 06 13:44:11 user nova-compute[74821]:  {{(pid=74821) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 13:44:12 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:44:12 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:44:12 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] No VIF found with MAC fa:16:3e:46:dc:53, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:44:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-02f67614-f514-4857-84b0-3bf2233993cb tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "db04d895-338b-46fb-af08-779ad5d1181d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.676s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:44:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:44:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:44:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:44:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:44:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:44:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:44:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Acquiring lock "db04d895-338b-46fb-af08-779ad5d1181d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:44:14 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "db04d895-338b-46fb-af08-779ad5d1181d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:44:14 user nova-compute[74821]: INFO nova.compute.manager [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Detaching volume f12b4b55-8dba-48a6-8e37-bae7a0df441f
Nov 06 13:44:14 user nova-compute[74821]: INFO nova.virt.block_device [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Attempting to driver detach volume f12b4b55-8dba-48a6-8e37-bae7a0df441f from mountpoint /dev/vdb
Nov 06 13:44:14 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Attempting to detach device vdb from instance db04d895-338b-46fb-af08-779ad5d1181d from the persistent domain config. {{(pid=74821) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 13:44:14 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:44:14 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:44:14 user nova-compute[74821]:   <source dev="/dev/sdd"/>
Nov 06 13:44:14 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:44:14 user nova-compute[74821]:   <serial>f12b4b55-8dba-48a6-8e37-bae7a0df441f</serial>
Nov 06 13:44:14 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:44:14 user nova-compute[74821]: </disk>
Nov 06 13:44:14 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:44:14 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Successfully detached device vdb from instance db04d895-338b-46fb-af08-779ad5d1181d from the persistent domain config.
Nov 06 13:44:14 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance db04d895-338b-46fb-af08-779ad5d1181d from the live domain config. {{(pid=74821) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 13:44:14 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:44:14 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:44:14 user nova-compute[74821]:   <source dev="/dev/sdd"/>
Nov 06 13:44:14 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:44:14 user nova-compute[74821]:   <serial>f12b4b55-8dba-48a6-8e37-bae7a0df441f</serial>
Nov 06 13:44:14 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:44:14 user nova-compute[74821]: </disk>
Nov 06 13:44:14 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:44:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:44:15 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance db04d895-338b-46fb-af08-779ad5d1181d {{(pid=74821) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 13:44:18 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:44:23 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:44:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:44:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:44:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:44:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:44:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:44:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:44:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "754e8314-2f91-4aa4-83d0-2ce9b94db4cc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:44:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "754e8314-2f91-4aa4-83d0-2ce9b94db4cc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:44:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "754e8314-2f91-4aa4-83d0-2ce9b94db4cc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:44:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "754e8314-2f91-4aa4-83d0-2ce9b94db4cc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:44:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "754e8314-2f91-4aa4-83d0-2ce9b94db4cc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:44:28 user nova-compute[74821]: INFO nova.compute.manager [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Terminating instance
Nov 06 13:44:28 user nova-compute[74821]: DEBUG nova.compute.manager [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:44:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:44:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:44:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:44:28 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG nova.compute.manager [req-740e062a-c913-4487-a753-adedd331c5bb req-52ff72b8-dfaa-4bc6-9f46-6edb048ddbc5 service nova] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Received event network-vif-unplugged-6c14439c-9307-476c-bb5a-484f35b38659 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-740e062a-c913-4487-a753-adedd331c5bb req-52ff72b8-dfaa-4bc6-9f46-6edb048ddbc5 service nova] Acquiring lock "754e8314-2f91-4aa4-83d0-2ce9b94db4cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-740e062a-c913-4487-a753-adedd331c5bb req-52ff72b8-dfaa-4bc6-9f46-6edb048ddbc5 service nova] Lock "754e8314-2f91-4aa4-83d0-2ce9b94db4cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-740e062a-c913-4487-a753-adedd331c5bb req-52ff72b8-dfaa-4bc6-9f46-6edb048ddbc5 service nova] Lock "754e8314-2f91-4aa4-83d0-2ce9b94db4cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG nova.compute.manager [req-740e062a-c913-4487-a753-adedd331c5bb req-52ff72b8-dfaa-4bc6-9f46-6edb048ddbc5 service nova] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] No waiting events found dispatching network-vif-unplugged-6c14439c-9307-476c-bb5a-484f35b38659 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG nova.compute.manager [req-740e062a-c913-4487-a753-adedd331c5bb req-52ff72b8-dfaa-4bc6-9f46-6edb048ddbc5 service nova] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Received event network-vif-unplugged-6c14439c-9307-476c-bb5a-484f35b38659 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:44:29 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Instance destroyed successfully.
Nov 06 13:44:29 user nova-compute[74821]: DEBUG nova.objects.instance [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lazy-loading 'resources' on Instance uuid 754e8314-2f91-4aa4-83d0-2ce9b94db4cc {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:39:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1099211257',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1099211257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1099211257',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGnq5y/MXe6UZrW1LNCywluTqthvaFWeogiAwRexvSjfpgmSSwLmZZZCaPd4/pdZhObjp7zR0lMzi3/WgjbTBYbir+OrXV9P+2/ciUapjpdFzriUXRwpwUH6gBEDYplWA==',key_name='tempest-keypair-1193584422',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:39:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c8e811a3a30417a8dc6ccad03f2f8e0',ramdisk_id='',reservation_id='r-1b0whqts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1930796442',owner_user_name='tempest-TestVolumeBootPattern-1930796442-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:39:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bb6a168d90a4795a72b8ac69eeadcc9',uuid=754e8314-2f91-4aa4-83d0-2ce9b94db4cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c14439c-9307-476c-bb5a-484f35b38659", "address": "fa:16:3e:e4:d9:3e", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c14439c-93", "ovs_interfaceid": "6c14439c-9307-476c-bb5a-484f35b38659", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Converting VIF {"id": "6c14439c-9307-476c-bb5a-484f35b38659", "address": "fa:16:3e:e4:d9:3e", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c14439c-93", "ovs_interfaceid": "6c14439c-9307-476c-bb5a-484f35b38659", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:d9:3e,bridge_name='br-int',has_traffic_filtering=True,id=6c14439c-9307-476c-bb5a-484f35b38659,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c14439c-93') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG os_vif [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:d9:3e,bridge_name='br-int',has_traffic_filtering=True,id=6c14439c-9307-476c-bb5a-484f35b38659,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c14439c-93') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c14439c-93, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d14d6ff-5585-4e71-b724-451f7b3be4e4) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:44:29 user nova-compute[74821]: INFO os_vif [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:d9:3e,bridge_name='br-int',has_traffic_filtering=True,id=6c14439c-9307-476c-bb5a-484f35b38659,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c14439c-93')
Nov 06 13:44:29 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cbXQAMsg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:44:29 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:44:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d23669e-37e9-4590-9114-43320ac3fbc5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:44:29 user nova-compute[74821]: No targets found.
Nov 06 13:44:29 user nova-compute[74821]: iSNS:
Nov 06 13:44:29 user nova-compute[74821]: No targets found.
Nov 06 13:44:29 user nova-compute[74821]: STATIC:
Nov 06 13:44:29 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4
Nov 06 13:44:29 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:44:29 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:44:29 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07
Nov 06 13:44:29 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:44:29 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:44:29 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f
Nov 06 13:44:29 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:44:29 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:44:29 user nova-compute[74821]: FIRMWARE:
Nov 06 13:44:29 user nova-compute[74821]: No targets found.
Nov 06 13:44:29 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:44:29 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:44:29 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d20448-6b01-4fb0-99fa-ddfceda3818e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d4fff7-c748-4c19-acb1-159189df2b20]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:44:29 user nova-compute[74821]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:44:29 user nova-compute[74821]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f (non-flash)
Nov 06 13:44:29 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 (non-flash)
Nov 06 13:44:29 user nova-compute[74821]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:44:29 user nova-compute[74821]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f (non-flash)
Nov 06 13:44:29 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e40589990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07'): ({'sdb'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Removing single pathed devices sdb {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[992ae452-9c1c-415e-b229-156ed7f83e39]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[76657a3c-b4ee-448b-bf1f-2fdf4a0ea444]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Flushing IO for device /dev/sdb {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a638fe13-c7d9-4e97-b82c-553140dbd193]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.237s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04e4196-2592-4d84-a808-4fdf12507302]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] SCSI volumes sdb have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23866333630353738', '/dev/disk/by-id/scsi-1SCST_BIO7c0c3543-8f360578cb18a2f9', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7c0c3543') {{(pid=85818) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[19457345-136e-4d2e-8bb2-42584ff5208a]: (4, None) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9ca53a-855f-4b86-892c-079869a54b5d]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:44:29 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:44:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:44:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23d2041-dad1-4eac-b278-a933e4e97017]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:44:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07, portal: 172.16.0.220,3260]
Nov 06 13:44:30 user nova-compute[74821]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07, portal: 172.16.0.220,3260] successful.
Nov 06 13:44:30 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:44:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:44:30 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f599665-77ef-4677-9f2a-a49c77df3b07 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:44:30 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3f08da-9afe-4e95-aad9-675e6e9c8501]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:44:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:44:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.497s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:44:30 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] <== disconnect_volume: return (497ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:44:30 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:44:30 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Deleting instance files /opt/stack/data/nova/instances/754e8314-2f91-4aa4-83d0-2ce9b94db4cc_del
Nov 06 13:44:30 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Deletion of /opt/stack/data/nova/instances/754e8314-2f91-4aa4-83d0-2ce9b94db4cc_del complete
Nov 06 13:44:30 user nova-compute[74821]: INFO nova.compute.manager [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 06 13:44:30 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:44:30 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:44:30 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:44:31 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:44:31 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Took 0.91 seconds to deallocate network for instance.
Nov 06 13:44:31 user nova-compute[74821]: DEBUG nova.compute.manager [req-7b6282f9-75f1-4015-a223-152a91ef0a71 req-45fd0bdd-eb86-402f-91e3-494f378f6b68 service nova] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Received event network-vif-plugged-6c14439c-9307-476c-bb5a-484f35b38659 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:44:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-7b6282f9-75f1-4015-a223-152a91ef0a71 req-45fd0bdd-eb86-402f-91e3-494f378f6b68 service nova] Acquiring lock "754e8314-2f91-4aa4-83d0-2ce9b94db4cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:44:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-7b6282f9-75f1-4015-a223-152a91ef0a71 req-45fd0bdd-eb86-402f-91e3-494f378f6b68 service nova] Lock "754e8314-2f91-4aa4-83d0-2ce9b94db4cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:44:31 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-7b6282f9-75f1-4015-a223-152a91ef0a71 req-45fd0bdd-eb86-402f-91e3-494f378f6b68 service nova] Lock "754e8314-2f91-4aa4-83d0-2ce9b94db4cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:44:31 user nova-compute[74821]: DEBUG nova.compute.manager [req-7b6282f9-75f1-4015-a223-152a91ef0a71 req-45fd0bdd-eb86-402f-91e3-494f378f6b68 service nova] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] No waiting events found dispatching network-vif-plugged-6c14439c-9307-476c-bb5a-484f35b38659 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:44:31 user nova-compute[74821]: WARNING nova.compute.manager [req-7b6282f9-75f1-4015-a223-152a91ef0a71 req-45fd0bdd-eb86-402f-91e3-494f378f6b68 service nova] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Received unexpected event network-vif-plugged-6c14439c-9307-476c-bb5a-484f35b38659 for instance with vm_state active and task_state deleting.
Nov 06 13:44:31 user nova-compute[74821]: DEBUG nova.compute.manager [req-7b6282f9-75f1-4015-a223-152a91ef0a71 req-45fd0bdd-eb86-402f-91e3-494f378f6b68 service nova] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Received event network-vif-deleted-6c14439c-9307-476c-bb5a-484f35b38659 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:44:31 user nova-compute[74821]: INFO nova.compute.manager [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Took 0.92 seconds to detach 1 volumes for instance.
Nov 06 13:44:31 user nova-compute[74821]: DEBUG nova.compute.manager [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 754e8314-2f91-4aa4-83d0-2ce9b94db4cc] Deleting volume: 1f599665-77ef-4677-9f2a-a49c77df3b07 {{(pid=74821) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 06 13:44:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:44:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:44:32 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:44:32 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:44:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:44:32 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Deleted allocations for instance 754e8314-2f91-4aa4-83d0-2ce9b94db4cc
Nov 06 13:44:32 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-1e003aa3-92e5-4de6-9508-b1a6c8ac4706 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "754e8314-2f91-4aa4-83d0-2ce9b94db4cc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.615s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:44:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:44:35 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance db04d895-338b-46fb-af08-779ad5d1181d is timed out.
Nov 06 13:44:35 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Successfully detached device vdb from instance db04d895-338b-46fb-af08-779ad5d1181d from the live domain config.
Nov 06 13:44:35 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQaxsHKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:44:35 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:44:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[20335d96-31e6-4041-a88d-5e41a19e351d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:44:35 user nova-compute[74821]: No targets found.
Nov 06 13:44:35 user nova-compute[74821]: iSNS:
Nov 06 13:44:35 user nova-compute[74821]: No targets found.
Nov 06 13:44:35 user nova-compute[74821]: STATIC:
Nov 06 13:44:35 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4
Nov 06 13:44:35 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:44:35 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:44:35 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f
Nov 06 13:44:35 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:44:35 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:44:35 user nova-compute[74821]: FIRMWARE:
Nov 06 13:44:35 user nova-compute[74821]: No targets found.
Nov 06 13:44:35 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:44:35 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:44:35 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b61acef-3bef-448a-853f-c014666870b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f5e69b-0d7d-4ff2-a128-52143833e060]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:44:35 user nova-compute[74821]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f (non-flash)
Nov 06 13:44:35 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:44:35 user nova-compute[74821]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f (non-flash)
Nov 06 13:44:35 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e40584c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f'): ({'sdd'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Removing single pathed devices sdd {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7379a72-faac-42c9-a23f-3a51ac3ab585]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9deb81-dab7-4621-bc9a-8b0a95a25439]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Flushing IO for device /dev/sdd {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b5cd10-4f4e-4392-91c6-6e546afd39c6]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[de872ca7-2fe9-4c4c-bea5-e6a329e93c43]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] SCSI volumes sdd have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d3c4aa-88b6-4ff4-aba8-5df7f67c1353]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[11083efd-c0da-413a-a245-d8fa4261a51d]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f, portal: 172.16.0.220,3260]
Nov 06 13:44:35 user nova-compute[74821]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f, portal: 172.16.0.220,3260] successful.
Nov 06 13:44:35 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f12b4b55-8dba-48a6-8e37-bae7a0df441f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7446f1b-5fcc-4ad5-99f2-d81a6b9edc16]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] <== disconnect_volume: return (279ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:44:35 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:44:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:44:36 user nova-compute[74821]: DEBUG nova.objects.instance [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lazy-loading 'flavor' on Instance uuid db04d895-338b-46fb-af08-779ad5d1181d {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:44:36 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-aabaf3a7-dc07-449e-bd08-56b69580e73c tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "db04d895-338b-46fb-af08-779ad5d1181d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.777s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:44:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:44:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:44:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:44:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:44:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:44:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:44:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:44:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:44:48 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:44:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:44:49 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:44:49 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:44:50 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Didn't find any instances for network info cache update. {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 13:44:50 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:44:52 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:44:52 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:44:52 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:44:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:44:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:44:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:44:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:44:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:44:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:44:55 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:44:55 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:44:56 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:44:56 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:44:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:44:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:44:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:44:57 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:44:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:44:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:44:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:44:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:44:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:44:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:44:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:44:57 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:44:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:44:58 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:44:58 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:44:58 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=8756MB free_disk=25.111698150634766GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:44:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:44:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:44:58 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance db04d895-338b-46fb-af08-779ad5d1181d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:44:58 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance c3293c45-e843-4d6b-bc15-a10010a24ea6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:44:58 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:44:58 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:44:58 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:44:58 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:44:58 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:44:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:44:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:45:01 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:45:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:45:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:45:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:45:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:45:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:45:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:45:08 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:45:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:45:11 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Acquiring lock "db04d895-338b-46fb-af08-779ad5d1181d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:45:11 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "db04d895-338b-46fb-af08-779ad5d1181d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:45:11 user nova-compute[74821]: DEBUG nova.objects.instance [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lazy-loading 'flavor' on Instance uuid db04d895-338b-46fb-af08-779ad5d1181d {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:45:11 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "db04d895-338b-46fb-af08-779ad5d1181d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:45:11 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Acquiring lock "db04d895-338b-46fb-af08-779ad5d1181d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:45:11 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "db04d895-338b-46fb-af08-779ad5d1181d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:45:11 user nova-compute[74821]: INFO nova.compute.manager [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Attaching volume 9fe2f814-b670-47e7-a56b-4c36dab41047 to /dev/vdb
Nov 06 13:45:11 user nova-compute[74821]: DEBUG os_brick.utils [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:45:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:45:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:45:11 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2702cd91-6ee9-4b82-b9ae-2c14986fafc3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:45:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:45:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:45:11 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ac78d4-5fa5-433c-a180-16a1df89155c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:45:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:45:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:45:11 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7cd12c-bc19-4434-b98a-9c5ce1a1c01d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:45:11 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63fbb5a-dbdc-4dc8-af3d-348d00ab10b5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:45:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:45:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:45:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:45:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:45:11 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:45:11 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:45:11 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9b895d-df2b-42fc-92e2-fd8d28e38e5a]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:45:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:45:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:45:11 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:45:11 user nova-compute[74821]: DEBUG os_brick.utils [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:45:11 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Updating existing volume attachment record: c147f5d4-0b1a-4c8a-946b-3ee3875a5bee {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:45:13 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:45:14 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:45:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:45:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:45:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:45:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "c3293c45-e843-4d6b-bc15-a10010a24ea6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:45:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:45:21 user nova-compute[74821]: INFO nova.compute.manager [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Detaching volume 6e8f395f-5111-45d2-8cb4-6a2aced821d4
Nov 06 13:45:21 user nova-compute[74821]: INFO nova.virt.block_device [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Attempting to driver detach volume 6e8f395f-5111-45d2-8cb4-6a2aced821d4 from mountpoint /dev/vdb
Nov 06 13:45:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Attempting to detach device vdb from instance c3293c45-e843-4d6b-bc15-a10010a24ea6 from the persistent domain config. {{(pid=74821) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 13:45:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:45:21 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:45:21 user nova-compute[74821]:   <source dev="/dev/sdc"/>
Nov 06 13:45:21 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:45:21 user nova-compute[74821]:   <serial>6e8f395f-5111-45d2-8cb4-6a2aced821d4</serial>
Nov 06 13:45:21 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 06 13:45:21 user nova-compute[74821]: </disk>
Nov 06 13:45:21 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:45:21 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Successfully detached device vdb from instance c3293c45-e843-4d6b-bc15-a10010a24ea6 from the persistent domain config.
Nov 06 13:45:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c3293c45-e843-4d6b-bc15-a10010a24ea6 from the live domain config. {{(pid=74821) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 13:45:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:45:21 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:45:21 user nova-compute[74821]:   <source dev="/dev/sdc"/>
Nov 06 13:45:21 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:45:21 user nova-compute[74821]:   <serial>6e8f395f-5111-45d2-8cb4-6a2aced821d4</serial>
Nov 06 13:45:21 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 06 13:45:21 user nova-compute[74821]: </disk>
Nov 06 13:45:21 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:45:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c3293c45-e843-4d6b-bc15-a10010a24ea6 {{(pid=74821) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 13:45:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:45:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:45:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:45:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rgmTolMB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:45:36 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:45:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:45:36 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:45:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:45:36 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:45:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53eb5ae-3189-42df-aa1f-a43a55afcb2f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:45:36 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd271900-74b7-43d7-9cd5-7c38edb64b93]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047] added
Nov 06 13:45:36 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[587ab572-5735-4975-87af-1ec7e0a721a8]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f2e147-6f30-41f0-980d-84b8b5f5bc00]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rgmTolMB {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rgmTolMB" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1950a104-f9ff-4cc7-9cf4-e2c68fe4c839]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rgmTolMB'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e5da39-b3ab-4eed-9732-fd923a17b637]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c4505c-0e41-4307-ad2a-8722114a9ef5]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:45:36 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:45:36 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0dd21db-3493-4898-b553-e6e538408d41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047, portal: 172.16.0.220,3260]
Nov 06 13:45:36 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047, portal: 172.16.0.220,3260] successful.
Nov 06 13:45:36 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d281cf64-98bb-4003-a872-e1f060a0d431]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52696f5-49f9-472d-840b-7b1f24fe1c78]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:45:36 user nova-compute[74821]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047 (non-flash)
Nov 06 13:45:36 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:45:36 user nova-compute[74821]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047 (non-flash)
Nov 06 13:45:36 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[be78286a-aabc-4eed-80a2-f9b357770465]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:45:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rgmTolMB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:45:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:45:37 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23738346238323034', 'path': '/dev/sdb'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:45:37 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738346238323034', 'path': '/dev/sdb'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:45:37 user nova-compute[74821]: DEBUG nova.objects.instance [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lazy-loading 'flavor' on Instance uuid db04d895-338b-46fb-af08-779ad5d1181d {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:45:37 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 13:45:37 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:45:37 user nova-compute[74821]:   <source dev="/dev/sdb"/>
Nov 06 13:45:37 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:45:37 user nova-compute[74821]:   <serial>9fe2f814-b670-47e7-a56b-4c36dab41047</serial>
Nov 06 13:45:37 user nova-compute[74821]: </disk>
Nov 06 13:45:37 user nova-compute[74821]:  {{(pid=74821) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 13:45:37 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:45:37 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:45:37 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] No VIF found with MAC fa:16:3e:46:dc:53, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:45:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-fe39f199-d14d-4bb5-aaee-d71fd706a4ff tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "db04d895-338b-46fb-af08-779ad5d1181d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.711s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:45:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:45:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:45:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Acquiring lock "db04d895-338b-46fb-af08-779ad5d1181d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:45:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "db04d895-338b-46fb-af08-779ad5d1181d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:45:40 user nova-compute[74821]: INFO nova.compute.manager [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Detaching volume 9fe2f814-b670-47e7-a56b-4c36dab41047
Nov 06 13:45:40 user nova-compute[74821]: INFO nova.virt.block_device [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Attempting to driver detach volume 9fe2f814-b670-47e7-a56b-4c36dab41047 from mountpoint /dev/vdb
Nov 06 13:45:40 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Attempting to detach device vdb from instance db04d895-338b-46fb-af08-779ad5d1181d from the persistent domain config. {{(pid=74821) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 13:45:40 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:45:40 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:45:40 user nova-compute[74821]:   <source dev="/dev/sdb"/>
Nov 06 13:45:40 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:45:40 user nova-compute[74821]:   <serial>9fe2f814-b670-47e7-a56b-4c36dab41047</serial>
Nov 06 13:45:40 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:45:40 user nova-compute[74821]: </disk>
Nov 06 13:45:40 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:45:40 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Successfully detached device vdb from instance db04d895-338b-46fb-af08-779ad5d1181d from the persistent domain config.
Nov 06 13:45:40 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance db04d895-338b-46fb-af08-779ad5d1181d from the live domain config. {{(pid=74821) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 13:45:40 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:45:40 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:45:40 user nova-compute[74821]:   <source dev="/dev/sdb"/>
Nov 06 13:45:40 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:45:40 user nova-compute[74821]:   <serial>9fe2f814-b670-47e7-a56b-4c36dab41047</serial>
Nov 06 13:45:40 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:45:40 user nova-compute[74821]: </disk>
Nov 06 13:45:40 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:45:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance db04d895-338b-46fb-af08-779ad5d1181d {{(pid=74821) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 13:45:41 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c3293c45-e843-4d6b-bc15-a10010a24ea6 is timed out.
Nov 06 13:45:41 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Successfully detached device vdb from instance c3293c45-e843-4d6b-bc15-a10010a24ea6 from the live domain config.
Nov 06 13:45:41 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:45:41 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvPQSnqr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:45:41 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:45:41 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:45:41 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:45:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:45:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:45:41 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e95a27-c66f-4291-8b2b-a7b2a48b361a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:45:41 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:45:41 user nova-compute[74821]: No targets found.
Nov 06 13:45:41 user nova-compute[74821]: iSNS:
Nov 06 13:45:41 user nova-compute[74821]: No targets found.
Nov 06 13:45:41 user nova-compute[74821]: STATIC:
Nov 06 13:45:41 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4
Nov 06 13:45:41 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:45:41 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:45:41 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047
Nov 06 13:45:41 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:45:41 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:45:41 user nova-compute[74821]: FIRMWARE:
Nov 06 13:45:41 user nova-compute[74821]: No targets found.
Nov 06 13:45:41 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:45:41 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:45:41 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:45:41 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:45:41 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:45:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:45:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:45:41 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b13ce0-0862-462d-bd50-c1ef897f100c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:45:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:45:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:45:41 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc725a8f-2da6-4289-8d7c-70a75ede7062]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:45:41 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:45:41 user nova-compute[74821]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047 (non-flash)
Nov 06 13:45:41 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:45:41 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 (non-flash)
Nov 06 13:45:41 user nova-compute[74821]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047 (non-flash)
Nov 06 13:45:41 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:45:41 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e4040f400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4'): ({'sdc'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:45:41 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Removing single pathed devices sdc {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:45:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:45:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:45:41 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e741570a-efb0-45be-bbc2-d09347c8f2a9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:45:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:45:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:45:41 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e378cbfb-cec5-4189-aea1-2f2e246294cd]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:45:41 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Flushing IO for device /dev/sdc {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:45:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:45:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:45:41 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90c8a9d-b384-4070-bcde-85e367675c27]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:45:41 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:45:41 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:45:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.101s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:45:42 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5096ff29-9e8b-4475-b2dd-9f7982deb7b2]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:45:42 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:45:42 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] SCSI volumes sdc have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:45:42 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:45:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:45:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.040s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:45:42 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce71efc9-9553-4609-b160-cd94653f3ef5]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:45:42 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:45:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:45:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:45:42 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[597b54cb-ebe2-4d7a-a11e-1b4973b9ddc0]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:45:42 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4, portal: 172.16.0.220,3260]
Nov 06 13:45:42 user nova-compute[74821]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4, portal: 172.16.0.220,3260] successful.
Nov 06 13:45:42 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:45:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:45:42 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e8f395f-5111-45d2-8cb4-6a2aced821d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:45:42 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4039c6e-3967-446a-b463-9fe02b405bd5]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:45:42 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:45:42 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:45:42 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] <== disconnect_volume: return (394ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:45:42 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:45:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:45:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:45:42 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:45:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:45:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:45:42 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:45:42 user nova-compute[74821]: INFO nova.compute.claims [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Claim successful on node user
Nov 06 13:45:42 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:45:42 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:45:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.255s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:45:42 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:45:42 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:45:42 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:45:42 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:45:42 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:45:42 user nova-compute[74821]: INFO nova.virt.block_device [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Booting with volume 9600620b-087a-4abc-bee1-b4e3c18b77e8 at /dev/vda
Nov 06 13:45:43 user nova-compute[74821]: DEBUG os_brick.utils [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:45:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:45:43 user nova-compute[74821]: DEBUG nova.objects.instance [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lazy-loading 'flavor' on Instance uuid c3293c45-e843-4d6b-bc15-a10010a24ea6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:45:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:45:43 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f51c821-52e7-4f7b-a393-26ddfcd9b0ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:45:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:45:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:45:43 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b8d3b6-a663-4808-827c-a65c6f72b5c2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:45:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:45:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9a2951e4-3ca3-4583-9ed1-6c3ff9d7a202 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.912s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:45:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:45:43 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac611801-c203-4022-8c3d-151e84c77782]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:45:43 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[87dfff77-3177-4d1c-8d1f-ce224c1bf9ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:45:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:45:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:45:43 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:45:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:45:43 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:45:43 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:45:43 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b262ea-1e6e-4892-9315-f1742e9d0f6c]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:45:43 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:45:43 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:45:43 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:45:43 user nova-compute[74821]: DEBUG os_brick.utils [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:45:43 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Updating existing volume attachment record: 3f39ccb1-f65b-480e-835b-142f16d62647 {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:45:43 user nova-compute[74821]: DEBUG nova.policy [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3bb6a168d90a4795a72b8ac69eeadcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e811a3a30417a8dc6ccad03f2f8e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:45:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b1fdf534-7986-45bd-bd5b-c63aac108bc9 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "c3293c45-e843-4d6b-bc15-a10010a24ea6" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:45:43 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b1fdf534-7986-45bd-bd5b-c63aac108bc9 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:45:43 user nova-compute[74821]: DEBUG nova.compute.manager [None req-b1fdf534-7986-45bd-bd5b-c63aac108bc9 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:45:43 user nova-compute[74821]: DEBUG nova.compute.manager [None req-b1fdf534-7986-45bd-bd5b-c63aac108bc9 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74821) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 06 13:45:43 user nova-compute[74821]: DEBUG nova.objects.instance [None req-b1fdf534-7986-45bd-bd5b-c63aac108bc9 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lazy-loading 'flavor' on Instance uuid c3293c45-e843-4d6b-bc15-a10010a24ea6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:45:43 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:45:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:45:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:45:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:45:44 user nova-compute[74821]: DEBUG nova.compute.manager [req-9e7e3572-a5ba-4c3f-8029-a8a87e92a03d req-486a642f-98b7-47ee-a113-7a1119d4dca3 service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Received event network-vif-unplugged-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:45:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-9e7e3572-a5ba-4c3f-8029-a8a87e92a03d req-486a642f-98b7-47ee-a113-7a1119d4dca3 service nova] Acquiring lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:45:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-9e7e3572-a5ba-4c3f-8029-a8a87e92a03d req-486a642f-98b7-47ee-a113-7a1119d4dca3 service nova] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:45:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-9e7e3572-a5ba-4c3f-8029-a8a87e92a03d req-486a642f-98b7-47ee-a113-7a1119d4dca3 service nova] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:45:44 user nova-compute[74821]: DEBUG nova.compute.manager [req-9e7e3572-a5ba-4c3f-8029-a8a87e92a03d req-486a642f-98b7-47ee-a113-7a1119d4dca3 service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] No waiting events found dispatching network-vif-unplugged-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:45:44 user nova-compute[74821]: WARNING nova.compute.manager [req-9e7e3572-a5ba-4c3f-8029-a8a87e92a03d req-486a642f-98b7-47ee-a113-7a1119d4dca3 service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Received unexpected event network-vif-unplugged-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec for instance with vm_state active and task_state powering-off.
Nov 06 13:45:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:45:44 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Successfully created port: dd012b53-0495-40ee-a825-7dadaabe579c {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:45:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:45:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:45:44 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Instance destroyed successfully.
Nov 06 13:45:44 user nova-compute[74821]: DEBUG nova.compute.manager [None req-b1fdf534-7986-45bd-bd5b-c63aac108bc9 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:45:44 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b1fdf534-7986-45bd-bd5b-c63aac108bc9 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.061s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:45:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:45:45 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Successfully updated port: dd012b53-0495-40ee-a825-7dadaabe579c {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:45:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "refresh_cache-bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:45:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquired lock "refresh_cache-bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:45:45 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:45:45 user nova-compute[74821]: DEBUG nova.compute.manager [req-879ee821-64be-48b5-9b28-bcd4cbc2afe2 req-10a49890-c997-48e2-a6a2-b168deac7c8b service nova] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Received event network-changed-dd012b53-0495-40ee-a825-7dadaabe579c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:45:45 user nova-compute[74821]: DEBUG nova.compute.manager [req-879ee821-64be-48b5-9b28-bcd4cbc2afe2 req-10a49890-c997-48e2-a6a2-b168deac7c8b service nova] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Refreshing instance network info cache due to event network-changed-dd012b53-0495-40ee-a825-7dadaabe579c. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:45:45 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-879ee821-64be-48b5-9b28-bcd4cbc2afe2 req-10a49890-c997-48e2-a6a2-b168deac7c8b service nova] Acquiring lock "refresh_cache-bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:45:45 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:45:46 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Updating instance_info_cache with network_info: [{"id": "dd012b53-0495-40ee-a825-7dadaabe579c", "address": "fa:16:3e:c6:1e:8c", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd012b53-04", "ovs_interfaceid": "dd012b53-0495-40ee-a825-7dadaabe579c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:45:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Releasing lock "refresh_cache-bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:45:46 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Instance network_info: |[{"id": "dd012b53-0495-40ee-a825-7dadaabe579c", "address": "fa:16:3e:c6:1e:8c", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd012b53-04", "ovs_interfaceid": "dd012b53-0495-40ee-a825-7dadaabe579c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:45:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-879ee821-64be-48b5-9b28-bcd4cbc2afe2 req-10a49890-c997-48e2-a6a2-b168deac7c8b service nova] Acquired lock "refresh_cache-bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:45:46 user nova-compute[74821]: DEBUG nova.network.neutron [req-879ee821-64be-48b5-9b28-bcd4cbc2afe2 req-10a49890-c997-48e2-a6a2-b168deac7c8b service nova] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Refreshing network info cache for port dd012b53-0495-40ee-a825-7dadaabe579c {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:45:46 user nova-compute[74821]: DEBUG nova.compute.manager [req-c107fbed-baed-4c36-a6c6-70916f62393f req-83a9b3e3-26b8-492f-85ce-360cfa8bf1a7 service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Received event network-vif-plugged-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:45:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c107fbed-baed-4c36-a6c6-70916f62393f req-83a9b3e3-26b8-492f-85ce-360cfa8bf1a7 service nova] Acquiring lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:45:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c107fbed-baed-4c36-a6c6-70916f62393f req-83a9b3e3-26b8-492f-85ce-360cfa8bf1a7 service nova] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:45:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c107fbed-baed-4c36-a6c6-70916f62393f req-83a9b3e3-26b8-492f-85ce-360cfa8bf1a7 service nova] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:45:46 user nova-compute[74821]: DEBUG nova.compute.manager [req-c107fbed-baed-4c36-a6c6-70916f62393f req-83a9b3e3-26b8-492f-85ce-360cfa8bf1a7 service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] No waiting events found dispatching network-vif-plugged-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:45:46 user nova-compute[74821]: WARNING nova.compute.manager [req-c107fbed-baed-4c36-a6c6-70916f62393f req-83a9b3e3-26b8-492f-85ce-360cfa8bf1a7 service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Received unexpected event network-vif-plugged-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec for instance with vm_state stopped and task_state None.
Nov 06 13:45:46 user nova-compute[74821]: DEBUG nova.network.neutron [req-879ee821-64be-48b5-9b28-bcd4cbc2afe2 req-10a49890-c997-48e2-a6a2-b168deac7c8b service nova] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Updated VIF entry in instance network info cache for port dd012b53-0495-40ee-a825-7dadaabe579c. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:45:46 user nova-compute[74821]: DEBUG nova.network.neutron [req-879ee821-64be-48b5-9b28-bcd4cbc2afe2 req-10a49890-c997-48e2-a6a2-b168deac7c8b service nova] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Updating instance_info_cache with network_info: [{"id": "dd012b53-0495-40ee-a825-7dadaabe579c", "address": "fa:16:3e:c6:1e:8c", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd012b53-04", "ovs_interfaceid": "dd012b53-0495-40ee-a825-7dadaabe579c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:45:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-879ee821-64be-48b5-9b28-bcd4cbc2afe2 req-10a49890-c997-48e2-a6a2-b168deac7c8b service nova] Releasing lock "refresh_cache-bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:45:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:45:50 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:45:50 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:45:50 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:45:50 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Rebuilding the list of instances to heal {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 13:45:50 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Skipping network cache update for instance because it is Building. {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 06 13:45:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-db04d895-338b-46fb-af08-779ad5d1181d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:45:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-db04d895-338b-46fb-af08-779ad5d1181d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:45:51 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:45:51 user nova-compute[74821]: DEBUG nova.objects.instance [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lazy-loading 'info_cache' on Instance uuid db04d895-338b-46fb-af08-779ad5d1181d {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:45:51 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Updating instance_info_cache with network_info: [{"id": "0997f4aa-17bc-4f72-b43a-63eb00bd4a71", "address": "fa:16:3e:46:dc:53", "network": {"id": "9dfb5db2-5cef-4f79-a41d-af4ae6967c09", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1976265278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a79b69221f742dc9f128dd708d1b9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0997f4aa-17", "ovs_interfaceid": "0997f4aa-17bc-4f72-b43a-63eb00bd4a71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:45:51 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-db04d895-338b-46fb-af08-779ad5d1181d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:45:51 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:45:52 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:45:52 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:45:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:45:54 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:45:57 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:45:57 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:45:57 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:45:57 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:45:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:45:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:45:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:45:57 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:45:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:45:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:45:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:45:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:45:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:45:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:45:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:45:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:45:59 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:45:59 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:45:59 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=8824MB free_disk=25.107677459716797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:45:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:45:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:45:59 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance db04d895-338b-46fb-af08-779ad5d1181d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:45:59 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance c3293c45-e843-4d6b-bc15-a10010a24ea6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:45:59 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:45:59 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:45:59 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:45:59 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:45:59 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:45:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:45:59 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:45:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.325s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:46:01 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance db04d895-338b-46fb-af08-779ad5d1181d is timed out.
Nov 06 13:46:01 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Successfully detached device vdb from instance db04d895-338b-46fb-af08-779ad5d1181d from the live domain config.
Nov 06 13:46:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rgmTolMB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:46:01 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:46:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[35afe27a-0b28-41fb-8982-d9d6511ad1c2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:46:01 user nova-compute[74821]: No targets found.
Nov 06 13:46:01 user nova-compute[74821]: iSNS:
Nov 06 13:46:01 user nova-compute[74821]: No targets found.
Nov 06 13:46:01 user nova-compute[74821]: STATIC:
Nov 06 13:46:01 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047
Nov 06 13:46:01 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:46:01 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:46:01 user nova-compute[74821]: FIRMWARE:
Nov 06 13:46:01 user nova-compute[74821]: No targets found.
Nov 06 13:46:01 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:46:01 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:46:01 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abbd8a5-5cd2-436f-9c96-40b0a390adb8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d85d46-8543-4958-b7f0-7638981d0b5e]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047 (non-flash)
Nov 06 13:46:01 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047 (non-flash)
Nov 06 13:46:01 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e40492c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047'): ({'sdb'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Removing single pathed devices sdb {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cbcd26-6def-46dd-b243-fb834c1d4249]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d6f8a0-0133-4197-b685-420e4206c35d]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Flushing IO for device /dev/sdb {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f141cb-eb57-4573-9607-beaa4cc5f611]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1249501-90bd-4b27-bfcf-24536284c3c6]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] SCSI volumes sdb have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d011a4b-622c-4841-a174-9820a88e86c7]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9cc8f3-de3c-4975-8af2-49973f0a499a]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047, portal: 172.16.0.220,3260]
Nov 06 13:46:01 user nova-compute[74821]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047, portal: 172.16.0.220,3260] successful.
Nov 06 13:46:01 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe2f814-b670-47e7-a56b-4c36dab41047 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72573b1-2886-4690-81ef-c4866ea70100]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] <== disconnect_volume: return (283ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:46:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:46:02 user nova-compute[74821]: DEBUG nova.objects.instance [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lazy-loading 'flavor' on Instance uuid db04d895-338b-46fb-af08-779ad5d1181d {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:46:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8caffa4a-ec53-4b14-a394-f7f43b6cf091 tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "db04d895-338b-46fb-af08-779ad5d1181d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.846s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:46:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:46:05 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Creating image(s)
Nov 06 13:46:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Did not create local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Ensure instance console log exists: /opt/stack/data/nova/instances/bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Start _get_guest_xml network_info=[{"id": "dd012b53-0495-40ee-a825-7dadaabe579c", "address": "fa:16:3e:c6:1e:8c", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd012b53-04", "ovs_interfaceid": "dd012b53-0495-40ee-a825-7dadaabe579c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ytXCSQzf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac', 'attached_at': '', 'detached_at': '', 'volume_id': '9600620b-087a-4abc-bee1-b4e3c18b77e8', 'serial': '9600620b-087a-4abc-bee1-b4e3c18b77e8'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '3f39ccb1-f65b-480e-835b-142f16d62647', 'volume_type': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:46:05 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:46:05 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:46:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ytXCSQzf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:46:05 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:46:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:46:05 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:46:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:46:05 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:46:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c302d7-ae82-4ad5-87c2-75e42b580355]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:46:05 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b717a8-79fc-434c-a61d-12cd34642bfe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8] added
Nov 06 13:46:05 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32c98f0-7380-43ef-a9ab-b6592ca78dae]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1d28a3-3d19-4a14-82f7-c5e8b99f4cda]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ytXCSQzf {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ytXCSQzf" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[366cd24f-7536-42dc-a979-de14dd8c89e6]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ytXCSQzf'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7006e3-8433-47e5-9fbc-8717364b477d]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b971dd1b-4584-4fae-a78b-e5e1bc83e3b6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 06 13:46:05 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 06 13:46:05 user nova-compute[74821]:  {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:46:05 user nova-compute[74821]: WARNING os_brick.initiator.connectors.iscsi [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 06 13:46:05 user nova-compute[74821]: 
Nov 06 13:46:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f8faf4-3ea2-4090-9a78-b76aced1b8b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8, portal: 172.16.0.220,3260]
Nov 06 13:46:05 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8, portal: 172.16.0.220,3260] successful.
Nov 06 13:46:05 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b6ba37-142a-4776-9230-5e23c2364f56]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b04cc98-a8fe-49de-8d9f-16d6ab89399d]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 (non-flash)
Nov 06 13:46:05 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 (non-flash)
Nov 06 13:46:05 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3405f81c-0ea8-4cfc-8fb8-7923183d0cf1]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:46:05 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ytXCSQzf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:46:06 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:46:06 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26434646637643463', 'path': '/dev/sdb'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:46:06 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434646637643463', 'path': '/dev/sdb'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:46:06 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-990591675',display_name='tempest-TestVolumeBootPattern-server-990591675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-990591675',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfkJ+gcSdYeVBScTbHfbQppT+GyWkt0sgvXBBnJvMr4dzybcwiVijK0IZrgpO4n3M0oU/D2RJOqwTHI/tQmkgtCEBZc1yLKKsxKLmfpxs7+Nu7iryecTOj297JFUnXZvw==',key_name='tempest-TestVolumeBootPattern-11065527',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c8e811a3a30417a8dc6ccad03f2f8e0',ramdisk_id='',reservation_id='r-0r1g101e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1930796442',owner_user_name='tempest-TestVolumeBootPattern-1930796442-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:45:43Z,user_data=None,user_id='3bb6a168d90a4795a72b8ac69eeadcc9',uuid=bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd012b53-0495-40ee-a825-7dadaabe579c", "address": "fa:16:3e:c6:1e:8c", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd012b53-04", "ovs_interfaceid": "dd012b53-0495-40ee-a825-7dadaabe579c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:46:06 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Converting VIF {"id": "dd012b53-0495-40ee-a825-7dadaabe579c", "address": "fa:16:3e:c6:1e:8c", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd012b53-04", "ovs_interfaceid": "dd012b53-0495-40ee-a825-7dadaabe579c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:46:06 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:1e:8c,bridge_name='br-int',has_traffic_filtering=True,id=dd012b53-0495-40ee-a825-7dadaabe579c,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd012b53-04') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:46:06 user nova-compute[74821]: DEBUG nova.objects.instance [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lazy-loading 'pci_devices' on Instance uuid bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:46:06 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:46:06 user nova-compute[74821]:   <uuid>bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac</uuid>
Nov 06 13:46:06 user nova-compute[74821]:   <name>instance-00000031</name>
Nov 06 13:46:06 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:46:06 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:46:06 user nova-compute[74821]:   <metadata>
Nov 06 13:46:06 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:46:06 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:46:06 user nova-compute[74821]:       <nova:name>tempest-TestVolumeBootPattern-server-990591675</nova:name>
Nov 06 13:46:06 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:46:05</nova:creationTime>
Nov 06 13:46:06 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:46:06 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:46:06 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:46:06 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:46:06 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:46:06 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:46:06 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:46:06 user nova-compute[74821]:       <nova:owner>
Nov 06 13:46:06 user nova-compute[74821]:         <nova:user uuid="3bb6a168d90a4795a72b8ac69eeadcc9">tempest-TestVolumeBootPattern-1930796442-project-member</nova:user>
Nov 06 13:46:06 user nova-compute[74821]:         <nova:project uuid="2c8e811a3a30417a8dc6ccad03f2f8e0">tempest-TestVolumeBootPattern-1930796442</nova:project>
Nov 06 13:46:06 user nova-compute[74821]:       </nova:owner>
Nov 06 13:46:06 user nova-compute[74821]:       <nova:ports>
Nov 06 13:46:06 user nova-compute[74821]:         <nova:port uuid="dd012b53-0495-40ee-a825-7dadaabe579c">
Nov 06 13:46:06 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 06 13:46:06 user nova-compute[74821]:         </nova:port>
Nov 06 13:46:06 user nova-compute[74821]:       </nova:ports>
Nov 06 13:46:06 user nova-compute[74821]:     </nova:instance>
Nov 06 13:46:06 user nova-compute[74821]:   </metadata>
Nov 06 13:46:06 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:46:06 user nova-compute[74821]:     <system>
Nov 06 13:46:06 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:46:06 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:46:06 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:46:06 user nova-compute[74821]:       <entry name="serial">bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac</entry>
Nov 06 13:46:06 user nova-compute[74821]:       <entry name="uuid">bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac</entry>
Nov 06 13:46:06 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:46:06 user nova-compute[74821]:     </system>
Nov 06 13:46:06 user nova-compute[74821]:   </sysinfo>
Nov 06 13:46:06 user nova-compute[74821]:   <os>
Nov 06 13:46:06 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:46:06 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:46:06 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:46:06 user nova-compute[74821]:   </os>
Nov 06 13:46:06 user nova-compute[74821]:   <features>
Nov 06 13:46:06 user nova-compute[74821]:     <acpi/>
Nov 06 13:46:06 user nova-compute[74821]:     <apic/>
Nov 06 13:46:06 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:46:06 user nova-compute[74821]:   </features>
Nov 06 13:46:06 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:46:06 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:46:06 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:46:06 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:46:06 user nova-compute[74821]:   </clock>
Nov 06 13:46:06 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:46:06 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:46:06 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:46:06 user nova-compute[74821]:   </cpu>
Nov 06 13:46:06 user nova-compute[74821]:   <devices>
Nov 06 13:46:06 user nova-compute[74821]:     <disk type="block" device="disk">
Nov 06 13:46:06 user nova-compute[74821]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:46:06 user nova-compute[74821]:       <source dev="/dev/sdb"/>
Nov 06 13:46:06 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:46:06 user nova-compute[74821]:       <serial>9600620b-087a-4abc-bee1-b4e3c18b77e8</serial>
Nov 06 13:46:06 user nova-compute[74821]:     </disk>
Nov 06 13:46:06 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:46:06 user nova-compute[74821]:       <mac address="fa:16:3e:c6:1e:8c"/>
Nov 06 13:46:06 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:46:06 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:46:06 user nova-compute[74821]:       <target dev="tapdd012b53-04"/>
Nov 06 13:46:06 user nova-compute[74821]:     </interface>
Nov 06 13:46:06 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:46:06 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac/console.log" append="off"/>
Nov 06 13:46:06 user nova-compute[74821]:     </serial>
Nov 06 13:46:06 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:46:06 user nova-compute[74821]:     <video>
Nov 06 13:46:06 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:46:06 user nova-compute[74821]:     </video>
Nov 06 13:46:06 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:46:06 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:46:06 user nova-compute[74821]:     </rng>
Nov 06 13:46:06 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:46:06 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:46:06 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:46:06 user nova-compute[74821]:     </memballoon>
Nov 06 13:46:06 user nova-compute[74821]:   </devices>
Nov 06 13:46:06 user nova-compute[74821]: </domain>
Nov 06 13:46:06 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:46:06 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-990591675',display_name='tempest-TestVolumeBootPattern-server-990591675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-990591675',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfkJ+gcSdYeVBScTbHfbQppT+GyWkt0sgvXBBnJvMr4dzybcwiVijK0IZrgpO4n3M0oU/D2RJOqwTHI/tQmkgtCEBZc1yLKKsxKLmfpxs7+Nu7iryecTOj297JFUnXZvw==',key_name='tempest-TestVolumeBootPattern-11065527',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c8e811a3a30417a8dc6ccad03f2f8e0',ramdisk_id='',reservation_id='r-0r1g101e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1930796442',owner_user_name='tempest-TestVolumeBootPattern-1930796442-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:45:43Z,user_data=None,user_id='3bb6a168d90a4795a72b8ac69eeadcc9',uuid=bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd012b53-0495-40ee-a825-7dadaabe579c", "address": "fa:16:3e:c6:1e:8c", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd012b53-04", "ovs_interfaceid": "dd012b53-0495-40ee-a825-7dadaabe579c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:46:06 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Converting VIF {"id": "dd012b53-0495-40ee-a825-7dadaabe579c", "address": "fa:16:3e:c6:1e:8c", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd012b53-04", "ovs_interfaceid": "dd012b53-0495-40ee-a825-7dadaabe579c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:46:06 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:1e:8c,bridge_name='br-int',has_traffic_filtering=True,id=dd012b53-0495-40ee-a825-7dadaabe579c,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd012b53-04') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:46:06 user nova-compute[74821]: DEBUG os_vif [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:1e:8c,bridge_name='br-int',has_traffic_filtering=True,id=dd012b53-0495-40ee-a825-7dadaabe579c,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd012b53-04') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:46:06 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:46:06 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:46:06 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:46:06 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:46:06 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bf949ec7-f90b-51bd-97a7-de34271d57c4', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:46:06 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:46:06 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:46:06 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:46:06 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:46:06 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd012b53-04, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:46:06 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdd012b53-04, col_values=(('qos', UUID('ab747d7d-e97b-495e-b282-ada212da6841')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:46:06 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdd012b53-04, col_values=(('external_ids', {'iface-id': 'dd012b53-0495-40ee-a825-7dadaabe579c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:1e:8c', 'vm-uuid': 'bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:46:06 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:46:06 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:46:06 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:46:06 user nova-compute[74821]: INFO os_vif [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:1e:8c,bridge_name='br-int',has_traffic_filtering=True,id=dd012b53-0495-40ee-a825-7dadaabe579c,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd012b53-04')
Nov 06 13:46:06 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:46:06 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] No VIF found with MAC fa:16:3e:c6:1e:8c, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:46:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:46:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:46:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:46:08 user nova-compute[74821]: DEBUG nova.compute.manager [req-c4f26baa-cd0c-43bc-a3ff-6739dce4a9e6 req-cd36411b-5836-4155-9919-804eb7545b72 service nova] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Received event network-vif-plugged-dd012b53-0495-40ee-a825-7dadaabe579c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:46:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c4f26baa-cd0c-43bc-a3ff-6739dce4a9e6 req-cd36411b-5836-4155-9919-804eb7545b72 service nova] Acquiring lock "bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:46:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c4f26baa-cd0c-43bc-a3ff-6739dce4a9e6 req-cd36411b-5836-4155-9919-804eb7545b72 service nova] Lock "bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:46:08 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c4f26baa-cd0c-43bc-a3ff-6739dce4a9e6 req-cd36411b-5836-4155-9919-804eb7545b72 service nova] Lock "bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:46:08 user nova-compute[74821]: DEBUG nova.compute.manager [req-c4f26baa-cd0c-43bc-a3ff-6739dce4a9e6 req-cd36411b-5836-4155-9919-804eb7545b72 service nova] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] No waiting events found dispatching network-vif-plugged-dd012b53-0495-40ee-a825-7dadaabe579c {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:46:08 user nova-compute[74821]: WARNING nova.compute.manager [req-c4f26baa-cd0c-43bc-a3ff-6739dce4a9e6 req-cd36411b-5836-4155-9919-804eb7545b72 service nova] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Received unexpected event network-vif-plugged-dd012b53-0495-40ee-a825-7dadaabe579c for instance with vm_state building and task_state spawning.
Nov 06 13:46:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:46:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:46:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:46:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:46:08 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:46:09 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:46:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:46:09 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Instance spawned successfully.
Nov 06 13:46:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:46:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:46:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:46:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:46:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:46:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:46:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:46:10 user nova-compute[74821]: INFO nova.compute.manager [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Took 5.02 seconds to spawn the instance on the hypervisor.
Nov 06 13:46:10 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:46:10 user nova-compute[74821]: DEBUG nova.compute.manager [req-5b797411-5dd2-491c-a6b1-c8a102d2587b req-889aa94f-c7b8-45f1-baa5-4a3188990cce service nova] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Received event network-vif-plugged-dd012b53-0495-40ee-a825-7dadaabe579c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:46:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5b797411-5dd2-491c-a6b1-c8a102d2587b req-889aa94f-c7b8-45f1-baa5-4a3188990cce service nova] Acquiring lock "bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:46:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5b797411-5dd2-491c-a6b1-c8a102d2587b req-889aa94f-c7b8-45f1-baa5-4a3188990cce service nova] Lock "bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:46:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-5b797411-5dd2-491c-a6b1-c8a102d2587b req-889aa94f-c7b8-45f1-baa5-4a3188990cce service nova] Lock "bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:46:10 user nova-compute[74821]: DEBUG nova.compute.manager [req-5b797411-5dd2-491c-a6b1-c8a102d2587b req-889aa94f-c7b8-45f1-baa5-4a3188990cce service nova] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] No waiting events found dispatching network-vif-plugged-dd012b53-0495-40ee-a825-7dadaabe579c {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:46:10 user nova-compute[74821]: WARNING nova.compute.manager [req-5b797411-5dd2-491c-a6b1-c8a102d2587b req-889aa94f-c7b8-45f1-baa5-4a3188990cce service nova] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Received unexpected event network-vif-plugged-dd012b53-0495-40ee-a825-7dadaabe579c for instance with vm_state building and task_state spawning.
Nov 06 13:46:10 user nova-compute[74821]: INFO nova.compute.manager [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Took 27.65 seconds to build instance.
Nov 06 13:46:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5f75a376-3fbf-4dc6-b38c-29402741c537 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.742s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:46:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:46:11 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:46:12 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:46:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:46:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:46:20 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:46:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:46:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:46:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:46:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:46:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:46:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:46:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.imagecache [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Verify base images {{(pid=74821) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 06 13:46:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.imagecache [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74821) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 06 13:46:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.imagecache [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Image id bbed6343-3ff2-4f28-897a-55ddcbbc8268 yields fingerprint 6146e1615e448d04d59f8842ff9643af75521374 {{(pid=74821) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 06 13:46:21 user nova-compute[74821]: INFO nova.virt.libvirt.imagecache [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] image bbed6343-3ff2-4f28-897a-55ddcbbc8268 at (/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374): checking
Nov 06 13:46:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.imagecache [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] image bbed6343-3ff2-4f28-897a-55ddcbbc8268 at (/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374): image is in use {{(pid=74821) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 06 13:46:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.imagecache [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] c3293c45-e843-4d6b-bc15-a10010a24ea6 is a valid instance name {{(pid=74821) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 06 13:46:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.imagecache [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] c3293c45-e843-4d6b-bc15-a10010a24ea6 has a disk file {{(pid=74821) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 06 13:46:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:46:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:46:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.imagecache [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance c3293c45-e843-4d6b-bc15-a10010a24ea6 is backed by 6146e1615e448d04d59f8842ff9643af75521374 {{(pid=74821) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 06 13:46:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.imagecache [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] db04d895-338b-46fb-af08-779ad5d1181d is a valid instance name {{(pid=74821) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 06 13:46:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.imagecache [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] db04d895-338b-46fb-af08-779ad5d1181d has a disk file {{(pid=74821) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 06 13:46:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:46:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:46:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.imagecache [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance db04d895-338b-46fb-af08-779ad5d1181d is backed by 6146e1615e448d04d59f8842ff9643af75521374 {{(pid=74821) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 06 13:46:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.imagecache [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac is a valid instance name {{(pid=74821) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 06 13:46:21 user nova-compute[74821]: WARNING nova.virt.libvirt.imagecache [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Unknown base file: /opt/stack/data/nova/instances/_base/98547e8463b3ef6269735b89a9ed2b90250539b7
Nov 06 13:46:21 user nova-compute[74821]: WARNING nova.virt.libvirt.imagecache [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Unknown base file: /opt/stack/data/nova/instances/_base/406e8191d82b819844fed77b556cd6d5e9162d2c
Nov 06 13:46:21 user nova-compute[74821]: WARNING nova.virt.libvirt.imagecache [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Unknown base file: /opt/stack/data/nova/instances/_base/bf5f33f04319e72cbea83e7b9cdf20f81b8100f3
Nov 06 13:46:21 user nova-compute[74821]: WARNING nova.virt.libvirt.imagecache [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Unknown base file: /opt/stack/data/nova/instances/_base/3d67c1541c8f804de9e33cc5f1a19a4b12b0179b
Nov 06 13:46:21 user nova-compute[74821]: WARNING nova.virt.libvirt.imagecache [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Unknown base file: /opt/stack/data/nova/instances/_base/2168b23d5cf1db6819fd7454256e109af9aabb92
Nov 06 13:46:21 user nova-compute[74821]: WARNING nova.virt.libvirt.imagecache [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Unknown base file: /opt/stack/data/nova/instances/_base/ad36bdff2a6f608e0a3fed7e52e52a3f61a95484
Nov 06 13:46:21 user nova-compute[74821]: WARNING nova.virt.libvirt.imagecache [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Unknown base file: /opt/stack/data/nova/instances/_base/392377818b8196e889922901bb678f357a6c57a5
Nov 06 13:46:21 user nova-compute[74821]: WARNING nova.virt.libvirt.imagecache [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Unknown base file: /opt/stack/data/nova/instances/_base/7ce5db5cb702e712465a6c2e92d774b15ed5c534
Nov 06 13:46:21 user nova-compute[74821]: WARNING nova.virt.libvirt.imagecache [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Unknown base file: /opt/stack/data/nova/instances/_base/652dab4a580ab731c387769b29b92e68e87830cc
Nov 06 13:46:21 user nova-compute[74821]: INFO nova.virt.libvirt.imagecache [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Active base files: /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374
Nov 06 13:46:21 user nova-compute[74821]: INFO nova.virt.libvirt.imagecache [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Removable base files: /opt/stack/data/nova/instances/_base/98547e8463b3ef6269735b89a9ed2b90250539b7 /opt/stack/data/nova/instances/_base/406e8191d82b819844fed77b556cd6d5e9162d2c /opt/stack/data/nova/instances/_base/bf5f33f04319e72cbea83e7b9cdf20f81b8100f3 /opt/stack/data/nova/instances/_base/3d67c1541c8f804de9e33cc5f1a19a4b12b0179b /opt/stack/data/nova/instances/_base/2168b23d5cf1db6819fd7454256e109af9aabb92 /opt/stack/data/nova/instances/_base/ad36bdff2a6f608e0a3fed7e52e52a3f61a95484 /opt/stack/data/nova/instances/_base/392377818b8196e889922901bb678f357a6c57a5 /opt/stack/data/nova/instances/_base/7ce5db5cb702e712465a6c2e92d774b15ed5c534 /opt/stack/data/nova/instances/_base/652dab4a580ab731c387769b29b92e68e87830cc
Nov 06 13:46:21 user nova-compute[74821]: INFO nova.virt.libvirt.imagecache [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/98547e8463b3ef6269735b89a9ed2b90250539b7
Nov 06 13:46:21 user nova-compute[74821]: INFO nova.virt.libvirt.imagecache [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/406e8191d82b819844fed77b556cd6d5e9162d2c
Nov 06 13:46:21 user nova-compute[74821]: INFO nova.virt.libvirt.imagecache [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bf5f33f04319e72cbea83e7b9cdf20f81b8100f3
Nov 06 13:46:21 user nova-compute[74821]: INFO nova.virt.libvirt.imagecache [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3d67c1541c8f804de9e33cc5f1a19a4b12b0179b
Nov 06 13:46:21 user nova-compute[74821]: INFO nova.virt.libvirt.imagecache [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2168b23d5cf1db6819fd7454256e109af9aabb92
Nov 06 13:46:21 user nova-compute[74821]: INFO nova.virt.libvirt.imagecache [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ad36bdff2a6f608e0a3fed7e52e52a3f61a95484
Nov 06 13:46:21 user nova-compute[74821]: INFO nova.virt.libvirt.imagecache [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/392377818b8196e889922901bb678f357a6c57a5
Nov 06 13:46:21 user nova-compute[74821]: INFO nova.virt.libvirt.imagecache [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7ce5db5cb702e712465a6c2e92d774b15ed5c534
Nov 06 13:46:21 user nova-compute[74821]: INFO nova.virt.libvirt.imagecache [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/652dab4a580ab731c387769b29b92e68e87830cc
Nov 06 13:46:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.imagecache [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Verification complete {{(pid=74821) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 06 13:46:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.imagecache [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Verify swap images {{(pid=74821) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 06 13:46:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.imagecache [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Verify ephemeral images {{(pid=74821) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 06 13:46:21 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:46:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:46:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:46:31 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:46:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:46:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:46:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:46:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:46:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:46:46 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:46:51 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:46:51 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:46:51 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:46:51 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:46:51 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:46:51 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:46:51 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:46:51 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:46:51 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:46:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-c3293c45-e843-4d6b-bc15-a10010a24ea6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:46:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-c3293c45-e843-4d6b-bc15-a10010a24ea6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:46:52 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:46:52 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Updating instance_info_cache with network_info: [{"id": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "address": "fa:16:3e:87:40:ab", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da3ffbf-3f", "ovs_interfaceid": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:46:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-c3293c45-e843-4d6b-bc15-a10010a24ea6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:46:52 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:46:52 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:46:52 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:46:55 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:46:55 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Cleaning up deleted instances {{(pid=74821) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 13:46:55 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] There are 0 instances to clean {{(pid=74821) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 13:46:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:46:56 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:46:57 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:46:57 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:46:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:46:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:46:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:46:58 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:46:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:46:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:46:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:46:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:46:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:46:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:46:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:46:58 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:46:58 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:46:59 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:46:59 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:46:59 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=8722MB free_disk=25.09726333618164GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:46:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:46:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:46:59 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance db04d895-338b-46fb-af08-779ad5d1181d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:46:59 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance c3293c45-e843-4d6b-bc15-a10010a24ea6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:46:59 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:46:59 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:46:59 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:46:59 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:46:59 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:46:59 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:46:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.279s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:47:00 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:47:00 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:47:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:01 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:47:06 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:47:06 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:06 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:47:06 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:47:06 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:47:06 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:06 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:47:06 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Cleaning up deleted instances with incomplete migration  {{(pid=74821) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 13:47:11 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:11 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:47:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:21 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:47:21 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:47:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:47:31 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:33 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:34 user nova-compute[74821]: DEBUG nova.compute.manager [req-e7b7a609-c3a5-4abe-b507-17e2d3197b4e req-f2de8cc3-eb53-4de6-81e5-09d8eaa71784 service nova] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Received event network-changed-dd012b53-0495-40ee-a825-7dadaabe579c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:47:34 user nova-compute[74821]: DEBUG nova.compute.manager [req-e7b7a609-c3a5-4abe-b507-17e2d3197b4e req-f2de8cc3-eb53-4de6-81e5-09d8eaa71784 service nova] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Refreshing instance network info cache due to event network-changed-dd012b53-0495-40ee-a825-7dadaabe579c. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:47:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e7b7a609-c3a5-4abe-b507-17e2d3197b4e req-f2de8cc3-eb53-4de6-81e5-09d8eaa71784 service nova] Acquiring lock "refresh_cache-bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:47:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e7b7a609-c3a5-4abe-b507-17e2d3197b4e req-f2de8cc3-eb53-4de6-81e5-09d8eaa71784 service nova] Acquired lock "refresh_cache-bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:47:34 user nova-compute[74821]: DEBUG nova.network.neutron [req-e7b7a609-c3a5-4abe-b507-17e2d3197b4e req-f2de8cc3-eb53-4de6-81e5-09d8eaa71784 service nova] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Refreshing network info cache for port dd012b53-0495-40ee-a825-7dadaabe579c {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:47:34 user nova-compute[74821]: DEBUG nova.objects.instance [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lazy-loading 'flavor' on Instance uuid c3293c45-e843-4d6b-bc15-a10010a24ea6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:47:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "refresh_cache-c3293c45-e843-4d6b-bc15-a10010a24ea6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:47:34 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquired lock "refresh_cache-c3293c45-e843-4d6b-bc15-a10010a24ea6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:47:34 user nova-compute[74821]: DEBUG nova.network.neutron [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:47:34 user nova-compute[74821]: DEBUG nova.objects.instance [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lazy-loading 'info_cache' on Instance uuid c3293c45-e843-4d6b-bc15-a10010a24ea6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:47:34 user nova-compute[74821]: DEBUG nova.objects.base [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Object Instance<c3293c45-e843-4d6b-bc15-a10010a24ea6> lazy-loaded attributes: flavor,info_cache {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:47:35 user nova-compute[74821]: INFO nova.compute.manager [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Terminating instance
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.compute.manager [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.network.neutron [req-e7b7a609-c3a5-4abe-b507-17e2d3197b4e req-f2de8cc3-eb53-4de6-81e5-09d8eaa71784 service nova] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Updated VIF entry in instance network info cache for port dd012b53-0495-40ee-a825-7dadaabe579c. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.network.neutron [req-e7b7a609-c3a5-4abe-b507-17e2d3197b4e req-f2de8cc3-eb53-4de6-81e5-09d8eaa71784 service nova] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Updating instance_info_cache with network_info: [{"id": "dd012b53-0495-40ee-a825-7dadaabe579c", "address": "fa:16:3e:c6:1e:8c", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd012b53-04", "ovs_interfaceid": "dd012b53-0495-40ee-a825-7dadaabe579c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-e7b7a609-c3a5-4abe-b507-17e2d3197b4e req-f2de8cc3-eb53-4de6-81e5-09d8eaa71784 service nova] Releasing lock "refresh_cache-bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.network.neutron [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Updating instance_info_cache with network_info: [{"id": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "address": "fa:16:3e:87:40:ab", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da3ffbf-3f", "ovs_interfaceid": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Releasing lock "refresh_cache-c3293c45-e843-4d6b-bc15-a10010a24ea6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.compute.manager [req-2632483a-7463-4693-93f7-5789786838c0 req-edf4b3f7-191e-4e84-9754-e716f638fa29 service nova] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Received event network-vif-unplugged-dd012b53-0495-40ee-a825-7dadaabe579c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2632483a-7463-4693-93f7-5789786838c0 req-edf4b3f7-191e-4e84-9754-e716f638fa29 service nova] Acquiring lock "bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2632483a-7463-4693-93f7-5789786838c0 req-edf4b3f7-191e-4e84-9754-e716f638fa29 service nova] Lock "bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2632483a-7463-4693-93f7-5789786838c0 req-edf4b3f7-191e-4e84-9754-e716f638fa29 service nova] Lock "bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.compute.manager [req-2632483a-7463-4693-93f7-5789786838c0 req-edf4b3f7-191e-4e84-9754-e716f638fa29 service nova] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] No waiting events found dispatching network-vif-unplugged-dd012b53-0495-40ee-a825-7dadaabe579c {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.compute.manager [req-2632483a-7463-4693-93f7-5789786838c0 req-edf4b3f7-191e-4e84-9754-e716f638fa29 service nova] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Received event network-vif-unplugged-dd012b53-0495-40ee-a825-7dadaabe579c for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:47:35 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Instance destroyed successfully.
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.objects.instance [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lazy-loading 'resources' on Instance uuid c3293c45-e843-4d6b-bc15-a10010a24ea6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.objects.base [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Object Instance<c3293c45-e843-4d6b-bc15-a10010a24ea6> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:39:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1993604917',display_name='tempest-AttachVolumeTestJSON-server-1993604917',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1993604917',id=45,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVB62RpV7sb/k2zRM/ERNI4ujnBhy7CTod4Pfx14PprgP+C8QSul7cOBioxpJJqMn0wC1iI7xPCkFVcTSwGlIE5o2jmZYDIM/eqmdyMBPfuKA5g8IgRvnLBPlG3P7M+Gw==',key_name='tempest-keypair-2114445980',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:39:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9f3e02b312774fffa90b9aea7611b7d2',ramdisk_id='',reservation_id='r-e3xww6ds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1920917363',owner_user_name='tempest-AttachVolumeTestJSON-1920917363-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:45:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88ff13567ecb4157898a278d3ae6e0d0',uuid=c3293c45-e843-4d6b-bc15-a10010a24ea6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "address": "fa:16:3e:87:40:ab", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da3ffbf-3f", "ovs_interfaceid": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Converting VIF {"id": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "address": "fa:16:3e:87:40:ab", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da3ffbf-3f", "ovs_interfaceid": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:40:ab,bridge_name='br-int',has_traffic_filtering=True,id=4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec,network=Network(a2ec52e9-7476-4ced-9810-d58d3f9eec4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4da3ffbf-3f') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG os_vif [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:40:ab,bridge_name='br-int',has_traffic_filtering=True,id=4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec,network=Network(a2ec52e9-7476-4ced-9810-d58d3f9eec4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4da3ffbf-3f') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4da3ffbf-3f, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=42596340-c50e-414e-af6d-946d664fc5c4) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:35 user nova-compute[74821]: INFO os_vif [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:40:ab,bridge_name='br-int',has_traffic_filtering=True,id=4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec,network=Network(a2ec52e9-7476-4ced-9810-d58d3f9eec4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4da3ffbf-3f')
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Start _get_guest_xml network_info=[{"id": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "address": "fa:16:3e:87:40:ab", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da3ffbf-3f", "ovs_interfaceid": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.objects.instance [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lazy-loading 'numa_topology' on Instance uuid c3293c45-e843-4d6b-bc15-a10010a24ea6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.objects.base [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Object Instance<c3293c45-e843-4d6b-bc15-a10010a24ea6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:47:35 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:47:35 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.objects.instance [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lazy-loading 'vcpu_model' on Instance uuid c3293c45-e843-4d6b-bc15-a10010a24ea6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.objects.base [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Object Instance<c3293c45-e843-4d6b-bc15-a10010a24ea6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:39:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1993604917',display_name='tempest-AttachVolumeTestJSON-server-1993604917',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1993604917',id=45,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVB62RpV7sb/k2zRM/ERNI4ujnBhy7CTod4Pfx14PprgP+C8QSul7cOBioxpJJqMn0wC1iI7xPCkFVcTSwGlIE5o2jmZYDIM/eqmdyMBPfuKA5g8IgRvnLBPlG3P7M+Gw==',key_name='tempest-keypair-2114445980',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:39:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9f3e02b312774fffa90b9aea7611b7d2',ramdisk_id='',reservation_id='r-e3xww6ds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1920917363',owner_user_name='tempest-AttachVolumeTestJSON-1920917363-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:45:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88ff13567ecb4157898a278d3ae6e0d0',uuid=c3293c45-e843-4d6b-bc15-a10010a24ea6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "address": "fa:16:3e:87:40:ab", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da3ffbf-3f", "ovs_interfaceid": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Converting VIF {"id": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "address": "fa:16:3e:87:40:ab", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da3ffbf-3f", "ovs_interfaceid": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:40:ab,bridge_name='br-int',has_traffic_filtering=True,id=4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec,network=Network(a2ec52e9-7476-4ced-9810-d58d3f9eec4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4da3ffbf-3f') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.objects.instance [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lazy-loading 'pci_devices' on Instance uuid c3293c45-e843-4d6b-bc15-a10010a24ea6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.objects.base [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Object Instance<c3293c45-e843-4d6b-bc15-a10010a24ea6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:47:35 user nova-compute[74821]:   <uuid>c3293c45-e843-4d6b-bc15-a10010a24ea6</uuid>
Nov 06 13:47:35 user nova-compute[74821]:   <name>instance-0000002d</name>
Nov 06 13:47:35 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:47:35 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:47:35 user nova-compute[74821]:   <metadata>
Nov 06 13:47:35 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:47:35 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:47:35 user nova-compute[74821]:       <nova:name>tempest-AttachVolumeTestJSON-server-1993604917</nova:name>
Nov 06 13:47:35 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:47:35</nova:creationTime>
Nov 06 13:47:35 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:47:35 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:47:35 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:47:35 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:47:35 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:47:35 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:47:35 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:47:35 user nova-compute[74821]:       <nova:owner>
Nov 06 13:47:35 user nova-compute[74821]:         <nova:user uuid="88ff13567ecb4157898a278d3ae6e0d0">tempest-AttachVolumeTestJSON-1920917363-project-member</nova:user>
Nov 06 13:47:35 user nova-compute[74821]:         <nova:project uuid="9f3e02b312774fffa90b9aea7611b7d2">tempest-AttachVolumeTestJSON-1920917363</nova:project>
Nov 06 13:47:35 user nova-compute[74821]:       </nova:owner>
Nov 06 13:47:35 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:47:35 user nova-compute[74821]:       <nova:ports>
Nov 06 13:47:35 user nova-compute[74821]:         <nova:port uuid="4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec">
Nov 06 13:47:35 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 06 13:47:35 user nova-compute[74821]:         </nova:port>
Nov 06 13:47:35 user nova-compute[74821]:       </nova:ports>
Nov 06 13:47:35 user nova-compute[74821]:     </nova:instance>
Nov 06 13:47:35 user nova-compute[74821]:   </metadata>
Nov 06 13:47:35 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:47:35 user nova-compute[74821]:     <system>
Nov 06 13:47:35 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:47:35 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:47:35 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:47:35 user nova-compute[74821]:       <entry name="serial">c3293c45-e843-4d6b-bc15-a10010a24ea6</entry>
Nov 06 13:47:35 user nova-compute[74821]:       <entry name="uuid">c3293c45-e843-4d6b-bc15-a10010a24ea6</entry>
Nov 06 13:47:35 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:47:35 user nova-compute[74821]:     </system>
Nov 06 13:47:35 user nova-compute[74821]:   </sysinfo>
Nov 06 13:47:35 user nova-compute[74821]:   <os>
Nov 06 13:47:35 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:47:35 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:47:35 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:47:35 user nova-compute[74821]:   </os>
Nov 06 13:47:35 user nova-compute[74821]:   <features>
Nov 06 13:47:35 user nova-compute[74821]:     <acpi/>
Nov 06 13:47:35 user nova-compute[74821]:     <apic/>
Nov 06 13:47:35 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:47:35 user nova-compute[74821]:   </features>
Nov 06 13:47:35 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:47:35 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:47:35 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:47:35 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:47:35 user nova-compute[74821]:   </clock>
Nov 06 13:47:35 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:47:35 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:47:35 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:47:35 user nova-compute[74821]:   </cpu>
Nov 06 13:47:35 user nova-compute[74821]:   <devices>
Nov 06 13:47:35 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:47:35 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:47:35 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk"/>
Nov 06 13:47:35 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:47:35 user nova-compute[74821]:     </disk>
Nov 06 13:47:35 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:47:35 user nova-compute[74821]:       <mac address="fa:16:3e:87:40:ab"/>
Nov 06 13:47:35 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:47:35 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:47:35 user nova-compute[74821]:       <target dev="tap4da3ffbf-3f"/>
Nov 06 13:47:35 user nova-compute[74821]:     </interface>
Nov 06 13:47:35 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:47:35 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/console.log" append="off"/>
Nov 06 13:47:35 user nova-compute[74821]:     </serial>
Nov 06 13:47:35 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:47:35 user nova-compute[74821]:     <video>
Nov 06 13:47:35 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:47:35 user nova-compute[74821]:     </video>
Nov 06 13:47:35 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:47:35 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:47:35 user nova-compute[74821]:     </rng>
Nov 06 13:47:35 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:47:35 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:47:35 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:47:35 user nova-compute[74821]:     </memballoon>
Nov 06 13:47:35 user nova-compute[74821]:   </devices>
Nov 06 13:47:35 user nova-compute[74821]: </domain>
Nov 06 13:47:35 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:47:35 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:47:36 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Instance destroyed successfully.
Nov 06 13:47:36 user nova-compute[74821]: DEBUG nova.objects.instance [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lazy-loading 'resources' on Instance uuid bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-990591675',display_name='tempest-TestVolumeBootPattern-server-990591675',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-990591675',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfkJ+gcSdYeVBScTbHfbQppT+GyWkt0sgvXBBnJvMr4dzybcwiVijK0IZrgpO4n3M0oU/D2RJOqwTHI/tQmkgtCEBZc1yLKKsxKLmfpxs7+Nu7iryecTOj297JFUnXZvw==',key_name='tempest-TestVolumeBootPattern-11065527',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:46:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c8e811a3a30417a8dc6ccad03f2f8e0',ramdisk_id='',reservation_id='r-0r1g101e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1930796442',owner_user_name='tempest-TestVolumeBootPattern-1930796442-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:46:10Z,user_data=None,user_id='3bb6a168d90a4795a72b8ac69eeadcc9',uuid=bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd012b53-0495-40ee-a825-7dadaabe579c", "address": "fa:16:3e:c6:1e:8c", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd012b53-04", "ovs_interfaceid": "dd012b53-0495-40ee-a825-7dadaabe579c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Converting VIF {"id": "dd012b53-0495-40ee-a825-7dadaabe579c", "address": "fa:16:3e:c6:1e:8c", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd012b53-04", "ovs_interfaceid": "dd012b53-0495-40ee-a825-7dadaabe579c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:1e:8c,bridge_name='br-int',has_traffic_filtering=True,id=dd012b53-0495-40ee-a825-7dadaabe579c,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd012b53-04') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG os_vif [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:1e:8c,bridge_name='br-int',has_traffic_filtering=True,id=dd012b53-0495-40ee-a825-7dadaabe579c,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd012b53-04') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd012b53-04, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab747d7d-e97b-495e-b282-ada212da6841) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:47:36 user nova-compute[74821]: INFO os_vif [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:1e:8c,bridge_name='br-int',has_traffic_filtering=True,id=dd012b53-0495-40ee-a825-7dadaabe579c,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd012b53-04')
Nov 06 13:47:36 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ytXCSQzf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:47:36 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:47:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2b981f-162e-4cbe-8ce4-896c61cdcb15]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:47:36 user nova-compute[74821]: No targets found.
Nov 06 13:47:36 user nova-compute[74821]: iSNS:
Nov 06 13:47:36 user nova-compute[74821]: No targets found.
Nov 06 13:47:36 user nova-compute[74821]: STATIC:
Nov 06 13:47:36 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8
Nov 06 13:47:36 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:47:36 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:47:36 user nova-compute[74821]: FIRMWARE:
Nov 06 13:47:36 user nova-compute[74821]: No targets found.
Nov 06 13:47:36 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:47:36 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:47:36 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[790c574c-9e44-41ce-b32b-81618cad9344]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98a2c4e-5b37-42d4-aebf-37ebeb7e2b1b]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 (non-flash)
Nov 06 13:47:36 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 (non-flash)
Nov 06 13:47:36 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e40294790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8'): ({'sdb'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Removing single pathed devices sdb {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[675ffce8-b052-4790-bdd3-101c8d1ceef1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3c9703-f2c3-404c-90e6-a87dc5c94322]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Flushing IO for device /dev/sdb {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4227cb3-383f-444f-928e-60c2be66035b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.065s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee04fda9-94ae-448e-b9cb-4b5185c530a1]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] SCSI volumes sdb have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_73f47e5e', '/dev/disk/by-id/scsi-26434646637643463', '/dev/disk/by-id/scsi-1SCST_BIO73f47e5e-d4df7d4c7ae8981c') {{(pid=85818) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85dc2e0-5c5e-4e7b-92d5-90022f102f0c]: (4, None) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG nova.objects.instance [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lazy-loading 'trusted_certs' on Instance uuid c3293c45-e843-4d6b-bc15-a10010a24ea6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c183004b-a828-4db2-8ec5-4d4b4f73e16e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG nova.objects.base [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Object Instance<c3293c45-e843-4d6b-bc15-a10010a24ea6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[059ce4b7-7ae7-410a-8198-7359c5596e9c]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8, portal: 172.16.0.220,3260]
Nov 06 13:47:36 user nova-compute[74821]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8, portal: 172.16.0.220,3260] successful.
Nov 06 13:47:36 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecb5da6-eb40-4c22-b0ab-032539dfb09f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] <== disconnect_volume: return (394ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:47:36 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Deleting instance files /opt/stack/data/nova/instances/bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac_del
Nov 06 13:47:36 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Deletion of /opt/stack/data/nova/instances/bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac_del complete
Nov 06 13:47:36 user nova-compute[74821]: INFO nova.compute.manager [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Took 1.37 seconds to destroy the instance on the hypervisor.
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.199s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Cannot resize image /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG nova.objects.instance [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lazy-loading 'migration_context' on Instance uuid c3293c45-e843-4d6b-bc15-a10010a24ea6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG nova.objects.base [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Object Instance<c3293c45-e843-4d6b-bc15-a10010a24ea6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74821) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:39:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1993604917',display_name='tempest-AttachVolumeTestJSON-server-1993604917',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1993604917',id=45,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVB62RpV7sb/k2zRM/ERNI4ujnBhy7CTod4Pfx14PprgP+C8QSul7cOBioxpJJqMn0wC1iI7xPCkFVcTSwGlIE5o2jmZYDIM/eqmdyMBPfuKA5g8IgRvnLBPlG3P7M+Gw==',key_name='tempest-keypair-2114445980',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:39:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='9f3e02b312774fffa90b9aea7611b7d2',ramdisk_id='',reservation_id='r-e3xww6ds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1920917363',owner_user_name='tempest-AttachVolumeTestJSON-1920917363-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:45:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88ff13567ecb4157898a278d3ae6e0d0',uuid=c3293c45-e843-4d6b-bc15-a10010a24ea6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "address": "fa:16:3e:87:40:ab", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da3ffbf-3f", "ovs_interfaceid": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Converting VIF {"id": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "address": "fa:16:3e:87:40:ab", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da3ffbf-3f", "ovs_interfaceid": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:40:ab,bridge_name='br-int',has_traffic_filtering=True,id=4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec,network=Network(a2ec52e9-7476-4ced-9810-d58d3f9eec4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4da3ffbf-3f') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG os_vif [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:40:ab,bridge_name='br-int',has_traffic_filtering=True,id=4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec,network=Network(a2ec52e9-7476-4ced-9810-d58d3f9eec4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4da3ffbf-3f') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e06a90f1-fdc0-5ef6-969e-1e527b1fdc96', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4da3ffbf-3f, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4da3ffbf-3f, col_values=(('qos', UUID('6e054e12-b412-4742-bcc1-a94dce931431')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4da3ffbf-3f, col_values=(('external_ids', {'iface-id': '4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:40:ab', 'vm-uuid': 'c3293c45-e843-4d6b-bc15-a10010a24ea6'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:47:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:36 user nova-compute[74821]: INFO os_vif [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:40:ab,bridge_name='br-int',has_traffic_filtering=True,id=4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec,network=Network(a2ec52e9-7476-4ced-9810-d58d3f9eec4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4da3ffbf-3f')
Nov 06 13:47:37 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:47:37 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Took 1.03 seconds to deallocate network for instance.
Nov 06 13:47:37 user nova-compute[74821]: DEBUG nova.compute.manager [req-9ace84d2-47d5-4e4f-bafc-44e5655e79ba req-bc65942c-47b4-4c96-9458-87918ea11251 service nova] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Received event network-vif-deleted-dd012b53-0495-40ee-a825-7dadaabe579c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:47:37 user nova-compute[74821]: INFO nova.compute.manager [req-9ace84d2-47d5-4e4f-bafc-44e5655e79ba req-bc65942c-47b4-4c96-9458-87918ea11251 service nova] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Neutron deleted interface dd012b53-0495-40ee-a825-7dadaabe579c; detaching it from the instance and deleting it from the info cache
Nov 06 13:47:37 user nova-compute[74821]: DEBUG nova.network.neutron [req-9ace84d2-47d5-4e4f-bafc-44e5655e79ba req-bc65942c-47b4-4c96-9458-87918ea11251 service nova] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:47:37 user nova-compute[74821]: DEBUG nova.compute.manager [req-9ace84d2-47d5-4e4f-bafc-44e5655e79ba req-bc65942c-47b4-4c96-9458-87918ea11251 service nova] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Detach interface failed, port_id=dd012b53-0495-40ee-a825-7dadaabe579c, reason: Instance bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac could not be found. {{(pid=74821) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 06 13:47:37 user nova-compute[74821]: DEBUG nova.compute.manager [req-2285c199-b865-4c40-a189-a002d97041ed req-ec59f1b7-ac34-4c92-8397-a78f15362b30 service nova] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Received event network-vif-plugged-dd012b53-0495-40ee-a825-7dadaabe579c {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:47:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2285c199-b865-4c40-a189-a002d97041ed req-ec59f1b7-ac34-4c92-8397-a78f15362b30 service nova] Acquiring lock "bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:47:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2285c199-b865-4c40-a189-a002d97041ed req-ec59f1b7-ac34-4c92-8397-a78f15362b30 service nova] Lock "bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:47:37 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-2285c199-b865-4c40-a189-a002d97041ed req-ec59f1b7-ac34-4c92-8397-a78f15362b30 service nova] Lock "bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:47:37 user nova-compute[74821]: DEBUG nova.compute.manager [req-2285c199-b865-4c40-a189-a002d97041ed req-ec59f1b7-ac34-4c92-8397-a78f15362b30 service nova] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] No waiting events found dispatching network-vif-plugged-dd012b53-0495-40ee-a825-7dadaabe579c {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:47:37 user nova-compute[74821]: WARNING nova.compute.manager [req-2285c199-b865-4c40-a189-a002d97041ed req-ec59f1b7-ac34-4c92-8397-a78f15362b30 service nova] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Received unexpected event network-vif-plugged-dd012b53-0495-40ee-a825-7dadaabe579c for instance with vm_state active and task_state deleting.
Nov 06 13:47:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:38 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:38 user nova-compute[74821]: INFO nova.compute.manager [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac] Took 1.01 seconds to detach 1 volumes for instance.
Nov 06 13:47:38 user nova-compute[74821]: DEBUG nova.compute.manager [req-6a0ec656-5ee3-4704-bba7-ab23df1a625e req-8da990c5-3efc-4313-9970-4bd28162b983 service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Received event network-vif-plugged-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:47:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6a0ec656-5ee3-4704-bba7-ab23df1a625e req-8da990c5-3efc-4313-9970-4bd28162b983 service nova] Acquiring lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:47:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6a0ec656-5ee3-4704-bba7-ab23df1a625e req-8da990c5-3efc-4313-9970-4bd28162b983 service nova] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:47:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6a0ec656-5ee3-4704-bba7-ab23df1a625e req-8da990c5-3efc-4313-9970-4bd28162b983 service nova] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:47:38 user nova-compute[74821]: DEBUG nova.compute.manager [req-6a0ec656-5ee3-4704-bba7-ab23df1a625e req-8da990c5-3efc-4313-9970-4bd28162b983 service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] No waiting events found dispatching network-vif-plugged-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:47:38 user nova-compute[74821]: WARNING nova.compute.manager [req-6a0ec656-5ee3-4704-bba7-ab23df1a625e req-8da990c5-3efc-4313-9970-4bd28162b983 service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Received unexpected event network-vif-plugged-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec for instance with vm_state stopped and task_state powering-on.
Nov 06 13:47:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:47:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:47:38 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:47:39 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:47:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.241s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:47:39 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Deleted allocations for instance bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac
Nov 06 13:47:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-3aed2835-f059-4cf4-8d7d-58627f51244a tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "bf9b9b00-7af6-4e7e-a3c6-6b2771e5faac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.010s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:47:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:40 user nova-compute[74821]: DEBUG nova.compute.manager [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:47:40 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Instance rebooted successfully.
Nov 06 13:47:40 user nova-compute[74821]: DEBUG nova.compute.manager [None req-b68ad79e-ab9a-4611-b73c-ed3d804e6fae tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:47:40 user nova-compute[74821]: DEBUG nova.compute.manager [req-d1832ea2-b26a-4fad-8dd4-1b5a75c61e25 req-93e8bf43-9957-45f3-b3ac-88d2796c894f service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Received event network-vif-plugged-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:47:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d1832ea2-b26a-4fad-8dd4-1b5a75c61e25 req-93e8bf43-9957-45f3-b3ac-88d2796c894f service nova] Acquiring lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:47:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d1832ea2-b26a-4fad-8dd4-1b5a75c61e25 req-93e8bf43-9957-45f3-b3ac-88d2796c894f service nova] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:47:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-d1832ea2-b26a-4fad-8dd4-1b5a75c61e25 req-93e8bf43-9957-45f3-b3ac-88d2796c894f service nova] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:47:40 user nova-compute[74821]: DEBUG nova.compute.manager [req-d1832ea2-b26a-4fad-8dd4-1b5a75c61e25 req-93e8bf43-9957-45f3-b3ac-88d2796c894f service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] No waiting events found dispatching network-vif-plugged-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:47:40 user nova-compute[74821]: WARNING nova.compute.manager [req-d1832ea2-b26a-4fad-8dd4-1b5a75c61e25 req-93e8bf43-9957-45f3-b3ac-88d2796c894f service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Received unexpected event network-vif-plugged-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec for instance with vm_state stopped and task_state powering-on.
Nov 06 13:47:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:46 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:51 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:47:51 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:47:51 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:47:51 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:47:51 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Rebuilding the list of instances to heal {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 13:47:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-db04d895-338b-46fb-af08-779ad5d1181d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:47:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-db04d895-338b-46fb-af08-779ad5d1181d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:47:52 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:47:52 user nova-compute[74821]: DEBUG nova.objects.instance [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lazy-loading 'info_cache' on Instance uuid db04d895-338b-46fb-af08-779ad5d1181d {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:47:53 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Updating instance_info_cache with network_info: [{"id": "0997f4aa-17bc-4f72-b43a-63eb00bd4a71", "address": "fa:16:3e:46:dc:53", "network": {"id": "9dfb5db2-5cef-4f79-a41d-af4ae6967c09", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1976265278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a79b69221f742dc9f128dd708d1b9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0997f4aa-17", "ovs_interfaceid": "0997f4aa-17bc-4f72-b43a-63eb00bd4a71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:47:53 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-db04d895-338b-46fb-af08-779ad5d1181d" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:47:53 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:47:54 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:47:54 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:47:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-be8b67cb-6d8b-4241-8af4-eba28fa2202d tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Acquiring lock "db04d895-338b-46fb-af08-779ad5d1181d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:47:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-be8b67cb-6d8b-4241-8af4-eba28fa2202d tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "db04d895-338b-46fb-af08-779ad5d1181d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:47:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-be8b67cb-6d8b-4241-8af4-eba28fa2202d tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Acquiring lock "db04d895-338b-46fb-af08-779ad5d1181d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:47:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-be8b67cb-6d8b-4241-8af4-eba28fa2202d tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "db04d895-338b-46fb-af08-779ad5d1181d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:47:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-be8b67cb-6d8b-4241-8af4-eba28fa2202d tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "db04d895-338b-46fb-af08-779ad5d1181d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:47:55 user nova-compute[74821]: INFO nova.compute.manager [None req-be8b67cb-6d8b-4241-8af4-eba28fa2202d tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Terminating instance
Nov 06 13:47:55 user nova-compute[74821]: DEBUG nova.compute.manager [None req-be8b67cb-6d8b-4241-8af4-eba28fa2202d tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:47:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:55 user nova-compute[74821]: DEBUG nova.compute.manager [req-f4966d88-e5e2-4adb-b9ec-6f2f35341a83 req-65c0c1d3-eb5e-48aa-931d-b8b4c58ba90a service nova] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Received event network-vif-unplugged-0997f4aa-17bc-4f72-b43a-63eb00bd4a71 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:47:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f4966d88-e5e2-4adb-b9ec-6f2f35341a83 req-65c0c1d3-eb5e-48aa-931d-b8b4c58ba90a service nova] Acquiring lock "db04d895-338b-46fb-af08-779ad5d1181d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:47:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f4966d88-e5e2-4adb-b9ec-6f2f35341a83 req-65c0c1d3-eb5e-48aa-931d-b8b4c58ba90a service nova] Lock "db04d895-338b-46fb-af08-779ad5d1181d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:47:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-f4966d88-e5e2-4adb-b9ec-6f2f35341a83 req-65c0c1d3-eb5e-48aa-931d-b8b4c58ba90a service nova] Lock "db04d895-338b-46fb-af08-779ad5d1181d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:47:55 user nova-compute[74821]: DEBUG nova.compute.manager [req-f4966d88-e5e2-4adb-b9ec-6f2f35341a83 req-65c0c1d3-eb5e-48aa-931d-b8b4c58ba90a service nova] [instance: db04d895-338b-46fb-af08-779ad5d1181d] No waiting events found dispatching network-vif-unplugged-0997f4aa-17bc-4f72-b43a-63eb00bd4a71 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:47:55 user nova-compute[74821]: DEBUG nova.compute.manager [req-f4966d88-e5e2-4adb-b9ec-6f2f35341a83 req-65c0c1d3-eb5e-48aa-931d-b8b4c58ba90a service nova] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Received event network-vif-unplugged-0997f4aa-17bc-4f72-b43a-63eb00bd4a71 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:47:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:56 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Instance destroyed successfully.
Nov 06 13:47:56 user nova-compute[74821]: DEBUG nova.objects.instance [None req-be8b67cb-6d8b-4241-8af4-eba28fa2202d tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lazy-loading 'resources' on Instance uuid db04d895-338b-46fb-af08-779ad5d1181d {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:47:56 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-be8b67cb-6d8b-4241-8af4-eba28fa2202d tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-335810033',display_name='tempest-SnapshotDataIntegrityTests-server-335810033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-335810033',id=43,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGRM2scSWIB9SJVmVaK/TIRflWA9+OKPVB/HP4WWZWcIPzN8dsrSzB4SmzKnfq19/ZTqcIPWLmq+BLb/XrmixEZclq08+LpZtf2QCzhMkqaUtNiA51kyuD8lF/xjis8Yw==',key_name='tempest-keypair-1748001198',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:38:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a79b69221f742dc9f128dd708d1b9c9',ramdisk_id='',reservation_id='r-h92c1vgc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1195143959',owner_user_name='tempest-SnapshotDataIntegrityTests-1195143959-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:38:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44a138b3c24e462287d29a4b892b5923',uuid=db04d895-338b-46fb-af08-779ad5d1181d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0997f4aa-17bc-4f72-b43a-63eb00bd4a71", "address": "fa:16:3e:46:dc:53", "network": {"id": "9dfb5db2-5cef-4f79-a41d-af4ae6967c09", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1976265278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a79b69221f742dc9f128dd708d1b9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0997f4aa-17", "ovs_interfaceid": "0997f4aa-17bc-4f72-b43a-63eb00bd4a71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:47:56 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-be8b67cb-6d8b-4241-8af4-eba28fa2202d tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Converting VIF {"id": "0997f4aa-17bc-4f72-b43a-63eb00bd4a71", "address": "fa:16:3e:46:dc:53", "network": {"id": "9dfb5db2-5cef-4f79-a41d-af4ae6967c09", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1976265278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a79b69221f742dc9f128dd708d1b9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0997f4aa-17", "ovs_interfaceid": "0997f4aa-17bc-4f72-b43a-63eb00bd4a71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:47:56 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-be8b67cb-6d8b-4241-8af4-eba28fa2202d tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:dc:53,bridge_name='br-int',has_traffic_filtering=True,id=0997f4aa-17bc-4f72-b43a-63eb00bd4a71,network=Network(9dfb5db2-5cef-4f79-a41d-af4ae6967c09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0997f4aa-17') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:47:56 user nova-compute[74821]: DEBUG os_vif [None req-be8b67cb-6d8b-4241-8af4-eba28fa2202d tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:dc:53,bridge_name='br-int',has_traffic_filtering=True,id=0997f4aa-17bc-4f72-b43a-63eb00bd4a71,network=Network(9dfb5db2-5cef-4f79-a41d-af4ae6967c09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0997f4aa-17') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:47:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0997f4aa-17, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:47:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=16611c90-0759-485c-92f9-e700ddc12afd) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:47:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:47:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:47:56 user nova-compute[74821]: INFO os_vif [None req-be8b67cb-6d8b-4241-8af4-eba28fa2202d tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:dc:53,bridge_name='br-int',has_traffic_filtering=True,id=0997f4aa-17bc-4f72-b43a-63eb00bd4a71,network=Network(9dfb5db2-5cef-4f79-a41d-af4ae6967c09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0997f4aa-17')
Nov 06 13:47:56 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-be8b67cb-6d8b-4241-8af4-eba28fa2202d tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Deleting instance files /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d_del
Nov 06 13:47:56 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-be8b67cb-6d8b-4241-8af4-eba28fa2202d tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Deletion of /opt/stack/data/nova/instances/db04d895-338b-46fb-af08-779ad5d1181d_del complete
Nov 06 13:47:56 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._sync_power_states {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:47:56 user nova-compute[74821]: INFO nova.compute.manager [None req-be8b67cb-6d8b-4241-8af4-eba28fa2202d tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 06 13:47:56 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-be8b67cb-6d8b-4241-8af4-eba28fa2202d tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:47:56 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:47:56 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: db04d895-338b-46fb-af08-779ad5d1181d] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:47:56 user nova-compute[74821]: WARNING nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] While synchronizing instance power states, found 2 instances in the database and 1 instances on the hypervisor.
Nov 06 13:47:56 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Triggering sync for uuid db04d895-338b-46fb-af08-779ad5d1181d {{(pid=74821) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 13:47:56 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Triggering sync for uuid c3293c45-e843-4d6b-bc15-a10010a24ea6 {{(pid=74821) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 06 13:47:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "db04d895-338b-46fb-af08-779ad5d1181d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:47:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "c3293c45-e843-4d6b-bc15-a10010a24ea6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:47:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:47:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:47:57 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:47:57 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Took 0.71 seconds to deallocate network for instance.
Nov 06 13:47:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-be8b67cb-6d8b-4241-8af4-eba28fa2202d tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:47:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-be8b67cb-6d8b-4241-8af4-eba28fa2202d tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:47:57 user nova-compute[74821]: DEBUG nova.compute.manager [req-379498b5-b0f8-4baf-9b20-acfb08f9257a req-54e1e58a-091b-4d3a-9bba-a93e0dc0c6cf service nova] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Received event network-vif-deleted-0997f4aa-17bc-4f72-b43a-63eb00bd4a71 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:47:57 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-be8b67cb-6d8b-4241-8af4-eba28fa2202d tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:47:57 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-be8b67cb-6d8b-4241-8af4-eba28fa2202d tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:47:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-be8b67cb-6d8b-4241-8af4-eba28fa2202d tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:47:57 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-be8b67cb-6d8b-4241-8af4-eba28fa2202d tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Deleted allocations for instance db04d895-338b-46fb-af08-779ad5d1181d
Nov 06 13:47:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-be8b67cb-6d8b-4241-8af4-eba28fa2202d tempest-SnapshotDataIntegrityTests-1195143959 tempest-SnapshotDataIntegrityTests-1195143959-project-member] Lock "db04d895-338b-46fb-af08-779ad5d1181d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.951s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:47:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "db04d895-338b-46fb-af08-779ad5d1181d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.037s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:47:57 user nova-compute[74821]: INFO nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: db04d895-338b-46fb-af08-779ad5d1181d] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 06 13:47:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "db04d895-338b-46fb-af08-779ad5d1181d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:47:57 user nova-compute[74821]: DEBUG nova.compute.manager [req-40fa8293-a743-4f0d-ba17-74f53712f518 req-2e8d6020-98a8-44a7-8641-38fb8b77de92 service nova] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Received event network-vif-plugged-0997f4aa-17bc-4f72-b43a-63eb00bd4a71 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:47:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-40fa8293-a743-4f0d-ba17-74f53712f518 req-2e8d6020-98a8-44a7-8641-38fb8b77de92 service nova] Acquiring lock "db04d895-338b-46fb-af08-779ad5d1181d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:47:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-40fa8293-a743-4f0d-ba17-74f53712f518 req-2e8d6020-98a8-44a7-8641-38fb8b77de92 service nova] Lock "db04d895-338b-46fb-af08-779ad5d1181d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:47:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-40fa8293-a743-4f0d-ba17-74f53712f518 req-2e8d6020-98a8-44a7-8641-38fb8b77de92 service nova] Lock "db04d895-338b-46fb-af08-779ad5d1181d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:47:57 user nova-compute[74821]: DEBUG nova.compute.manager [req-40fa8293-a743-4f0d-ba17-74f53712f518 req-2e8d6020-98a8-44a7-8641-38fb8b77de92 service nova] [instance: db04d895-338b-46fb-af08-779ad5d1181d] No waiting events found dispatching network-vif-plugged-0997f4aa-17bc-4f72-b43a-63eb00bd4a71 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:47:57 user nova-compute[74821]: WARNING nova.compute.manager [req-40fa8293-a743-4f0d-ba17-74f53712f518 req-2e8d6020-98a8-44a7-8641-38fb8b77de92 service nova] [instance: db04d895-338b-46fb-af08-779ad5d1181d] Received unexpected event network-vif-plugged-0997f4aa-17bc-4f72-b43a-63eb00bd4a71 for instance with vm_state deleted and task_state None.
Nov 06 13:47:58 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:47:58 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:47:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:47:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:47:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:47:58 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:47:59 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:47:59 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:47:59 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:47:59 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:47:59 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:47:59 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:47:59 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=8796MB free_disk=25.121673583984375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:47:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:47:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:48:00 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance c3293c45-e843-4d6b-bc15-a10010a24ea6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:48:00 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:48:00 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:48:00 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Refreshing inventories for resource provider a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 13:48:00 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Updating ProviderTree inventory for provider a45ec519-15f5-48fe-877b-466db09f8afe from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 13:48:00 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Updating inventory in ProviderTree for provider a45ec519-15f5-48fe-877b-466db09f8afe with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 13:48:00 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Refreshing aggregate associations for resource provider a45ec519-15f5-48fe-877b-466db09f8afe, aggregates: None {{(pid=74821) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 13:48:00 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Refreshing trait associations for resource provider a45ec519-15f5-48fe-877b-466db09f8afe, traits: COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42 {{(pid=74821) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 13:48:00 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:48:00 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:48:00 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:48:00 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:48:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:48:01 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:48:01 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:48:01 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:48:01 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:48:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:48:06 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:48:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:48:11 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:48:13 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:48:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:48:21 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:48:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:48:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:48:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:48:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:48:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:48:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:48:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "9ad0a4b2-8071-48cb-8cca-bd05bf40c590" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:48:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "9ad0a4b2-8071-48cb-8cca-bd05bf40c590" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:48:27 user nova-compute[74821]: DEBUG nova.compute.manager [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:48:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:48:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:48:27 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:48:27 user nova-compute[74821]: INFO nova.compute.claims [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Claim successful on node user
Nov 06 13:48:27 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:48:27 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:48:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.292s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:48:27 user nova-compute[74821]: DEBUG nova.compute.manager [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:48:27 user nova-compute[74821]: DEBUG nova.compute.manager [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:48:27 user nova-compute[74821]: DEBUG nova.network.neutron [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:48:27 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:48:27 user nova-compute[74821]: DEBUG nova.compute.manager [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:48:27 user nova-compute[74821]: DEBUG nova.policy [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3bb6a168d90a4795a72b8ac69eeadcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e811a3a30417a8dc6ccad03f2f8e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:48:27 user nova-compute[74821]: INFO nova.virt.block_device [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Booting with volume 9600620b-087a-4abc-bee1-b4e3c18b77e8 at /dev/vda
Nov 06 13:48:27 user nova-compute[74821]: DEBUG os_brick.utils [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:48:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:48:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:48:27 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[479346c4-fca1-4596-816e-8089e78b4cf6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:48:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:48:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:48:27 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5079cef1-9dee-4faf-af35-3a33fe948223]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:48:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:48:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:48:27 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a67129f-8f10-46e1-afd9-ab204c3d2d5a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:48:27 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b175fd87-02be-4954-9147-bd90965b5a1e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:48:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:48:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:48:27 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:48:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:48:27 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:48:27 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:48:27 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0603f6-b7f3-4de5-9b9f-2607719faaf8]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:48:27 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:48:27 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:48:27 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:48:27 user nova-compute[74821]: DEBUG os_brick.utils [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:48:27 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Updating existing volume attachment record: 1be91bbb-ae53-498b-983c-6facbdc7fd03 {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:48:28 user nova-compute[74821]: DEBUG nova.network.neutron [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Successfully created port: 5b1366a3-69e9-4118-8e38-026944e8d7a6 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:48:29 user nova-compute[74821]: DEBUG nova.network.neutron [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Successfully updated port: 5b1366a3-69e9-4118-8e38-026944e8d7a6 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:48:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "refresh_cache-9ad0a4b2-8071-48cb-8cca-bd05bf40c590" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:48:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquired lock "refresh_cache-9ad0a4b2-8071-48cb-8cca-bd05bf40c590" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:48:29 user nova-compute[74821]: DEBUG nova.network.neutron [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:48:29 user nova-compute[74821]: DEBUG nova.compute.manager [req-8e98f4fb-2040-4456-970c-d080c91afd8c req-b6df8135-e132-4212-a1a7-10f6daddd4bb service nova] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Received event network-changed-5b1366a3-69e9-4118-8e38-026944e8d7a6 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:48:29 user nova-compute[74821]: DEBUG nova.compute.manager [req-8e98f4fb-2040-4456-970c-d080c91afd8c req-b6df8135-e132-4212-a1a7-10f6daddd4bb service nova] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Refreshing instance network info cache due to event network-changed-5b1366a3-69e9-4118-8e38-026944e8d7a6. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:48:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8e98f4fb-2040-4456-970c-d080c91afd8c req-b6df8135-e132-4212-a1a7-10f6daddd4bb service nova] Acquiring lock "refresh_cache-9ad0a4b2-8071-48cb-8cca-bd05bf40c590" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:48:29 user nova-compute[74821]: DEBUG nova.network.neutron [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:48:29 user nova-compute[74821]: DEBUG nova.network.neutron [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Updating instance_info_cache with network_info: [{"id": "5b1366a3-69e9-4118-8e38-026944e8d7a6", "address": "fa:16:3e:c1:bd:02", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1366a3-69", "ovs_interfaceid": "5b1366a3-69e9-4118-8e38-026944e8d7a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:48:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Releasing lock "refresh_cache-9ad0a4b2-8071-48cb-8cca-bd05bf40c590" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:48:29 user nova-compute[74821]: DEBUG nova.compute.manager [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Instance network_info: |[{"id": "5b1366a3-69e9-4118-8e38-026944e8d7a6", "address": "fa:16:3e:c1:bd:02", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1366a3-69", "ovs_interfaceid": "5b1366a3-69e9-4118-8e38-026944e8d7a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:48:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8e98f4fb-2040-4456-970c-d080c91afd8c req-b6df8135-e132-4212-a1a7-10f6daddd4bb service nova] Acquired lock "refresh_cache-9ad0a4b2-8071-48cb-8cca-bd05bf40c590" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:48:29 user nova-compute[74821]: DEBUG nova.network.neutron [req-8e98f4fb-2040-4456-970c-d080c91afd8c req-b6df8135-e132-4212-a1a7-10f6daddd4bb service nova] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Refreshing network info cache for port 5b1366a3-69e9-4118-8e38-026944e8d7a6 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:48:29 user nova-compute[74821]: DEBUG nova.network.neutron [req-8e98f4fb-2040-4456-970c-d080c91afd8c req-b6df8135-e132-4212-a1a7-10f6daddd4bb service nova] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Updated VIF entry in instance network info cache for port 5b1366a3-69e9-4118-8e38-026944e8d7a6. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:48:29 user nova-compute[74821]: DEBUG nova.network.neutron [req-8e98f4fb-2040-4456-970c-d080c91afd8c req-b6df8135-e132-4212-a1a7-10f6daddd4bb service nova] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Updating instance_info_cache with network_info: [{"id": "5b1366a3-69e9-4118-8e38-026944e8d7a6", "address": "fa:16:3e:c1:bd:02", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1366a3-69", "ovs_interfaceid": "5b1366a3-69e9-4118-8e38-026944e8d7a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:48:29 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-8e98f4fb-2040-4456-970c-d080c91afd8c req-b6df8135-e132-4212-a1a7-10f6daddd4bb service nova] Releasing lock "refresh_cache-9ad0a4b2-8071-48cb-8cca-bd05bf40c590" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:48:31 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:48:36 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:48:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:48:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:48:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:48:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:48:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:48:41 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:48:46 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:48:46 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG nova.compute.manager [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:48:49 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Creating image(s)
Nov 06 13:48:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Did not create local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Ensure instance console log exists: /opt/stack/data/nova/instances/9ad0a4b2-8071-48cb-8cca-bd05bf40c590/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Start _get_guest_xml network_info=[{"id": "5b1366a3-69e9-4118-8e38-026944e8d7a6", "address": "fa:16:3e:c1:bd:02", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1366a3-69", "ovs_interfaceid": "5b1366a3-69e9-4118-8e38-026944e8d7a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ytXCSQzf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9ad0a4b2-8071-48cb-8cca-bd05bf40c590', 'attached_at': '', 'detached_at': '', 'volume_id': '9600620b-087a-4abc-bee1-b4e3c18b77e8', 'serial': '9600620b-087a-4abc-bee1-b4e3c18b77e8'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '1be91bbb-ae53-498b-983c-6facbdc7fd03', 'volume_type': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:48:49 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:48:49 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:48:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ytXCSQzf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:48:49 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:48:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:48:49 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:48:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:48:49 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:48:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c71d97-8fe7-4c15-a4d8-ccb41cfc2b9c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:48:49 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed18363-ef99-47f2-beda-f145d3c3747d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8] added
Nov 06 13:48:49 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8bb50a-33e6-4156-b7f1-cf1fc12e65d2]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[01758468-8446-48c6-ba40-327438190439]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ytXCSQzf {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ytXCSQzf" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddcd1f9-0547-46da-aadc-af0770a45634]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ytXCSQzf'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[845c605f-1a8f-43e7-a3eb-3eefe2ff4ce9]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79af7a4-5b47-48b1-ba0f-b30311145eb9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 06 13:48:49 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 06 13:48:49 user nova-compute[74821]:  {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:48:49 user nova-compute[74821]: WARNING os_brick.initiator.connectors.iscsi [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 06 13:48:49 user nova-compute[74821]: 
Nov 06 13:48:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3266a397-5d7c-4e12-a063-5acb3247dbd3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8, portal: 172.16.0.220,3260]
Nov 06 13:48:49 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8, portal: 172.16.0.220,3260] successful.
Nov 06 13:48:49 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a1d3eb-1318-4ea8-9c6c-c8f39bcaf246]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d329099-529b-4af3-ba44-4e25b4190428]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 (non-flash)
Nov 06 13:48:49 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 (non-flash)
Nov 06 13:48:49 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c304d009-840c-4963-b723-0bd9f2901074]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:48:49 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ytXCSQzf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:48:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:48:50 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26434646637643463', 'path': '/dev/sdb'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:48:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434646637643463', 'path': '/dev/sdb'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:48:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:48:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2118364660',display_name='tempest-TestVolumeBootPattern-server-2118364660',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2118364660',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfkJ+gcSdYeVBScTbHfbQppT+GyWkt0sgvXBBnJvMr4dzybcwiVijK0IZrgpO4n3M0oU/D2RJOqwTHI/tQmkgtCEBZc1yLKKsxKLmfpxs7+Nu7iryecTOj297JFUnXZvw==',key_name='tempest-TestVolumeBootPattern-11065527',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c8e811a3a30417a8dc6ccad03f2f8e0',ramdisk_id='',reservation_id='r-7w7vkics',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1930796442',owner_user_name='tempest-TestVolumeBootPattern-1930796442-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:48:28Z,user_data=None,user_id='3bb6a168d90a4795a72b8ac69eeadcc9',uuid=9ad0a4b2-8071-48cb-8cca-bd05bf40c590,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b1366a3-69e9-4118-8e38-026944e8d7a6", "address": "fa:16:3e:c1:bd:02", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1366a3-69", "ovs_interfaceid": "5b1366a3-69e9-4118-8e38-026944e8d7a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:48:50 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Converting VIF {"id": "5b1366a3-69e9-4118-8e38-026944e8d7a6", "address": "fa:16:3e:c1:bd:02", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1366a3-69", "ovs_interfaceid": "5b1366a3-69e9-4118-8e38-026944e8d7a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:48:50 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:bd:02,bridge_name='br-int',has_traffic_filtering=True,id=5b1366a3-69e9-4118-8e38-026944e8d7a6,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b1366a3-69') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:48:50 user nova-compute[74821]: DEBUG nova.objects.instance [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ad0a4b2-8071-48cb-8cca-bd05bf40c590 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:48:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:48:50 user nova-compute[74821]:   <uuid>9ad0a4b2-8071-48cb-8cca-bd05bf40c590</uuid>
Nov 06 13:48:50 user nova-compute[74821]:   <name>instance-00000032</name>
Nov 06 13:48:50 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:48:50 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:48:50 user nova-compute[74821]:   <metadata>
Nov 06 13:48:50 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:48:50 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:48:50 user nova-compute[74821]:       <nova:name>tempest-TestVolumeBootPattern-server-2118364660</nova:name>
Nov 06 13:48:50 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:48:49</nova:creationTime>
Nov 06 13:48:50 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:48:50 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:48:50 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:48:50 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:48:50 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:48:50 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:48:50 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:48:50 user nova-compute[74821]:       <nova:owner>
Nov 06 13:48:50 user nova-compute[74821]:         <nova:user uuid="3bb6a168d90a4795a72b8ac69eeadcc9">tempest-TestVolumeBootPattern-1930796442-project-member</nova:user>
Nov 06 13:48:50 user nova-compute[74821]:         <nova:project uuid="2c8e811a3a30417a8dc6ccad03f2f8e0">tempest-TestVolumeBootPattern-1930796442</nova:project>
Nov 06 13:48:50 user nova-compute[74821]:       </nova:owner>
Nov 06 13:48:50 user nova-compute[74821]:       <nova:ports>
Nov 06 13:48:50 user nova-compute[74821]:         <nova:port uuid="5b1366a3-69e9-4118-8e38-026944e8d7a6">
Nov 06 13:48:50 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 06 13:48:50 user nova-compute[74821]:         </nova:port>
Nov 06 13:48:50 user nova-compute[74821]:       </nova:ports>
Nov 06 13:48:50 user nova-compute[74821]:     </nova:instance>
Nov 06 13:48:50 user nova-compute[74821]:   </metadata>
Nov 06 13:48:50 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:48:50 user nova-compute[74821]:     <system>
Nov 06 13:48:50 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:48:50 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:48:50 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:48:50 user nova-compute[74821]:       <entry name="serial">9ad0a4b2-8071-48cb-8cca-bd05bf40c590</entry>
Nov 06 13:48:50 user nova-compute[74821]:       <entry name="uuid">9ad0a4b2-8071-48cb-8cca-bd05bf40c590</entry>
Nov 06 13:48:50 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:48:50 user nova-compute[74821]:     </system>
Nov 06 13:48:50 user nova-compute[74821]:   </sysinfo>
Nov 06 13:48:50 user nova-compute[74821]:   <os>
Nov 06 13:48:50 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:48:50 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:48:50 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:48:50 user nova-compute[74821]:   </os>
Nov 06 13:48:50 user nova-compute[74821]:   <features>
Nov 06 13:48:50 user nova-compute[74821]:     <acpi/>
Nov 06 13:48:50 user nova-compute[74821]:     <apic/>
Nov 06 13:48:50 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:48:50 user nova-compute[74821]:   </features>
Nov 06 13:48:50 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:48:50 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:48:50 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:48:50 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:48:50 user nova-compute[74821]:   </clock>
Nov 06 13:48:50 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:48:50 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:48:50 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:48:50 user nova-compute[74821]:   </cpu>
Nov 06 13:48:50 user nova-compute[74821]:   <devices>
Nov 06 13:48:50 user nova-compute[74821]:     <disk type="block" device="disk">
Nov 06 13:48:50 user nova-compute[74821]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:48:50 user nova-compute[74821]:       <source dev="/dev/sdb"/>
Nov 06 13:48:50 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:48:50 user nova-compute[74821]:       <serial>9600620b-087a-4abc-bee1-b4e3c18b77e8</serial>
Nov 06 13:48:50 user nova-compute[74821]:     </disk>
Nov 06 13:48:50 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:48:50 user nova-compute[74821]:       <mac address="fa:16:3e:c1:bd:02"/>
Nov 06 13:48:50 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:48:50 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:48:50 user nova-compute[74821]:       <target dev="tap5b1366a3-69"/>
Nov 06 13:48:50 user nova-compute[74821]:     </interface>
Nov 06 13:48:50 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:48:50 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/9ad0a4b2-8071-48cb-8cca-bd05bf40c590/console.log" append="off"/>
Nov 06 13:48:50 user nova-compute[74821]:     </serial>
Nov 06 13:48:50 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:48:50 user nova-compute[74821]:     <video>
Nov 06 13:48:50 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:48:50 user nova-compute[74821]:     </video>
Nov 06 13:48:50 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:48:50 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:48:50 user nova-compute[74821]:     </rng>
Nov 06 13:48:50 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:48:50 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:48:50 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:48:50 user nova-compute[74821]:     </memballoon>
Nov 06 13:48:50 user nova-compute[74821]:   </devices>
Nov 06 13:48:50 user nova-compute[74821]: </domain>
Nov 06 13:48:50 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:48:50 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:48:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2118364660',display_name='tempest-TestVolumeBootPattern-server-2118364660',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2118364660',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfkJ+gcSdYeVBScTbHfbQppT+GyWkt0sgvXBBnJvMr4dzybcwiVijK0IZrgpO4n3M0oU/D2RJOqwTHI/tQmkgtCEBZc1yLKKsxKLmfpxs7+Nu7iryecTOj297JFUnXZvw==',key_name='tempest-TestVolumeBootPattern-11065527',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c8e811a3a30417a8dc6ccad03f2f8e0',ramdisk_id='',reservation_id='r-7w7vkics',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1930796442',owner_user_name='tempest-TestVolumeBootPattern-1930796442-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:48:28Z,user_data=None,user_id='3bb6a168d90a4795a72b8ac69eeadcc9',uuid=9ad0a4b2-8071-48cb-8cca-bd05bf40c590,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b1366a3-69e9-4118-8e38-026944e8d7a6", "address": "fa:16:3e:c1:bd:02", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1366a3-69", "ovs_interfaceid": "5b1366a3-69e9-4118-8e38-026944e8d7a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:48:50 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Converting VIF {"id": "5b1366a3-69e9-4118-8e38-026944e8d7a6", "address": "fa:16:3e:c1:bd:02", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1366a3-69", "ovs_interfaceid": "5b1366a3-69e9-4118-8e38-026944e8d7a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:48:50 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:bd:02,bridge_name='br-int',has_traffic_filtering=True,id=5b1366a3-69e9-4118-8e38-026944e8d7a6,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b1366a3-69') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:48:50 user nova-compute[74821]: DEBUG os_vif [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:bd:02,bridge_name='br-int',has_traffic_filtering=True,id=5b1366a3-69e9-4118-8e38-026944e8d7a6,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b1366a3-69') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:48:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:48:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:48:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:48:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:48:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '785b94c4-6fba-5eb3-821d-f319cd1907a1', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:48:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:48:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:48:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:48:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b1366a3-69, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:48:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b1366a3-69, col_values=(('qos', UUID('ed6fe8f3-fc09-4b92-a667-807b1403f1c4')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:48:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b1366a3-69, col_values=(('external_ids', {'iface-id': '5b1366a3-69e9-4118-8e38-026944e8d7a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:bd:02', 'vm-uuid': '9ad0a4b2-8071-48cb-8cca-bd05bf40c590'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:48:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:48:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:48:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:48:50 user nova-compute[74821]: INFO os_vif [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:bd:02,bridge_name='br-int',has_traffic_filtering=True,id=5b1366a3-69e9-4118-8e38-026944e8d7a6,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b1366a3-69')
Nov 06 13:48:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:48:51 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] No VIF found with MAC fa:16:3e:c1:bd:02, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:48:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:48:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:48:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:48:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-b9136b81-5103-4839-9717-8b8cfb460255 req-cdea660c-7eb5-41bf-90ae-decd916965b4 service nova] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Received event network-vif-plugged-5b1366a3-69e9-4118-8e38-026944e8d7a6 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:48:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b9136b81-5103-4839-9717-8b8cfb460255 req-cdea660c-7eb5-41bf-90ae-decd916965b4 service nova] Acquiring lock "9ad0a4b2-8071-48cb-8cca-bd05bf40c590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:48:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b9136b81-5103-4839-9717-8b8cfb460255 req-cdea660c-7eb5-41bf-90ae-decd916965b4 service nova] Lock "9ad0a4b2-8071-48cb-8cca-bd05bf40c590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:48:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-b9136b81-5103-4839-9717-8b8cfb460255 req-cdea660c-7eb5-41bf-90ae-decd916965b4 service nova] Lock "9ad0a4b2-8071-48cb-8cca-bd05bf40c590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:48:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-b9136b81-5103-4839-9717-8b8cfb460255 req-cdea660c-7eb5-41bf-90ae-decd916965b4 service nova] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] No waiting events found dispatching network-vif-plugged-5b1366a3-69e9-4118-8e38-026944e8d7a6 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:48:52 user nova-compute[74821]: WARNING nova.compute.manager [req-b9136b81-5103-4839-9717-8b8cfb460255 req-cdea660c-7eb5-41bf-90ae-decd916965b4 service nova] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Received unexpected event network-vif-plugged-5b1366a3-69e9-4118-8e38-026944e8d7a6 for instance with vm_state building and task_state spawning.
Nov 06 13:48:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:48:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:48:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:48:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:48:53 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:48:53 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:48:53 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:48:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-c3293c45-e843-4d6b-bc15-a10010a24ea6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:48:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-c3293c45-e843-4d6b-bc15-a10010a24ea6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:48:54 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:48:54 user nova-compute[74821]: DEBUG nova.compute.manager [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:48:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:48:54 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Instance spawned successfully.
Nov 06 13:48:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:48:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:48:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:48:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:48:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:48:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:48:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:48:54 user nova-compute[74821]: DEBUG nova.compute.manager [req-9ca7f2be-877a-404c-82f0-1bfd4be6b77a req-c51f2fdc-63f6-43b0-9b8c-5194fa45b34c service nova] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Received event network-vif-plugged-5b1366a3-69e9-4118-8e38-026944e8d7a6 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:48:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-9ca7f2be-877a-404c-82f0-1bfd4be6b77a req-c51f2fdc-63f6-43b0-9b8c-5194fa45b34c service nova] Acquiring lock "9ad0a4b2-8071-48cb-8cca-bd05bf40c590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:48:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-9ca7f2be-877a-404c-82f0-1bfd4be6b77a req-c51f2fdc-63f6-43b0-9b8c-5194fa45b34c service nova] Lock "9ad0a4b2-8071-48cb-8cca-bd05bf40c590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:48:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-9ca7f2be-877a-404c-82f0-1bfd4be6b77a req-c51f2fdc-63f6-43b0-9b8c-5194fa45b34c service nova] Lock "9ad0a4b2-8071-48cb-8cca-bd05bf40c590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:48:54 user nova-compute[74821]: DEBUG nova.compute.manager [req-9ca7f2be-877a-404c-82f0-1bfd4be6b77a req-c51f2fdc-63f6-43b0-9b8c-5194fa45b34c service nova] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] No waiting events found dispatching network-vif-plugged-5b1366a3-69e9-4118-8e38-026944e8d7a6 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:48:54 user nova-compute[74821]: WARNING nova.compute.manager [req-9ca7f2be-877a-404c-82f0-1bfd4be6b77a req-c51f2fdc-63f6-43b0-9b8c-5194fa45b34c service nova] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Received unexpected event network-vif-plugged-5b1366a3-69e9-4118-8e38-026944e8d7a6 for instance with vm_state building and task_state spawning.
Nov 06 13:48:54 user nova-compute[74821]: INFO nova.compute.manager [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Took 5.19 seconds to spawn the instance on the hypervisor.
Nov 06 13:48:54 user nova-compute[74821]: DEBUG nova.compute.manager [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:48:54 user nova-compute[74821]: INFO nova.compute.manager [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Took 27.65 seconds to build instance.
Nov 06 13:48:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9f622c4d-2781-4875-8844-1772f0c4244c tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "9ad0a4b2-8071-48cb-8cca-bd05bf40c590" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.943s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:48:55 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Updating instance_info_cache with network_info: [{"id": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "address": "fa:16:3e:87:40:ab", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da3ffbf-3f", "ovs_interfaceid": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:48:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-c3293c45-e843-4d6b-bc15-a10010a24ea6" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:48:55 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:48:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:48:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:48:55 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:48:55 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:48:57 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:48:59 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:48:59 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:49:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:49:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:49:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:49:00 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:49:00 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:49:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:49:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:49:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:49:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:49:00 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:49:00 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:49:00 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:49:00 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=8814MB free_disk=25.117977142333984GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:49:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:49:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:49:01 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance c3293c45-e843-4d6b-bc15-a10010a24ea6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:49:01 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 9ad0a4b2-8071-48cb-8cca-bd05bf40c590 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:49:01 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:49:01 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:49:01 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:49:01 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:49:01 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:49:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.275s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:49:02 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:49:02 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:49:03 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:49:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:49:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:49:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:49:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:49:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:49:05 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:49:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:49:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:49:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:49:15 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:49:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:49:20 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:49:20 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:49:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:49:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:49:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9f5ccc4b-cf9e-47b5-aa4d-f826cae4f831 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "c3293c45-e843-4d6b-bc15-a10010a24ea6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:49:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9f5ccc4b-cf9e-47b5-aa4d-f826cae4f831 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:49:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9f5ccc4b-cf9e-47b5-aa4d-f826cae4f831 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:49:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9f5ccc4b-cf9e-47b5-aa4d-f826cae4f831 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:49:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9f5ccc4b-cf9e-47b5-aa4d-f826cae4f831 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:49:26 user nova-compute[74821]: INFO nova.compute.manager [None req-9f5ccc4b-cf9e-47b5-aa4d-f826cae4f831 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Terminating instance
Nov 06 13:49:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-9f5ccc4b-cf9e-47b5-aa4d-f826cae4f831 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:49:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:49:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:49:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:49:26 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:49:26 user nova-compute[74821]: DEBUG nova.compute.manager [req-3af267fb-c2da-4729-bf49-438275fde7f5 req-a9113fec-9bd1-4a03-9627-104ceaeceee5 service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Received event network-vif-unplugged-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:49:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3af267fb-c2da-4729-bf49-438275fde7f5 req-a9113fec-9bd1-4a03-9627-104ceaeceee5 service nova] Acquiring lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:49:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3af267fb-c2da-4729-bf49-438275fde7f5 req-a9113fec-9bd1-4a03-9627-104ceaeceee5 service nova] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:49:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-3af267fb-c2da-4729-bf49-438275fde7f5 req-a9113fec-9bd1-4a03-9627-104ceaeceee5 service nova] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:49:26 user nova-compute[74821]: DEBUG nova.compute.manager [req-3af267fb-c2da-4729-bf49-438275fde7f5 req-a9113fec-9bd1-4a03-9627-104ceaeceee5 service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] No waiting events found dispatching network-vif-unplugged-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:49:26 user nova-compute[74821]: DEBUG nova.compute.manager [req-3af267fb-c2da-4729-bf49-438275fde7f5 req-a9113fec-9bd1-4a03-9627-104ceaeceee5 service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Received event network-vif-unplugged-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:49:27 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Instance destroyed successfully.
Nov 06 13:49:27 user nova-compute[74821]: DEBUG nova.objects.instance [None req-9f5ccc4b-cf9e-47b5-aa4d-f826cae4f831 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lazy-loading 'resources' on Instance uuid c3293c45-e843-4d6b-bc15-a10010a24ea6 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:49:27 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-9f5ccc4b-cf9e-47b5-aa4d-f826cae4f831 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:39:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1993604917',display_name='tempest-AttachVolumeTestJSON-server-1993604917',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1993604917',id=45,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVB62RpV7sb/k2zRM/ERNI4ujnBhy7CTod4Pfx14PprgP+C8QSul7cOBioxpJJqMn0wC1iI7xPCkFVcTSwGlIE5o2jmZYDIM/eqmdyMBPfuKA5g8IgRvnLBPlG3P7M+Gw==',key_name='tempest-keypair-2114445980',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:39:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f3e02b312774fffa90b9aea7611b7d2',ramdisk_id='',reservation_id='r-e3xww6ds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1920917363',owner_user_name='tempest-AttachVolumeTestJSON-1920917363-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:47:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88ff13567ecb4157898a278d3ae6e0d0',uuid=c3293c45-e843-4d6b-bc15-a10010a24ea6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "address": "fa:16:3e:87:40:ab", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da3ffbf-3f", "ovs_interfaceid": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:49:27 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-9f5ccc4b-cf9e-47b5-aa4d-f826cae4f831 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Converting VIF {"id": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "address": "fa:16:3e:87:40:ab", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4da3ffbf-3f", "ovs_interfaceid": "4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:49:27 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-9f5ccc4b-cf9e-47b5-aa4d-f826cae4f831 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:40:ab,bridge_name='br-int',has_traffic_filtering=True,id=4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec,network=Network(a2ec52e9-7476-4ced-9810-d58d3f9eec4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4da3ffbf-3f') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:49:27 user nova-compute[74821]: DEBUG os_vif [None req-9f5ccc4b-cf9e-47b5-aa4d-f826cae4f831 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:40:ab,bridge_name='br-int',has_traffic_filtering=True,id=4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec,network=Network(a2ec52e9-7476-4ced-9810-d58d3f9eec4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4da3ffbf-3f') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:49:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:49:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4da3ffbf-3f, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:49:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:49:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:49:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:49:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e054e12-b412-4742-bcc1-a94dce931431) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:49:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:49:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:49:27 user nova-compute[74821]: INFO os_vif [None req-9f5ccc4b-cf9e-47b5-aa4d-f826cae4f831 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:40:ab,bridge_name='br-int',has_traffic_filtering=True,id=4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec,network=Network(a2ec52e9-7476-4ced-9810-d58d3f9eec4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4da3ffbf-3f')
Nov 06 13:49:27 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-9f5ccc4b-cf9e-47b5-aa4d-f826cae4f831 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Deleting instance files /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6_del
Nov 06 13:49:27 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-9f5ccc4b-cf9e-47b5-aa4d-f826cae4f831 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Deletion of /opt/stack/data/nova/instances/c3293c45-e843-4d6b-bc15-a10010a24ea6_del complete
Nov 06 13:49:27 user nova-compute[74821]: INFO nova.compute.manager [None req-9f5ccc4b-cf9e-47b5-aa4d-f826cae4f831 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 06 13:49:27 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-9f5ccc4b-cf9e-47b5-aa4d-f826cae4f831 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:49:27 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:49:27 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:49:27 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:49:27 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Took 0.62 seconds to deallocate network for instance.
Nov 06 13:49:27 user nova-compute[74821]: DEBUG nova.compute.manager [req-ed33d621-c203-4fba-abb1-29bbcf6eab5d req-a4bc6d7d-c81a-40b9-a56f-7b1110157a0b service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Received event network-vif-deleted-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:49:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9f5ccc4b-cf9e-47b5-aa4d-f826cae4f831 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:49:27 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9f5ccc4b-cf9e-47b5-aa4d-f826cae4f831 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:49:28 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-9f5ccc4b-cf9e-47b5-aa4d-f826cae4f831 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:49:28 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-9f5ccc4b-cf9e-47b5-aa4d-f826cae4f831 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:49:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9f5ccc4b-cf9e-47b5-aa4d-f826cae4f831 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.139s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:49:28 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-9f5ccc4b-cf9e-47b5-aa4d-f826cae4f831 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Deleted allocations for instance c3293c45-e843-4d6b-bc15-a10010a24ea6
Nov 06 13:49:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-9f5ccc4b-cf9e-47b5-aa4d-f826cae4f831 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.870s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:49:28 user nova-compute[74821]: DEBUG nova.compute.manager [req-968a1482-1f6a-4787-a92b-9ff7a20b2035 req-cb8ef211-df6c-4ecd-8217-97b7bdc9d2c7 service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Received event network-vif-plugged-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:49:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-968a1482-1f6a-4787-a92b-9ff7a20b2035 req-cb8ef211-df6c-4ecd-8217-97b7bdc9d2c7 service nova] Acquiring lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:49:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-968a1482-1f6a-4787-a92b-9ff7a20b2035 req-cb8ef211-df6c-4ecd-8217-97b7bdc9d2c7 service nova] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:49:28 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-968a1482-1f6a-4787-a92b-9ff7a20b2035 req-cb8ef211-df6c-4ecd-8217-97b7bdc9d2c7 service nova] Lock "c3293c45-e843-4d6b-bc15-a10010a24ea6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:49:28 user nova-compute[74821]: DEBUG nova.compute.manager [req-968a1482-1f6a-4787-a92b-9ff7a20b2035 req-cb8ef211-df6c-4ecd-8217-97b7bdc9d2c7 service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] No waiting events found dispatching network-vif-plugged-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:49:28 user nova-compute[74821]: WARNING nova.compute.manager [req-968a1482-1f6a-4787-a92b-9ff7a20b2035 req-cb8ef211-df6c-4ecd-8217-97b7bdc9d2c7 service nova] [instance: c3293c45-e843-4d6b-bc15-a10010a24ea6] Received unexpected event network-vif-plugged-4da3ffbf-3fb9-41c0-a7af-ca0d348d70ec for instance with vm_state deleted and task_state None.
Nov 06 13:49:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:49:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:49:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:49:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:49:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:49:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:49:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:49:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:49:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:49:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:49:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:49:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:49:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:49:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:49:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:49:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:49:53 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:49:53 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:49:53 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Rebuilding the list of instances to heal {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 13:49:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-9ad0a4b2-8071-48cb-8cca-bd05bf40c590" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:49:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-9ad0a4b2-8071-48cb-8cca-bd05bf40c590" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:49:54 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:49:54 user nova-compute[74821]: DEBUG nova.objects.instance [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lazy-loading 'info_cache' on Instance uuid 9ad0a4b2-8071-48cb-8cca-bd05bf40c590 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:49:54 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Updating instance_info_cache with network_info: [{"id": "5b1366a3-69e9-4118-8e38-026944e8d7a6", "address": "fa:16:3e:c1:bd:02", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1366a3-69", "ovs_interfaceid": "5b1366a3-69e9-4118-8e38-026944e8d7a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:49:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-9ad0a4b2-8071-48cb-8cca-bd05bf40c590" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:49:54 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:49:56 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:49:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:49:57 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:49:57 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:49:57 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:49:59 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:49:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:49:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:49:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:49:59 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:50:00 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:50:00 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:50:00 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:50:00 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=8935MB free_disk=25.13613510131836GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:50:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:50:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:50:00 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 9ad0a4b2-8071-48cb-8cca-bd05bf40c590 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:50:00 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:50:00 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:50:00 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:50:00 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:50:00 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:50:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.217s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:50:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:50:02 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:50:02 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:50:02 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:50:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:50:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:50:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:50:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:50:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:50:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:50:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:50:16 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:50:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:50:17 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:50:18 user nova-compute[74821]: DEBUG nova.compute.manager [req-19ee0b06-fa9b-494c-b200-411eab730853 req-e0a22059-c971-40a3-8718-b899468ac500 service nova] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Received event network-changed-5b1366a3-69e9-4118-8e38-026944e8d7a6 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:50:18 user nova-compute[74821]: DEBUG nova.compute.manager [req-19ee0b06-fa9b-494c-b200-411eab730853 req-e0a22059-c971-40a3-8718-b899468ac500 service nova] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Refreshing instance network info cache due to event network-changed-5b1366a3-69e9-4118-8e38-026944e8d7a6. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:50:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-19ee0b06-fa9b-494c-b200-411eab730853 req-e0a22059-c971-40a3-8718-b899468ac500 service nova] Acquiring lock "refresh_cache-9ad0a4b2-8071-48cb-8cca-bd05bf40c590" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:50:18 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-19ee0b06-fa9b-494c-b200-411eab730853 req-e0a22059-c971-40a3-8718-b899468ac500 service nova] Acquired lock "refresh_cache-9ad0a4b2-8071-48cb-8cca-bd05bf40c590" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:50:18 user nova-compute[74821]: DEBUG nova.network.neutron [req-19ee0b06-fa9b-494c-b200-411eab730853 req-e0a22059-c971-40a3-8718-b899468ac500 service nova] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Refreshing network info cache for port 5b1366a3-69e9-4118-8e38-026944e8d7a6 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:50:19 user nova-compute[74821]: DEBUG nova.network.neutron [req-19ee0b06-fa9b-494c-b200-411eab730853 req-e0a22059-c971-40a3-8718-b899468ac500 service nova] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Updated VIF entry in instance network info cache for port 5b1366a3-69e9-4118-8e38-026944e8d7a6. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:50:19 user nova-compute[74821]: DEBUG nova.network.neutron [req-19ee0b06-fa9b-494c-b200-411eab730853 req-e0a22059-c971-40a3-8718-b899468ac500 service nova] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Updating instance_info_cache with network_info: [{"id": "5b1366a3-69e9-4118-8e38-026944e8d7a6", "address": "fa:16:3e:c1:bd:02", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1366a3-69", "ovs_interfaceid": "5b1366a3-69e9-4118-8e38-026944e8d7a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:50:19 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-19ee0b06-fa9b-494c-b200-411eab730853 req-e0a22059-c971-40a3-8718-b899468ac500 service nova] Releasing lock "refresh_cache-9ad0a4b2-8071-48cb-8cca-bd05bf40c590" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:50:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "d17ee78d-8824-4212-9322-cbbb6eed4825" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:50:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "d17ee78d-8824-4212-9322-cbbb6eed4825" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:50:20 user nova-compute[74821]: DEBUG nova.compute.manager [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:50:20 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:50:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:50:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:50:20 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:50:20 user nova-compute[74821]: INFO nova.compute.claims [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Claim successful on node user
Nov 06 13:50:20 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:50:20 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:50:20 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.249s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:50:20 user nova-compute[74821]: DEBUG nova.compute.manager [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:50:20 user nova-compute[74821]: DEBUG nova.compute.manager [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:50:20 user nova-compute[74821]: DEBUG nova.network.neutron [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:50:20 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:50:20 user nova-compute[74821]: DEBUG nova.compute.manager [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:50:20 user nova-compute[74821]: DEBUG nova.policy [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '88ff13567ecb4157898a278d3ae6e0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f3e02b312774fffa90b9aea7611b7d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:50:21 user nova-compute[74821]: DEBUG nova.compute.manager [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:50:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:50:21 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Creating image(s)
Nov 06 13:50:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "/opt/stack/data/nova/instances/d17ee78d-8824-4212-9322-cbbb6eed4825/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:50:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "/opt/stack/data/nova/instances/d17ee78d-8824-4212-9322-cbbb6eed4825/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:50:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "/opt/stack/data/nova/instances/d17ee78d-8824-4212-9322-cbbb6eed4825/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:50:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:50:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.193s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:50:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "6146e1615e448d04d59f8842ff9643af75521374" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:50:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:50:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:50:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.199s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:50:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/d17ee78d-8824-4212-9322-cbbb6eed4825/disk 1073741824 {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:50:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374,backing_fmt=raw /opt/stack/data/nova/instances/d17ee78d-8824-4212-9322-cbbb6eed4825/disk 1073741824" returned: 0 in 0.057s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:50:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "6146e1615e448d04d59f8842ff9643af75521374" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:50:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:50:21 user nova-compute[74821]: DEBUG nova.network.neutron [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Successfully created port: d24821b0-564a-4201-87d3-fee351a1f359 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:50:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6146e1615e448d04d59f8842ff9643af75521374 --force-share --output=json" returned: 0 in 0.184s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:50:21 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d17ee78d-8824-4212-9322-cbbb6eed4825/disk. size=1073741824 {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 06 13:50:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17ee78d-8824-4212-9322-cbbb6eed4825/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:50:21 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17ee78d-8824-4212-9322-cbbb6eed4825/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:50:21 user nova-compute[74821]: DEBUG nova.virt.disk.api [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Cannot resize image /opt/stack/data/nova/instances/d17ee78d-8824-4212-9322-cbbb6eed4825/disk to a smaller size. {{(pid=74821) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 06 13:50:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Created local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 06 13:50:21 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Ensure instance console log exists: /opt/stack/data/nova/instances/d17ee78d-8824-4212-9322-cbbb6eed4825/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:50:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:50:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:50:21 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG nova.network.neutron [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Successfully updated port: d24821b0-564a-4201-87d3-fee351a1f359 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "refresh_cache-d17ee78d-8824-4212-9322-cbbb6eed4825" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquired lock "refresh_cache-d17ee78d-8824-4212-9322-cbbb6eed4825" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG nova.network.neutron [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG nova.compute.manager [req-0ea2e485-8f22-4a9c-acb0-5d6231879490 req-75d9811a-8229-4655-b458-94a3174ada33 service nova] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Received event network-changed-d24821b0-564a-4201-87d3-fee351a1f359 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG nova.compute.manager [req-0ea2e485-8f22-4a9c-acb0-5d6231879490 req-75d9811a-8229-4655-b458-94a3174ada33 service nova] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Refreshing instance network info cache due to event network-changed-d24821b0-564a-4201-87d3-fee351a1f359. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0ea2e485-8f22-4a9c-acb0-5d6231879490 req-75d9811a-8229-4655-b458-94a3174ada33 service nova] Acquiring lock "refresh_cache-d17ee78d-8824-4212-9322-cbbb6eed4825" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG nova.network.neutron [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG nova.network.neutron [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Updating instance_info_cache with network_info: [{"id": "d24821b0-564a-4201-87d3-fee351a1f359", "address": "fa:16:3e:a2:37:ad", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24821b0-56", "ovs_interfaceid": "d24821b0-564a-4201-87d3-fee351a1f359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Releasing lock "refresh_cache-d17ee78d-8824-4212-9322-cbbb6eed4825" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG nova.compute.manager [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Instance network_info: |[{"id": "d24821b0-564a-4201-87d3-fee351a1f359", "address": "fa:16:3e:a2:37:ad", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24821b0-56", "ovs_interfaceid": "d24821b0-564a-4201-87d3-fee351a1f359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0ea2e485-8f22-4a9c-acb0-5d6231879490 req-75d9811a-8229-4655-b458-94a3174ada33 service nova] Acquired lock "refresh_cache-d17ee78d-8824-4212-9322-cbbb6eed4825" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG nova.network.neutron [req-0ea2e485-8f22-4a9c-acb0-5d6231879490 req-75d9811a-8229-4655-b458-94a3174ada33 service nova] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Refreshing network info cache for port d24821b0-564a-4201-87d3-fee351a1f359 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Start _get_guest_xml network_info=[{"id": "d24821b0-564a-4201-87d3-fee351a1f359", "address": "fa:16:3e:a2:37:ad", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24821b0-56", "ovs_interfaceid": "d24821b0-564a-4201-87d3-fee351a1f359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'bbed6343-3ff2-4f28-897a-55ddcbbc8268'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:50:22 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:50:22 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:50:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-06T13:06:49Z,direct_url=<?>,disk_format='qcow2',id=bbed6343-3ff2-4f28-897a-55ddcbbc8268,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='46171fd82e804115aa775e4d69ffe44c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-06T13:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2055241102',display_name='tempest-AttachVolumeTestJSON-server-2055241102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2055241102',id=51,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlGyjYTEpDOjHV+PsBYEfZQaY41KhxLEdbxt/ZVNSujzI+qVDBOQK6X/7thRI2Q3mV4nN5yZZuaU7n9RPKLv6g3Hue5CPCmRL5rtz9AGGzALQY0s7fSY+6geloiW9Rrtg==',key_name='tempest-keypair-1319999646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f3e02b312774fffa90b9aea7611b7d2',ramdisk_id='',reservation_id='r-y5npli50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1920917363',owner_user_name='tempest-AttachVolumeTestJSON-1920917363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:50:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88ff13567ecb4157898a278d3ae6e0d0',uuid=d17ee78d-8824-4212-9322-cbbb6eed4825,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d24821b0-564a-4201-87d3-fee351a1f359", "address": "fa:16:3e:a2:37:ad", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24821b0-56", "ovs_interfaceid": "d24821b0-564a-4201-87d3-fee351a1f359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Converting VIF {"id": "d24821b0-564a-4201-87d3-fee351a1f359", "address": "fa:16:3e:a2:37:ad", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24821b0-56", "ovs_interfaceid": "d24821b0-564a-4201-87d3-fee351a1f359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:37:ad,bridge_name='br-int',has_traffic_filtering=True,id=d24821b0-564a-4201-87d3-fee351a1f359,network=Network(a2ec52e9-7476-4ced-9810-d58d3f9eec4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24821b0-56') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG nova.objects.instance [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lazy-loading 'pci_devices' on Instance uuid d17ee78d-8824-4212-9322-cbbb6eed4825 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:50:22 user nova-compute[74821]:   <uuid>d17ee78d-8824-4212-9322-cbbb6eed4825</uuid>
Nov 06 13:50:22 user nova-compute[74821]:   <name>instance-00000033</name>
Nov 06 13:50:22 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:50:22 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:50:22 user nova-compute[74821]:   <metadata>
Nov 06 13:50:22 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:50:22 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:50:22 user nova-compute[74821]:       <nova:name>tempest-AttachVolumeTestJSON-server-2055241102</nova:name>
Nov 06 13:50:22 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:50:22</nova:creationTime>
Nov 06 13:50:22 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:50:22 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:50:22 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:50:22 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:50:22 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:50:22 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:50:22 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:50:22 user nova-compute[74821]:       <nova:owner>
Nov 06 13:50:22 user nova-compute[74821]:         <nova:user uuid="88ff13567ecb4157898a278d3ae6e0d0">tempest-AttachVolumeTestJSON-1920917363-project-member</nova:user>
Nov 06 13:50:22 user nova-compute[74821]:         <nova:project uuid="9f3e02b312774fffa90b9aea7611b7d2">tempest-AttachVolumeTestJSON-1920917363</nova:project>
Nov 06 13:50:22 user nova-compute[74821]:       </nova:owner>
Nov 06 13:50:22 user nova-compute[74821]:       <nova:root type="image" uuid="bbed6343-3ff2-4f28-897a-55ddcbbc8268"/>
Nov 06 13:50:22 user nova-compute[74821]:       <nova:ports>
Nov 06 13:50:22 user nova-compute[74821]:         <nova:port uuid="d24821b0-564a-4201-87d3-fee351a1f359">
Nov 06 13:50:22 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 06 13:50:22 user nova-compute[74821]:         </nova:port>
Nov 06 13:50:22 user nova-compute[74821]:       </nova:ports>
Nov 06 13:50:22 user nova-compute[74821]:     </nova:instance>
Nov 06 13:50:22 user nova-compute[74821]:   </metadata>
Nov 06 13:50:22 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:50:22 user nova-compute[74821]:     <system>
Nov 06 13:50:22 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:50:22 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:50:22 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:50:22 user nova-compute[74821]:       <entry name="serial">d17ee78d-8824-4212-9322-cbbb6eed4825</entry>
Nov 06 13:50:22 user nova-compute[74821]:       <entry name="uuid">d17ee78d-8824-4212-9322-cbbb6eed4825</entry>
Nov 06 13:50:22 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:50:22 user nova-compute[74821]:     </system>
Nov 06 13:50:22 user nova-compute[74821]:   </sysinfo>
Nov 06 13:50:22 user nova-compute[74821]:   <os>
Nov 06 13:50:22 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:50:22 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:50:22 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:50:22 user nova-compute[74821]:   </os>
Nov 06 13:50:22 user nova-compute[74821]:   <features>
Nov 06 13:50:22 user nova-compute[74821]:     <acpi/>
Nov 06 13:50:22 user nova-compute[74821]:     <apic/>
Nov 06 13:50:22 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:50:22 user nova-compute[74821]:   </features>
Nov 06 13:50:22 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:50:22 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:50:22 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:50:22 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:50:22 user nova-compute[74821]:   </clock>
Nov 06 13:50:22 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:50:22 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:50:22 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:50:22 user nova-compute[74821]:   </cpu>
Nov 06 13:50:22 user nova-compute[74821]:   <devices>
Nov 06 13:50:22 user nova-compute[74821]:     <disk type="file" device="disk">
Nov 06 13:50:22 user nova-compute[74821]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 06 13:50:22 user nova-compute[74821]:       <source file="/opt/stack/data/nova/instances/d17ee78d-8824-4212-9322-cbbb6eed4825/disk"/>
Nov 06 13:50:22 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:50:22 user nova-compute[74821]:     </disk>
Nov 06 13:50:22 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:50:22 user nova-compute[74821]:       <mac address="fa:16:3e:a2:37:ad"/>
Nov 06 13:50:22 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:50:22 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:50:22 user nova-compute[74821]:       <target dev="tapd24821b0-56"/>
Nov 06 13:50:22 user nova-compute[74821]:     </interface>
Nov 06 13:50:22 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:50:22 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/d17ee78d-8824-4212-9322-cbbb6eed4825/console.log" append="off"/>
Nov 06 13:50:22 user nova-compute[74821]:     </serial>
Nov 06 13:50:22 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:50:22 user nova-compute[74821]:     <video>
Nov 06 13:50:22 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:50:22 user nova-compute[74821]:     </video>
Nov 06 13:50:22 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:50:22 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:50:22 user nova-compute[74821]:     </rng>
Nov 06 13:50:22 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:50:22 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:50:22 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:50:22 user nova-compute[74821]:     </memballoon>
Nov 06 13:50:22 user nova-compute[74821]:   </devices>
Nov 06 13:50:22 user nova-compute[74821]: </domain>
Nov 06 13:50:22 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2055241102',display_name='tempest-AttachVolumeTestJSON-server-2055241102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2055241102',id=51,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlGyjYTEpDOjHV+PsBYEfZQaY41KhxLEdbxt/ZVNSujzI+qVDBOQK6X/7thRI2Q3mV4nN5yZZuaU7n9RPKLv6g3Hue5CPCmRL5rtz9AGGzALQY0s7fSY+6geloiW9Rrtg==',key_name='tempest-keypair-1319999646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f3e02b312774fffa90b9aea7611b7d2',ramdisk_id='',reservation_id='r-y5npli50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1920917363',owner_user_name='tempest-AttachVolumeTestJSON-1920917363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:50:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88ff13567ecb4157898a278d3ae6e0d0',uuid=d17ee78d-8824-4212-9322-cbbb6eed4825,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d24821b0-564a-4201-87d3-fee351a1f359", "address": "fa:16:3e:a2:37:ad", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24821b0-56", "ovs_interfaceid": "d24821b0-564a-4201-87d3-fee351a1f359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Converting VIF {"id": "d24821b0-564a-4201-87d3-fee351a1f359", "address": "fa:16:3e:a2:37:ad", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24821b0-56", "ovs_interfaceid": "d24821b0-564a-4201-87d3-fee351a1f359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:37:ad,bridge_name='br-int',has_traffic_filtering=True,id=d24821b0-564a-4201-87d3-fee351a1f359,network=Network(a2ec52e9-7476-4ced-9810-d58d3f9eec4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24821b0-56') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG os_vif [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:37:ad,bridge_name='br-int',has_traffic_filtering=True,id=d24821b0-564a-4201-87d3-fee351a1f359,network=Network(a2ec52e9-7476-4ced-9810-d58d3f9eec4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24821b0-56') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '25c755e8-79a5-506c-acce-7ccea94e4f87', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd24821b0-56, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd24821b0-56, col_values=(('qos', UUID('6ec3a1db-aed1-4cda-be97-fd68d55793e9')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd24821b0-56, col_values=(('external_ids', {'iface-id': 'd24821b0-564a-4201-87d3-fee351a1f359', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:37:ad', 'vm-uuid': 'd17ee78d-8824-4212-9322-cbbb6eed4825'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:50:22 user nova-compute[74821]: INFO os_vif [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:37:ad,bridge_name='br-int',has_traffic_filtering=True,id=d24821b0-564a-4201-87d3-fee351a1f359,network=Network(a2ec52e9-7476-4ced-9810-d58d3f9eec4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24821b0-56')
Nov 06 13:50:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:50:22 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] No VIF found with MAC fa:16:3e:a2:37:ad, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:50:23 user nova-compute[74821]: DEBUG nova.network.neutron [req-0ea2e485-8f22-4a9c-acb0-5d6231879490 req-75d9811a-8229-4655-b458-94a3174ada33 service nova] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Updated VIF entry in instance network info cache for port d24821b0-564a-4201-87d3-fee351a1f359. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:50:23 user nova-compute[74821]: DEBUG nova.network.neutron [req-0ea2e485-8f22-4a9c-acb0-5d6231879490 req-75d9811a-8229-4655-b458-94a3174ada33 service nova] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Updating instance_info_cache with network_info: [{"id": "d24821b0-564a-4201-87d3-fee351a1f359", "address": "fa:16:3e:a2:37:ad", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24821b0-56", "ovs_interfaceid": "d24821b0-564a-4201-87d3-fee351a1f359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:50:23 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0ea2e485-8f22-4a9c-acb0-5d6231879490 req-75d9811a-8229-4655-b458-94a3174ada33 service nova] Releasing lock "refresh_cache-d17ee78d-8824-4212-9322-cbbb6eed4825" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:50:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:50:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:50:24 user nova-compute[74821]: DEBUG nova.compute.manager [req-a8431914-b576-4375-b167-5b09e66d5a0d req-676e61ba-57f2-4e35-b1ca-d2893ed21ce9 service nova] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Received event network-vif-plugged-d24821b0-564a-4201-87d3-fee351a1f359 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:50:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-a8431914-b576-4375-b167-5b09e66d5a0d req-676e61ba-57f2-4e35-b1ca-d2893ed21ce9 service nova] Acquiring lock "d17ee78d-8824-4212-9322-cbbb6eed4825-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:50:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-a8431914-b576-4375-b167-5b09e66d5a0d req-676e61ba-57f2-4e35-b1ca-d2893ed21ce9 service nova] Lock "d17ee78d-8824-4212-9322-cbbb6eed4825-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:50:24 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-a8431914-b576-4375-b167-5b09e66d5a0d req-676e61ba-57f2-4e35-b1ca-d2893ed21ce9 service nova] Lock "d17ee78d-8824-4212-9322-cbbb6eed4825-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:50:24 user nova-compute[74821]: DEBUG nova.compute.manager [req-a8431914-b576-4375-b167-5b09e66d5a0d req-676e61ba-57f2-4e35-b1ca-d2893ed21ce9 service nova] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] No waiting events found dispatching network-vif-plugged-d24821b0-564a-4201-87d3-fee351a1f359 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:50:24 user nova-compute[74821]: WARNING nova.compute.manager [req-a8431914-b576-4375-b167-5b09e66d5a0d req-676e61ba-57f2-4e35-b1ca-d2893ed21ce9 service nova] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Received unexpected event network-vif-plugged-d24821b0-564a-4201-87d3-fee351a1f359 for instance with vm_state building and task_state spawning.
Nov 06 13:50:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:50:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:50:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:50:25 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:50:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:50:26 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:50:26 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Instance spawned successfully.
Nov 06 13:50:26 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:50:26 user nova-compute[74821]: DEBUG nova.compute.manager [req-79adbf4d-5bbd-436f-83d3-c19e66cfe9eb req-cd98e6ec-25e7-4a64-8453-f13a9490411f service nova] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Received event network-vif-plugged-d24821b0-564a-4201-87d3-fee351a1f359 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:50:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-79adbf4d-5bbd-436f-83d3-c19e66cfe9eb req-cd98e6ec-25e7-4a64-8453-f13a9490411f service nova] Acquiring lock "d17ee78d-8824-4212-9322-cbbb6eed4825-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:50:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-79adbf4d-5bbd-436f-83d3-c19e66cfe9eb req-cd98e6ec-25e7-4a64-8453-f13a9490411f service nova] Lock "d17ee78d-8824-4212-9322-cbbb6eed4825-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:50:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-79adbf4d-5bbd-436f-83d3-c19e66cfe9eb req-cd98e6ec-25e7-4a64-8453-f13a9490411f service nova] Lock "d17ee78d-8824-4212-9322-cbbb6eed4825-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:50:26 user nova-compute[74821]: DEBUG nova.compute.manager [req-79adbf4d-5bbd-436f-83d3-c19e66cfe9eb req-cd98e6ec-25e7-4a64-8453-f13a9490411f service nova] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] No waiting events found dispatching network-vif-plugged-d24821b0-564a-4201-87d3-fee351a1f359 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:50:26 user nova-compute[74821]: WARNING nova.compute.manager [req-79adbf4d-5bbd-436f-83d3-c19e66cfe9eb req-cd98e6ec-25e7-4a64-8453-f13a9490411f service nova] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Received unexpected event network-vif-plugged-d24821b0-564a-4201-87d3-fee351a1f359 for instance with vm_state building and task_state spawning.
Nov 06 13:50:26 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:50:26 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:50:26 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:50:26 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:50:26 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:50:26 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:50:26 user nova-compute[74821]: INFO nova.compute.manager [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Took 5.55 seconds to spawn the instance on the hypervisor.
Nov 06 13:50:26 user nova-compute[74821]: DEBUG nova.compute.manager [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:50:26 user nova-compute[74821]: INFO nova.compute.manager [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Took 6.26 seconds to build instance.
Nov 06 13:50:26 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-b92cae83-cf49-4556-95b8-191403ffce41 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "d17ee78d-8824-4212-9322-cbbb6eed4825" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.378s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:50:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:50:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:50:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:50:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:50:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:50:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:50:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:50:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:50:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:50:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:50:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:50:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:50:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "62a98765-8951-464c-8070-28f0852c31af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:50:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "62a98765-8951-464c-8070-28f0852c31af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:50:46 user nova-compute[74821]: DEBUG nova.compute.manager [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Starting instance... {{(pid=74821) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 06 13:50:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:50:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:50:46 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74821) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 06 13:50:46 user nova-compute[74821]: INFO nova.compute.claims [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Claim successful on node user
Nov 06 13:50:46 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:50:46 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:50:46 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.233s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:50:46 user nova-compute[74821]: DEBUG nova.compute.manager [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Start building networks asynchronously for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 06 13:50:46 user nova-compute[74821]: DEBUG nova.compute.manager [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Allocating IP information in the background. {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 06 13:50:46 user nova-compute[74821]: DEBUG nova.network.neutron [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] allocate_for_instance() {{(pid=74821) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 06 13:50:46 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 06 13:50:46 user nova-compute[74821]: DEBUG nova.compute.manager [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Start building block device mappings for instance. {{(pid=74821) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 06 13:50:46 user nova-compute[74821]: INFO nova.virt.block_device [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Booting with volume eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd at /dev/vda
Nov 06 13:50:47 user nova-compute[74821]: DEBUG nova.policy [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3bb6a168d90a4795a72b8ac69eeadcc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8e811a3a30417a8dc6ccad03f2f8e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74821) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 06 13:50:47 user nova-compute[74821]: DEBUG os_brick.utils [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:50:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:50:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:50:47 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4861da4-7978-49cf-919c-c43e8683fae2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:50:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:50:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:50:47 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf19978-5a88-4572-959c-14c8d6ee8c72]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:50:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:50:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:50:47 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddba58e-8243-4405-9b93-2b2424ff8790]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:50:47 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3015c3-5ad2-4b77-8f27-620dd91c74e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:50:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:50:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:50:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:50:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:50:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:50:47 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:50:47 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19f882c-2e1d-4806-a0e7-e591a9adf8f5]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:50:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:50:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:50:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:50:47 user nova-compute[74821]: DEBUG os_brick.utils [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:50:47 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Updating existing volume attachment record: 5d36bee6-0202-42c3-a802-041c093d6c21 {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:50:47 user nova-compute[74821]: DEBUG nova.network.neutron [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Successfully created port: 94fd8191-6c39-4785-a499-0897389bb521 {{(pid=74821) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 06 13:50:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:50:48 user nova-compute[74821]: DEBUG nova.network.neutron [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Successfully updated port: 94fd8191-6c39-4785-a499-0897389bb521 {{(pid=74821) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 06 13:50:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "refresh_cache-62a98765-8951-464c-8070-28f0852c31af" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:50:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquired lock "refresh_cache-62a98765-8951-464c-8070-28f0852c31af" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:50:48 user nova-compute[74821]: DEBUG nova.network.neutron [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Building network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 06 13:50:48 user nova-compute[74821]: DEBUG nova.compute.manager [req-0d064ba4-0671-44b3-8005-f28ba655e29f req-a78d7cf4-635a-4841-97ea-288e01f3f499 service nova] [instance: 62a98765-8951-464c-8070-28f0852c31af] Received event network-changed-94fd8191-6c39-4785-a499-0897389bb521 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:50:48 user nova-compute[74821]: DEBUG nova.compute.manager [req-0d064ba4-0671-44b3-8005-f28ba655e29f req-a78d7cf4-635a-4841-97ea-288e01f3f499 service nova] [instance: 62a98765-8951-464c-8070-28f0852c31af] Refreshing instance network info cache due to event network-changed-94fd8191-6c39-4785-a499-0897389bb521. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:50:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0d064ba4-0671-44b3-8005-f28ba655e29f req-a78d7cf4-635a-4841-97ea-288e01f3f499 service nova] Acquiring lock "refresh_cache-62a98765-8951-464c-8070-28f0852c31af" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:50:48 user nova-compute[74821]: DEBUG nova.network.neutron [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Instance cache missing network info. {{(pid=74821) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 06 13:50:48 user nova-compute[74821]: DEBUG nova.network.neutron [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Updating instance_info_cache with network_info: [{"id": "94fd8191-6c39-4785-a499-0897389bb521", "address": "fa:16:3e:68:f1:04", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fd8191-6c", "ovs_interfaceid": "94fd8191-6c39-4785-a499-0897389bb521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:50:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Releasing lock "refresh_cache-62a98765-8951-464c-8070-28f0852c31af" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:50:48 user nova-compute[74821]: DEBUG nova.compute.manager [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Instance network_info: |[{"id": "94fd8191-6c39-4785-a499-0897389bb521", "address": "fa:16:3e:68:f1:04", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fd8191-6c", "ovs_interfaceid": "94fd8191-6c39-4785-a499-0897389bb521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74821) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 06 13:50:48 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0d064ba4-0671-44b3-8005-f28ba655e29f req-a78d7cf4-635a-4841-97ea-288e01f3f499 service nova] Acquired lock "refresh_cache-62a98765-8951-464c-8070-28f0852c31af" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:50:48 user nova-compute[74821]: DEBUG nova.network.neutron [req-0d064ba4-0671-44b3-8005-f28ba655e29f req-a78d7cf4-635a-4841-97ea-288e01f3f499 service nova] [instance: 62a98765-8951-464c-8070-28f0852c31af] Refreshing network info cache for port 94fd8191-6c39-4785-a499-0897389bb521 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:50:49 user nova-compute[74821]: DEBUG nova.network.neutron [req-0d064ba4-0671-44b3-8005-f28ba655e29f req-a78d7cf4-635a-4841-97ea-288e01f3f499 service nova] [instance: 62a98765-8951-464c-8070-28f0852c31af] Updated VIF entry in instance network info cache for port 94fd8191-6c39-4785-a499-0897389bb521. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:50:49 user nova-compute[74821]: DEBUG nova.network.neutron [req-0d064ba4-0671-44b3-8005-f28ba655e29f req-a78d7cf4-635a-4841-97ea-288e01f3f499 service nova] [instance: 62a98765-8951-464c-8070-28f0852c31af] Updating instance_info_cache with network_info: [{"id": "94fd8191-6c39-4785-a499-0897389bb521", "address": "fa:16:3e:68:f1:04", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fd8191-6c", "ovs_interfaceid": "94fd8191-6c39-4785-a499-0897389bb521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:50:49 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-0d064ba4-0671-44b3-8005-f28ba655e29f req-a78d7cf4-635a-4841-97ea-288e01f3f499 service nova] Releasing lock "refresh_cache-62a98765-8951-464c-8070-28f0852c31af" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:50:50 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:50:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:50:54 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:50:54 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:50:54 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Rebuilding the list of instances to heal {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 13:50:54 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 62a98765-8951-464c-8070-28f0852c31af] Skipping network cache update for instance because it is Building. {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 06 13:50:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-9ad0a4b2-8071-48cb-8cca-bd05bf40c590" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:50:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-9ad0a4b2-8071-48cb-8cca-bd05bf40c590" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:50:55 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:50:55 user nova-compute[74821]: DEBUG nova.objects.instance [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lazy-loading 'info_cache' on Instance uuid 9ad0a4b2-8071-48cb-8cca-bd05bf40c590 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:50:55 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:50:55 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Updating instance_info_cache with network_info: [{"id": "5b1366a3-69e9-4118-8e38-026944e8d7a6", "address": "fa:16:3e:c1:bd:02", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1366a3-69", "ovs_interfaceid": "5b1366a3-69e9-4118-8e38-026944e8d7a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:50:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-9ad0a4b2-8071-48cb-8cca-bd05bf40c590" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:50:55 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:50:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:50:57 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:50:57 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:50:57 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:50:57 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:50:59 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:50:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:50:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:50:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:50:59 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:51:00 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:51:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17ee78d-8824-4212-9322-cbbb6eed4825/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:51:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17ee78d-8824-4212-9322-cbbb6eed4825/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:51:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17ee78d-8824-4212-9322-cbbb6eed4825/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:51:00 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17ee78d-8824-4212-9322-cbbb6eed4825/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:51:00 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:51:00 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:51:00 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=8809MB free_disk=25.104873657226562GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:51:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:51:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:51:00 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 9ad0a4b2-8071-48cb-8cca-bd05bf40c590 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:51:00 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance d17ee78d-8824-4212-9322-cbbb6eed4825 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:51:00 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 62a98765-8951-464c-8070-28f0852c31af actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:51:00 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:51:00 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:51:01 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:51:01 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:51:01 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:51:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.237s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:51:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:51:03 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:51:03 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:51:03 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG nova.compute.manager [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Start spawning the instance on the hypervisor. {{(pid=74821) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Creating instance directory {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 06 13:51:07 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Creating image(s)
Nov 06 13:51:07 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Did not create local disks {{(pid=74821) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Ensure instance console log exists: /opt/stack/data/nova/instances/62a98765-8951-464c-8070-28f0852c31af/console.log {{(pid=74821) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Start _get_guest_xml network_info=[{"id": "94fd8191-6c39-4785-a499-0897389bb521", "address": "fa:16:3e:68:f1:04", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fd8191-6c", "ovs_interfaceid": "94fd8191-6c39-4785-a499-0897389bb521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VpXyKeWl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '62a98765-8951-464c-8070-28f0852c31af', 'attached_at': '', 'detached_at': '', 'volume_id': 'eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd', 'serial': 'eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'delete_on_termination': False, 'attachment_id': '5d36bee6-0202-42c3-a802-041c093d6c21', 'volume_type': None} {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 06 13:51:07 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:51:07 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:51:07 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] CPU controller missing on host. {{(pid=74821) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG nova.virt.libvirt.host [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] CPU controller found on host. {{(pid=74821) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74821) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-06T13:06:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Flavor limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Image limits 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Flavor pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Image pref 0:0:0 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Got 1 possible topologies {{(pid=74821) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG nova.virt.hardware [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74821) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VpXyKeWl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:51:07 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:51:07 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:51:07 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:51:07 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:51:07 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:51:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cef8b5-102d-4613-aab6-76fcbad62a47]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:51:07 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb5ee75-88d4-494c-a421-84d086e7d764]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd] added
Nov 06 13:51:07 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b84e5f7-6a21-46af-a25d-10896fdbf996]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb29a7ef-a6b3-47e2-b3f1-e0d97db5bb15]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:51:07 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VpXyKeWl {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:51:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VpXyKeWl" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:51:08 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5729afb-359e-4c07-8959-74f3a6028ced]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:51:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VpXyKeWl'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:51:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:51:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:51:08 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[932b36bc-5886-4eb9-89c7-54b0b9b35832]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:51:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:51:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:51:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:51:08 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f15e5e9-83de-4f36-936f-4889c547433b]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:51:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 (non-flash)
Nov 06 13:51:08 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:51:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 (non-flash)
Nov 06 13:51:08 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:51:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:51:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:51:08 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b03337b-6263-4e06-add1-24936d31d289]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:51:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd, portal: 172.16.0.220,3260]
Nov 06 13:51:08 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd, portal: 172.16.0.220,3260] successful.
Nov 06 13:51:08 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:51:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:51:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:51:08 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30a8f8a-c5ef-4547-a89f-237796e37ae7]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:51:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:51:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:51:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:51:08 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6f061e-bc08-410f-b434-c4bd583a5215]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:51:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 (non-flash)
Nov 06 13:51:08 user nova-compute[74821]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd (non-flash)
Nov 06 13:51:08 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:51:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 (non-flash)
Nov 06 13:51:08 user nova-compute[74821]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd (non-flash)
Nov 06 13:51:08 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:51:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:51:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:51:08 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:51:08 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:51:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:51:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:51:08 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d7f9fc-96c4-4543-9f5f-efe8a23cb70a]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:51:08 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:51:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VpXyKeWl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:51:08 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:51:09 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:51:09 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23637613039643537', 'path': '/dev/sdc'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:51:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637613039643537', 'path': '/dev/sdc'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:51:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:50:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1985857602',display_name='tempest-TestVolumeBootPattern-server-1985857602',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1985857602',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfkJ+gcSdYeVBScTbHfbQppT+GyWkt0sgvXBBnJvMr4dzybcwiVijK0IZrgpO4n3M0oU/D2RJOqwTHI/tQmkgtCEBZc1yLKKsxKLmfpxs7+Nu7iryecTOj297JFUnXZvw==',key_name='tempest-TestVolumeBootPattern-11065527',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c8e811a3a30417a8dc6ccad03f2f8e0',ramdisk_id='',reservation_id='r-hz9kwh0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1930796442',owner_user_name='tempest-TestVolumeBootPattern-1930796442-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:50:47Z,user_data=None,user_id='3bb6a168d90a4795a72b8ac69eeadcc9',uuid=62a98765-8951-464c-8070-28f0852c31af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94fd8191-6c39-4785-a499-0897389bb521", "address": "fa:16:3e:68:f1:04", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fd8191-6c", "ovs_interfaceid": "94fd8191-6c39-4785-a499-0897389bb521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74821) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 06 13:51:09 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Converting VIF {"id": "94fd8191-6c39-4785-a499-0897389bb521", "address": "fa:16:3e:68:f1:04", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fd8191-6c", "ovs_interfaceid": "94fd8191-6c39-4785-a499-0897389bb521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:51:09 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:f1:04,bridge_name='br-int',has_traffic_filtering=True,id=94fd8191-6c39-4785-a499-0897389bb521,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94fd8191-6c') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:51:09 user nova-compute[74821]: DEBUG nova.objects.instance [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lazy-loading 'pci_devices' on Instance uuid 62a98765-8951-464c-8070-28f0852c31af {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:51:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] End _get_guest_xml xml=<domain type="kvm">
Nov 06 13:51:09 user nova-compute[74821]:   <uuid>62a98765-8951-464c-8070-28f0852c31af</uuid>
Nov 06 13:51:09 user nova-compute[74821]:   <name>instance-00000034</name>
Nov 06 13:51:09 user nova-compute[74821]:   <memory>524288</memory>
Nov 06 13:51:09 user nova-compute[74821]:   <vcpu>1</vcpu>
Nov 06 13:51:09 user nova-compute[74821]:   <metadata>
Nov 06 13:51:09 user nova-compute[74821]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 06 13:51:09 user nova-compute[74821]:       <nova:package version="0.0.0"/>
Nov 06 13:51:09 user nova-compute[74821]:       <nova:name>tempest-TestVolumeBootPattern-server-1985857602</nova:name>
Nov 06 13:51:09 user nova-compute[74821]:       <nova:creationTime>2023-11-06 13:51:07</nova:creationTime>
Nov 06 13:51:09 user nova-compute[74821]:       <nova:flavor name="m1.tiny">
Nov 06 13:51:09 user nova-compute[74821]:         <nova:memory>512</nova:memory>
Nov 06 13:51:09 user nova-compute[74821]:         <nova:disk>1</nova:disk>
Nov 06 13:51:09 user nova-compute[74821]:         <nova:swap>0</nova:swap>
Nov 06 13:51:09 user nova-compute[74821]:         <nova:ephemeral>0</nova:ephemeral>
Nov 06 13:51:09 user nova-compute[74821]:         <nova:vcpus>1</nova:vcpus>
Nov 06 13:51:09 user nova-compute[74821]:       </nova:flavor>
Nov 06 13:51:09 user nova-compute[74821]:       <nova:owner>
Nov 06 13:51:09 user nova-compute[74821]:         <nova:user uuid="3bb6a168d90a4795a72b8ac69eeadcc9">tempest-TestVolumeBootPattern-1930796442-project-member</nova:user>
Nov 06 13:51:09 user nova-compute[74821]:         <nova:project uuid="2c8e811a3a30417a8dc6ccad03f2f8e0">tempest-TestVolumeBootPattern-1930796442</nova:project>
Nov 06 13:51:09 user nova-compute[74821]:       </nova:owner>
Nov 06 13:51:09 user nova-compute[74821]:       <nova:ports>
Nov 06 13:51:09 user nova-compute[74821]:         <nova:port uuid="94fd8191-6c39-4785-a499-0897389bb521">
Nov 06 13:51:09 user nova-compute[74821]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 06 13:51:09 user nova-compute[74821]:         </nova:port>
Nov 06 13:51:09 user nova-compute[74821]:       </nova:ports>
Nov 06 13:51:09 user nova-compute[74821]:     </nova:instance>
Nov 06 13:51:09 user nova-compute[74821]:   </metadata>
Nov 06 13:51:09 user nova-compute[74821]:   <sysinfo type="smbios">
Nov 06 13:51:09 user nova-compute[74821]:     <system>
Nov 06 13:51:09 user nova-compute[74821]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 06 13:51:09 user nova-compute[74821]:       <entry name="product">OpenStack Nova</entry>
Nov 06 13:51:09 user nova-compute[74821]:       <entry name="version">0.0.0</entry>
Nov 06 13:51:09 user nova-compute[74821]:       <entry name="serial">62a98765-8951-464c-8070-28f0852c31af</entry>
Nov 06 13:51:09 user nova-compute[74821]:       <entry name="uuid">62a98765-8951-464c-8070-28f0852c31af</entry>
Nov 06 13:51:09 user nova-compute[74821]:       <entry name="family">Virtual Machine</entry>
Nov 06 13:51:09 user nova-compute[74821]:     </system>
Nov 06 13:51:09 user nova-compute[74821]:   </sysinfo>
Nov 06 13:51:09 user nova-compute[74821]:   <os>
Nov 06 13:51:09 user nova-compute[74821]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 06 13:51:09 user nova-compute[74821]:     <boot dev="hd"/>
Nov 06 13:51:09 user nova-compute[74821]:     <smbios mode="sysinfo"/>
Nov 06 13:51:09 user nova-compute[74821]:   </os>
Nov 06 13:51:09 user nova-compute[74821]:   <features>
Nov 06 13:51:09 user nova-compute[74821]:     <acpi/>
Nov 06 13:51:09 user nova-compute[74821]:     <apic/>
Nov 06 13:51:09 user nova-compute[74821]:     <vmcoreinfo/>
Nov 06 13:51:09 user nova-compute[74821]:   </features>
Nov 06 13:51:09 user nova-compute[74821]:   <clock offset="utc">
Nov 06 13:51:09 user nova-compute[74821]:     <timer name="pit" tickpolicy="delay"/>
Nov 06 13:51:09 user nova-compute[74821]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 06 13:51:09 user nova-compute[74821]:     <timer name="hpet" present="no"/>
Nov 06 13:51:09 user nova-compute[74821]:   </clock>
Nov 06 13:51:09 user nova-compute[74821]:   <cpu mode="custom" match="exact">
Nov 06 13:51:09 user nova-compute[74821]:     <model>Nehalem</model>
Nov 06 13:51:09 user nova-compute[74821]:     <topology sockets="1" cores="1" threads="1"/>
Nov 06 13:51:09 user nova-compute[74821]:   </cpu>
Nov 06 13:51:09 user nova-compute[74821]:   <devices>
Nov 06 13:51:09 user nova-compute[74821]:     <disk type="block" device="disk">
Nov 06 13:51:09 user nova-compute[74821]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:51:09 user nova-compute[74821]:       <source dev="/dev/sdc"/>
Nov 06 13:51:09 user nova-compute[74821]:       <target dev="vda" bus="virtio"/>
Nov 06 13:51:09 user nova-compute[74821]:       <serial>eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd</serial>
Nov 06 13:51:09 user nova-compute[74821]:     </disk>
Nov 06 13:51:09 user nova-compute[74821]:     <interface type="ethernet">
Nov 06 13:51:09 user nova-compute[74821]:       <mac address="fa:16:3e:68:f1:04"/>
Nov 06 13:51:09 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:51:09 user nova-compute[74821]:       <mtu size="1442"/>
Nov 06 13:51:09 user nova-compute[74821]:       <target dev="tap94fd8191-6c"/>
Nov 06 13:51:09 user nova-compute[74821]:     </interface>
Nov 06 13:51:09 user nova-compute[74821]:     <serial type="pty">
Nov 06 13:51:09 user nova-compute[74821]:       <log file="/opt/stack/data/nova/instances/62a98765-8951-464c-8070-28f0852c31af/console.log" append="off"/>
Nov 06 13:51:09 user nova-compute[74821]:     </serial>
Nov 06 13:51:09 user nova-compute[74821]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 06 13:51:09 user nova-compute[74821]:     <video>
Nov 06 13:51:09 user nova-compute[74821]:       <model type="virtio"/>
Nov 06 13:51:09 user nova-compute[74821]:     </video>
Nov 06 13:51:09 user nova-compute[74821]:     <rng model="virtio">
Nov 06 13:51:09 user nova-compute[74821]:       <backend model="random">/dev/urandom</backend>
Nov 06 13:51:09 user nova-compute[74821]:     </rng>
Nov 06 13:51:09 user nova-compute[74821]:     <controller type="usb" index="0" model="none"/>
Nov 06 13:51:09 user nova-compute[74821]:     <memballoon model="virtio">
Nov 06 13:51:09 user nova-compute[74821]:       <stats period="10"/>
Nov 06 13:51:09 user nova-compute[74821]:     </memballoon>
Nov 06 13:51:09 user nova-compute[74821]:   </devices>
Nov 06 13:51:09 user nova-compute[74821]: </domain>
Nov 06 13:51:09 user nova-compute[74821]:  {{(pid=74821) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 06 13:51:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:50:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1985857602',display_name='tempest-TestVolumeBootPattern-server-1985857602',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1985857602',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfkJ+gcSdYeVBScTbHfbQppT+GyWkt0sgvXBBnJvMr4dzybcwiVijK0IZrgpO4n3M0oU/D2RJOqwTHI/tQmkgtCEBZc1yLKKsxKLmfpxs7+Nu7iryecTOj297JFUnXZvw==',key_name='tempest-TestVolumeBootPattern-11065527',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c8e811a3a30417a8dc6ccad03f2f8e0',ramdisk_id='',reservation_id='r-hz9kwh0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1930796442',owner_user_name='tempest-TestVolumeBootPattern-1930796442-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-06T13:50:47Z,user_data=None,user_id='3bb6a168d90a4795a72b8ac69eeadcc9',uuid=62a98765-8951-464c-8070-28f0852c31af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94fd8191-6c39-4785-a499-0897389bb521", "address": "fa:16:3e:68:f1:04", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fd8191-6c", "ovs_interfaceid": "94fd8191-6c39-4785-a499-0897389bb521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 06 13:51:09 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Converting VIF {"id": "94fd8191-6c39-4785-a499-0897389bb521", "address": "fa:16:3e:68:f1:04", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fd8191-6c", "ovs_interfaceid": "94fd8191-6c39-4785-a499-0897389bb521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:51:09 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:f1:04,bridge_name='br-int',has_traffic_filtering=True,id=94fd8191-6c39-4785-a499-0897389bb521,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94fd8191-6c') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:51:09 user nova-compute[74821]: DEBUG os_vif [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:f1:04,bridge_name='br-int',has_traffic_filtering=True,id=94fd8191-6c39-4785-a499-0897389bb521,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94fd8191-6c') {{(pid=74821) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 06 13:51:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:51:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:51:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 06 13:51:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:51:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bfb84388-2025-5d03-afe6-4b76b57920f6', '_type': 'linux-noop'}}, row=False) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:51:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:51:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:51:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:51:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94fd8191-6c, may_exist=True, interface_attrs={}) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:51:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap94fd8191-6c, col_values=(('qos', UUID('c9181c0e-c7ca-49fe-9a33-1b6aa56ba0c8')),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:51:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap94fd8191-6c, col_values=(('external_ids', {'iface-id': '94fd8191-6c39-4785-a499-0897389bb521', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:f1:04', 'vm-uuid': '62a98765-8951-464c-8070-28f0852c31af'}),), if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:51:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:51:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:51:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:51:09 user nova-compute[74821]: INFO os_vif [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:f1:04,bridge_name='br-int',has_traffic_filtering=True,id=94fd8191-6c39-4785-a499-0897389bb521,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94fd8191-6c')
Nov 06 13:51:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:51:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] No VIF found with MAC fa:16:3e:68:f1:04, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:51:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:51:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:51:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:51:10 user nova-compute[74821]: DEBUG nova.compute.manager [req-34b11273-b2b2-41aa-b891-e8ab96c7d361 req-a0fdbf51-b055-4c9d-aafd-414f1be0da86 service nova] [instance: 62a98765-8951-464c-8070-28f0852c31af] Received event network-vif-plugged-94fd8191-6c39-4785-a499-0897389bb521 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:51:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-34b11273-b2b2-41aa-b891-e8ab96c7d361 req-a0fdbf51-b055-4c9d-aafd-414f1be0da86 service nova] Acquiring lock "62a98765-8951-464c-8070-28f0852c31af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:51:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-34b11273-b2b2-41aa-b891-e8ab96c7d361 req-a0fdbf51-b055-4c9d-aafd-414f1be0da86 service nova] Lock "62a98765-8951-464c-8070-28f0852c31af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:51:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-34b11273-b2b2-41aa-b891-e8ab96c7d361 req-a0fdbf51-b055-4c9d-aafd-414f1be0da86 service nova] Lock "62a98765-8951-464c-8070-28f0852c31af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:51:10 user nova-compute[74821]: DEBUG nova.compute.manager [req-34b11273-b2b2-41aa-b891-e8ab96c7d361 req-a0fdbf51-b055-4c9d-aafd-414f1be0da86 service nova] [instance: 62a98765-8951-464c-8070-28f0852c31af] No waiting events found dispatching network-vif-plugged-94fd8191-6c39-4785-a499-0897389bb521 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:51:10 user nova-compute[74821]: WARNING nova.compute.manager [req-34b11273-b2b2-41aa-b891-e8ab96c7d361 req-a0fdbf51-b055-4c9d-aafd-414f1be0da86 service nova] [instance: 62a98765-8951-464c-8070-28f0852c31af] Received unexpected event network-vif-plugged-94fd8191-6c39-4785-a499-0897389bb521 for instance with vm_state building and task_state spawning.
Nov 06 13:51:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:51:10 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:51:12 user nova-compute[74821]: DEBUG nova.compute.manager [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Instance event wait completed in 0 seconds for  {{(pid=74821) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 06 13:51:12 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Guest created on hypervisor {{(pid=74821) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 06 13:51:12 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 62a98765-8951-464c-8070-28f0852c31af] Instance spawned successfully.
Nov 06 13:51:12 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 06 13:51:12 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Found default for hw_cdrom_bus of ide {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:51:12 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Found default for hw_disk_bus of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:51:12 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Found default for hw_input_bus of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:51:12 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Found default for hw_pointer_model of None {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:51:12 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Found default for hw_video_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:51:12 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Found default for hw_vif_model of virtio {{(pid=74821) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 06 13:51:12 user nova-compute[74821]: INFO nova.compute.manager [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Took 4.83 seconds to spawn the instance on the hypervisor.
Nov 06 13:51:12 user nova-compute[74821]: DEBUG nova.compute.manager [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Checking state {{(pid=74821) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 06 13:51:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-abcaa13b-6e58-4868-b220-d3f2122634ac req-d82381cd-3961-4573-8924-3d346a8d14f4 service nova] [instance: 62a98765-8951-464c-8070-28f0852c31af] Received event network-vif-plugged-94fd8191-6c39-4785-a499-0897389bb521 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:51:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-abcaa13b-6e58-4868-b220-d3f2122634ac req-d82381cd-3961-4573-8924-3d346a8d14f4 service nova] Acquiring lock "62a98765-8951-464c-8070-28f0852c31af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:51:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-abcaa13b-6e58-4868-b220-d3f2122634ac req-d82381cd-3961-4573-8924-3d346a8d14f4 service nova] Lock "62a98765-8951-464c-8070-28f0852c31af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:51:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-abcaa13b-6e58-4868-b220-d3f2122634ac req-d82381cd-3961-4573-8924-3d346a8d14f4 service nova] Lock "62a98765-8951-464c-8070-28f0852c31af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:51:12 user nova-compute[74821]: DEBUG nova.compute.manager [req-abcaa13b-6e58-4868-b220-d3f2122634ac req-d82381cd-3961-4573-8924-3d346a8d14f4 service nova] [instance: 62a98765-8951-464c-8070-28f0852c31af] No waiting events found dispatching network-vif-plugged-94fd8191-6c39-4785-a499-0897389bb521 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:51:12 user nova-compute[74821]: WARNING nova.compute.manager [req-abcaa13b-6e58-4868-b220-d3f2122634ac req-d82381cd-3961-4573-8924-3d346a8d14f4 service nova] [instance: 62a98765-8951-464c-8070-28f0852c31af] Received unexpected event network-vif-plugged-94fd8191-6c39-4785-a499-0897389bb521 for instance with vm_state building and task_state spawning.
Nov 06 13:51:12 user nova-compute[74821]: INFO nova.compute.manager [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Took 26.46 seconds to build instance.
Nov 06 13:51:12 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-8335da8c-163c-4f3a-bad5-2495750d9e65 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "62a98765-8951-464c-8070-28f0852c31af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.557s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:51:14 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:51:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:51:17 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:51:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:51:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:51:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:51:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:51:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:51:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:51:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:51:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:51:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:51:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:51:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:51:55 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:51:55 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:51:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-d17ee78d-8824-4212-9322-cbbb6eed4825" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:51:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-d17ee78d-8824-4212-9322-cbbb6eed4825" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:51:56 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:51:56 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Updating instance_info_cache with network_info: [{"id": "d24821b0-564a-4201-87d3-fee351a1f359", "address": "fa:16:3e:a2:37:ad", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24821b0-56", "ovs_interfaceid": "d24821b0-564a-4201-87d3-fee351a1f359", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:51:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-d17ee78d-8824-4212-9322-cbbb6eed4825" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:51:56 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:51:58 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:51:58 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:51:58 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Cleaning up deleted instances {{(pid=74821) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 13:51:58 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] There are 0 instances to clean {{(pid=74821) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 13:51:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:51:59 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:51:59 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:51:59 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:52:00 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:52:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:52:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:52:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:52:00 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:52:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:52:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:52:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17ee78d-8824-4212-9322-cbbb6eed4825/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:52:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17ee78d-8824-4212-9322-cbbb6eed4825/disk --force-share --output=json" returned: 0 in 0.361s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:52:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17ee78d-8824-4212-9322-cbbb6eed4825/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:52:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17ee78d-8824-4212-9322-cbbb6eed4825/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:52:01 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:52:01 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:52:01 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=8760MB free_disk=25.10352325439453GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:52:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:52:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:52:02 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 9ad0a4b2-8071-48cb-8cca-bd05bf40c590 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:52:02 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance d17ee78d-8824-4212-9322-cbbb6eed4825 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:52:02 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 62a98765-8951-464c-8070-28f0852c31af actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:52:02 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:52:02 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:52:02 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:52:02 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:52:02 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:52:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.258s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:52:03 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:52:03 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:52:03 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:52:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:52:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:52:11 user nova-compute[74821]: DEBUG nova.compute.manager [req-6778e937-8138-41f7-ab64-8355e3e41cc3 req-96bde32b-5462-4167-812d-fe3bb336dd0a service nova] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Received event network-changed-d24821b0-564a-4201-87d3-fee351a1f359 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:52:11 user nova-compute[74821]: DEBUG nova.compute.manager [req-6778e937-8138-41f7-ab64-8355e3e41cc3 req-96bde32b-5462-4167-812d-fe3bb336dd0a service nova] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Refreshing instance network info cache due to event network-changed-d24821b0-564a-4201-87d3-fee351a1f359. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:52:11 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6778e937-8138-41f7-ab64-8355e3e41cc3 req-96bde32b-5462-4167-812d-fe3bb336dd0a service nova] Acquiring lock "refresh_cache-d17ee78d-8824-4212-9322-cbbb6eed4825" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:52:11 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6778e937-8138-41f7-ab64-8355e3e41cc3 req-96bde32b-5462-4167-812d-fe3bb336dd0a service nova] Acquired lock "refresh_cache-d17ee78d-8824-4212-9322-cbbb6eed4825" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:52:11 user nova-compute[74821]: DEBUG nova.network.neutron [req-6778e937-8138-41f7-ab64-8355e3e41cc3 req-96bde32b-5462-4167-812d-fe3bb336dd0a service nova] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Refreshing network info cache for port d24821b0-564a-4201-87d3-fee351a1f359 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:52:11 user nova-compute[74821]: DEBUG nova.network.neutron [req-6778e937-8138-41f7-ab64-8355e3e41cc3 req-96bde32b-5462-4167-812d-fe3bb336dd0a service nova] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Updated VIF entry in instance network info cache for port d24821b0-564a-4201-87d3-fee351a1f359. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:52:11 user nova-compute[74821]: DEBUG nova.network.neutron [req-6778e937-8138-41f7-ab64-8355e3e41cc3 req-96bde32b-5462-4167-812d-fe3bb336dd0a service nova] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Updating instance_info_cache with network_info: [{"id": "d24821b0-564a-4201-87d3-fee351a1f359", "address": "fa:16:3e:a2:37:ad", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24821b0-56", "ovs_interfaceid": "d24821b0-564a-4201-87d3-fee351a1f359", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:52:11 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6778e937-8138-41f7-ab64-8355e3e41cc3 req-96bde32b-5462-4167-812d-fe3bb336dd0a service nova] Releasing lock "refresh_cache-d17ee78d-8824-4212-9322-cbbb6eed4825" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:52:13 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:52:13 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Cleaning up deleted instances with incomplete migration  {{(pid=74821) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 13:52:14 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:52:14 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:52:14 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:52:14 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:52:14 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:52:14 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:52:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:52:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "d17ee78d-8824-4212-9322-cbbb6eed4825" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:52:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "d17ee78d-8824-4212-9322-cbbb6eed4825" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:52:17 user nova-compute[74821]: DEBUG nova.objects.instance [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lazy-loading 'flavor' on Instance uuid d17ee78d-8824-4212-9322-cbbb6eed4825 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:52:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "d17ee78d-8824-4212-9322-cbbb6eed4825" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:52:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "d17ee78d-8824-4212-9322-cbbb6eed4825" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:52:17 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "d17ee78d-8824-4212-9322-cbbb6eed4825" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:52:17 user nova-compute[74821]: INFO nova.compute.manager [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Attaching volume 6ca266c5-13b5-40f9-bec7-f048d159a333 to /dev/vdb
Nov 06 13:52:17 user nova-compute[74821]: DEBUG os_brick.utils [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:52:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:52:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:52:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b4fb21-5dbe-49d4-8e8e-e042f0c59bdc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:52:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:52:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:52:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a51569-79c2-4db7-b991-0d54f6701001]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:52:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:52:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:52:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfe69f7-f900-47b2-8021-adec459556d2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:52:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4ba8bc-6374-44e0-ba49-f8d26bd4f7dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:52:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:52:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:52:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:52:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:52:17 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:52:17 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:52:17 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cb6f58-3fea-4389-8ea9-76640e382498]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:52:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:52:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:52:17 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:52:17 user nova-compute[74821]: DEBUG os_brick.utils [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:52:17 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Updating existing volume attachment record: 1563988b-644e-4f0c-9818-5a84fe3b8dd1 {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:52:18 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:52:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:52:20 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:52:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:52:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:52:29 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:52:30 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:52:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:52:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG nova.compute.manager [req-1d01673a-4d85-4370-b7c5-bbe33ba2e7fc req-237c7071-9153-4d90-b408-f69f4674296c service nova] [instance: 62a98765-8951-464c-8070-28f0852c31af] Received event network-changed-94fd8191-6c39-4785-a499-0897389bb521 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG nova.compute.manager [req-1d01673a-4d85-4370-b7c5-bbe33ba2e7fc req-237c7071-9153-4d90-b408-f69f4674296c service nova] [instance: 62a98765-8951-464c-8070-28f0852c31af] Refreshing instance network info cache due to event network-changed-94fd8191-6c39-4785-a499-0897389bb521. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1d01673a-4d85-4370-b7c5-bbe33ba2e7fc req-237c7071-9153-4d90-b408-f69f4674296c service nova] Acquiring lock "refresh_cache-62a98765-8951-464c-8070-28f0852c31af" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1d01673a-4d85-4370-b7c5-bbe33ba2e7fc req-237c7071-9153-4d90-b408-f69f4674296c service nova] Acquired lock "refresh_cache-62a98765-8951-464c-8070-28f0852c31af" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG nova.network.neutron [req-1d01673a-4d85-4370-b7c5-bbe33ba2e7fc req-237c7071-9153-4d90-b408-f69f4674296c service nova] [instance: 62a98765-8951-464c-8070-28f0852c31af] Refreshing network info cache for port 94fd8191-6c39-4785-a499-0897389bb521 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG nova.network.neutron [req-1d01673a-4d85-4370-b7c5-bbe33ba2e7fc req-237c7071-9153-4d90-b408-f69f4674296c service nova] [instance: 62a98765-8951-464c-8070-28f0852c31af] Updated VIF entry in instance network info cache for port 94fd8191-6c39-4785-a499-0897389bb521. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG nova.network.neutron [req-1d01673a-4d85-4370-b7c5-bbe33ba2e7fc req-237c7071-9153-4d90-b408-f69f4674296c service nova] [instance: 62a98765-8951-464c-8070-28f0852c31af] Updating instance_info_cache with network_info: [{"id": "94fd8191-6c39-4785-a499-0897389bb521", "address": "fa:16:3e:68:f1:04", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fd8191-6c", "ovs_interfaceid": "94fd8191-6c39-4785-a499-0897389bb521", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-1d01673a-4d85-4370-b7c5-bbe33ba2e7fc req-237c7071-9153-4d90-b408-f69f4674296c service nova] Releasing lock "refresh_cache-62a98765-8951-464c-8070-28f0852c31af" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PdIQUupT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:52:38 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:52:38 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:52:38 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:52:38 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:52:38 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:52:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[54279fc2-7efe-431b-ad4f-5a27ac4e8943]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:52:38 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8653308c-f4bc-49ed-abf6-865aa393b055]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333] added
Nov 06 13:52:38 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9eb8cfc-31c7-496b-8260-7509578e849e]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[85acf8bd-f5ea-4112-9fc3-f15df4ce96de]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PdIQUupT {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PdIQUupT" returned: 0 in 0.028s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c203183-1962-4eea-a1ba-61ea8bffe86b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PdIQUupT'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce27fdae-8db4-45bd-b09f-a7e05e6dff5f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d897baf-a527-43c4-8b8a-d928392e152e]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 (non-flash)
Nov 06 13:52:38 user nova-compute[74821]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd (non-flash)
Nov 06 13:52:38 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 (non-flash)
Nov 06 13:52:38 user nova-compute[74821]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd (non-flash)
Nov 06 13:52:38 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG nova.compute.manager [req-c91da959-87e4-49f1-be12-910a6b2a35c8 req-a3020e2c-fcac-428d-a704-6de1f9bca728 service nova] [instance: 62a98765-8951-464c-8070-28f0852c31af] Received event network-changed-94fd8191-6c39-4785-a499-0897389bb521 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG nova.compute.manager [req-c91da959-87e4-49f1-be12-910a6b2a35c8 req-a3020e2c-fcac-428d-a704-6de1f9bca728 service nova] [instance: 62a98765-8951-464c-8070-28f0852c31af] Refreshing instance network info cache due to event network-changed-94fd8191-6c39-4785-a499-0897389bb521. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c91da959-87e4-49f1-be12-910a6b2a35c8 req-a3020e2c-fcac-428d-a704-6de1f9bca728 service nova] Acquiring lock "refresh_cache-62a98765-8951-464c-8070-28f0852c31af" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c91da959-87e4-49f1-be12-910a6b2a35c8 req-a3020e2c-fcac-428d-a704-6de1f9bca728 service nova] Acquired lock "refresh_cache-62a98765-8951-464c-8070-28f0852c31af" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG nova.network.neutron [req-c91da959-87e4-49f1-be12-910a6b2a35c8 req-a3020e2c-fcac-428d-a704-6de1f9bca728 service nova] [instance: 62a98765-8951-464c-8070-28f0852c31af] Refreshing network info cache for port 94fd8191-6c39-4785-a499-0897389bb521 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a7238f-f4d2-4959-a001-09ca4fa6e3d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333, portal: 172.16.0.220,3260]
Nov 06 13:52:38 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333, portal: 172.16.0.220,3260] successful.
Nov 06 13:52:38 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:52:38 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d2de10-0e31-4454-bbac-712db771a5f6]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aef96da-24b2-424a-b3bd-dd74e924037c]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 (non-flash)
Nov 06 13:52:39 user nova-compute[74821]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd (non-flash)
Nov 06 13:52:39 user nova-compute[74821]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 (non-flash)
Nov 06 13:52:39 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 (non-flash)
Nov 06 13:52:39 user nova-compute[74821]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd (non-flash)
Nov 06 13:52:39 user nova-compute[74821]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 (non-flash)
Nov 06 13:52:39 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] HCTL ('35', '-', '-', 0) found on session 57 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "62a98765-8951-464c-8070-28f0852c31af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "62a98765-8951-464c-8070-28f0852c31af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "62a98765-8951-464c-8070-28f0852c31af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "62a98765-8951-464c-8070-28f0852c31af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "62a98765-8951-464c-8070-28f0852c31af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:52:39 user nova-compute[74821]: INFO nova.compute.manager [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Terminating instance
Nov 06 13:52:39 user nova-compute[74821]: DEBUG nova.compute.manager [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94d6243-8531-4520-a7f9-d5de76e993c9]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Searching for a device in session 57 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PdIQUupT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG nova.network.neutron [req-c91da959-87e4-49f1-be12-910a6b2a35c8 req-a3020e2c-fcac-428d-a704-6de1f9bca728 service nova] [instance: 62a98765-8951-464c-8070-28f0852c31af] Updated VIF entry in instance network info cache for port 94fd8191-6c39-4785-a499-0897389bb521. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG nova.network.neutron [req-c91da959-87e4-49f1-be12-910a6b2a35c8 req-a3020e2c-fcac-428d-a704-6de1f9bca728 service nova] [instance: 62a98765-8951-464c-8070-28f0852c31af] Updating instance_info_cache with network_info: [{"id": "94fd8191-6c39-4785-a499-0897389bb521", "address": "fa:16:3e:68:f1:04", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fd8191-6c", "ovs_interfaceid": "94fd8191-6c39-4785-a499-0897389bb521", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c91da959-87e4-49f1-be12-910a6b2a35c8 req-a3020e2c-fcac-428d-a704-6de1f9bca728 service nova] Releasing lock "refresh_cache-62a98765-8951-464c-8070-28f0852c31af" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:52:39 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 62a98765-8951-464c-8070-28f0852c31af] Instance destroyed successfully.
Nov 06 13:52:39 user nova-compute[74821]: DEBUG nova.objects.instance [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lazy-loading 'resources' on Instance uuid 62a98765-8951-464c-8070-28f0852c31af {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:50:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1985857602',display_name='tempest-TestVolumeBootPattern-server-1985857602',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1985857602',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfkJ+gcSdYeVBScTbHfbQppT+GyWkt0sgvXBBnJvMr4dzybcwiVijK0IZrgpO4n3M0oU/D2RJOqwTHI/tQmkgtCEBZc1yLKKsxKLmfpxs7+Nu7iryecTOj297JFUnXZvw==',key_name='tempest-TestVolumeBootPattern-11065527',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:51:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c8e811a3a30417a8dc6ccad03f2f8e0',ramdisk_id='',reservation_id='r-hz9kwh0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1930796442',owner_user_name='tempest-TestVolumeBootPattern-1930796442-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:51:13Z,user_data=None,user_id='3bb6a168d90a4795a72b8ac69eeadcc9',uuid=62a98765-8951-464c-8070-28f0852c31af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94fd8191-6c39-4785-a499-0897389bb521", "address": "fa:16:3e:68:f1:04", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fd8191-6c", "ovs_interfaceid": "94fd8191-6c39-4785-a499-0897389bb521", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Converting VIF {"id": "94fd8191-6c39-4785-a499-0897389bb521", "address": "fa:16:3e:68:f1:04", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94fd8191-6c", "ovs_interfaceid": "94fd8191-6c39-4785-a499-0897389bb521", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:f1:04,bridge_name='br-int',has_traffic_filtering=True,id=94fd8191-6c39-4785-a499-0897389bb521,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94fd8191-6c') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG os_vif [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:f1:04,bridge_name='br-int',has_traffic_filtering=True,id=94fd8191-6c39-4785-a499-0897389bb521,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94fd8191-6c') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94fd8191-6c, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c9181c0e-c7ca-49fe-9a33-1b6aa56ba0c8) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:52:39 user nova-compute[74821]: INFO os_vif [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:f1:04,bridge_name='br-int',has_traffic_filtering=True,id=94fd8191-6c39-4785-a499-0897389bb521,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94fd8191-6c')
Nov 06 13:52:39 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:52:39 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VpXyKeWl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:52:39 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:52:39 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23765616432346263', 'path': '/dev/sdd'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765616432346263', 'path': '/dev/sdd'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.227s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG nova.objects.instance [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lazy-loading 'flavor' on Instance uuid d17ee78d-8824-4212-9322-cbbb6eed4825 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc23b6d-0b64-45fd-ad57-995e641c63f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:52:40 user nova-compute[74821]: No targets found.
Nov 06 13:52:40 user nova-compute[74821]: iSNS:
Nov 06 13:52:40 user nova-compute[74821]: No targets found.
Nov 06 13:52:40 user nova-compute[74821]: STATIC:
Nov 06 13:52:40 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd
Nov 06 13:52:40 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:52:40 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:52:40 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333
Nov 06 13:52:40 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:52:40 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:52:40 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8
Nov 06 13:52:40 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:52:40 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:52:40 user nova-compute[74821]: FIRMWARE:
Nov 06 13:52:40 user nova-compute[74821]: No targets found.
Nov 06 13:52:40 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:52:40 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:52:40 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 13:52:40 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:52:40 user nova-compute[74821]:   <source dev="/dev/sdd"/>
Nov 06 13:52:40 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:52:40 user nova-compute[74821]:   <serial>6ca266c5-13b5-40f9-bec7-f048d159a333</serial>
Nov 06 13:52:40 user nova-compute[74821]: </disk>
Nov 06 13:52:40 user nova-compute[74821]:  {{(pid=74821) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG nova.compute.manager [req-6054f797-4906-4084-a46b-235aec0cb0a8 req-0d07c3d4-4092-41d3-b55a-c80365bce5da service nova] [instance: 62a98765-8951-464c-8070-28f0852c31af] Received event network-vif-unplugged-94fd8191-6c39-4785-a499-0897389bb521 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6054f797-4906-4084-a46b-235aec0cb0a8 req-0d07c3d4-4092-41d3-b55a-c80365bce5da service nova] Acquiring lock "62a98765-8951-464c-8070-28f0852c31af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6054f797-4906-4084-a46b-235aec0cb0a8 req-0d07c3d4-4092-41d3-b55a-c80365bce5da service nova] Lock "62a98765-8951-464c-8070-28f0852c31af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6054f797-4906-4084-a46b-235aec0cb0a8 req-0d07c3d4-4092-41d3-b55a-c80365bce5da service nova] Lock "62a98765-8951-464c-8070-28f0852c31af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG nova.compute.manager [req-6054f797-4906-4084-a46b-235aec0cb0a8 req-0d07c3d4-4092-41d3-b55a-c80365bce5da service nova] [instance: 62a98765-8951-464c-8070-28f0852c31af] No waiting events found dispatching network-vif-unplugged-94fd8191-6c39-4785-a499-0897389bb521 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG nova.compute.manager [req-6054f797-4906-4084-a46b-235aec0cb0a8 req-0d07c3d4-4092-41d3-b55a-c80365bce5da service nova] [instance: 62a98765-8951-464c-8070-28f0852c31af] Received event network-vif-unplugged-94fd8191-6c39-4785-a499-0897389bb521 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG nova.compute.manager [req-6054f797-4906-4084-a46b-235aec0cb0a8 req-0d07c3d4-4092-41d3-b55a-c80365bce5da service nova] [instance: 62a98765-8951-464c-8070-28f0852c31af] Received event network-vif-plugged-94fd8191-6c39-4785-a499-0897389bb521 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6054f797-4906-4084-a46b-235aec0cb0a8 req-0d07c3d4-4092-41d3-b55a-c80365bce5da service nova] Acquiring lock "62a98765-8951-464c-8070-28f0852c31af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6054f797-4906-4084-a46b-235aec0cb0a8 req-0d07c3d4-4092-41d3-b55a-c80365bce5da service nova] Lock "62a98765-8951-464c-8070-28f0852c31af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-6054f797-4906-4084-a46b-235aec0cb0a8 req-0d07c3d4-4092-41d3-b55a-c80365bce5da service nova] Lock "62a98765-8951-464c-8070-28f0852c31af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG nova.compute.manager [req-6054f797-4906-4084-a46b-235aec0cb0a8 req-0d07c3d4-4092-41d3-b55a-c80365bce5da service nova] [instance: 62a98765-8951-464c-8070-28f0852c31af] No waiting events found dispatching network-vif-plugged-94fd8191-6c39-4785-a499-0897389bb521 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:52:40 user nova-compute[74821]: WARNING nova.compute.manager [req-6054f797-4906-4084-a46b-235aec0cb0a8 req-0d07c3d4-4092-41d3-b55a-c80365bce5da service nova] [instance: 62a98765-8951-464c-8070-28f0852c31af] Received unexpected event network-vif-plugged-94fd8191-6c39-4785-a499-0897389bb521 for instance with vm_state active and task_state deleting.
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[98084f33-f4fe-4a2e-a597-5029f3fd7560]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdbd1f7-a6bf-4e8d-8a5a-c55a115a100e]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 (non-flash)
Nov 06 13:52:40 user nova-compute[74821]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd (non-flash)
Nov 06 13:52:40 user nova-compute[74821]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 (non-flash)
Nov 06 13:52:40 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 (non-flash)
Nov 06 13:52:40 user nova-compute[74821]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd (non-flash)
Nov 06 13:52:40 user nova-compute[74821]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 (non-flash)
Nov 06 13:52:40 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e402e8940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd'): ({'sdc'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Removing single pathed devices sdc {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4a3254-44a9-4865-a1cc-9c29a813e7bf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c370d47-074a-40b3-ae13-beacf940fadf]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Flushing IO for device /dev/sdc {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a87b715-f8cf-43e8-be42-48094d40a9cd]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[967b42e5-36e3-4f00-bef5-700f3557a570]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] SCSI volumes sdc have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[918265bd-85e0-43a8-baaf-d84a4d849c44]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c701cd-1c2d-4cbc-bb48-3efad0f82ce8]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd, portal: 172.16.0.220,3260]
Nov 06 13:52:40 user nova-compute[74821]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd, portal: 172.16.0.220,3260] successful.
Nov 06 13:52:40 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eca3c2c9-0974-43c0-8872-c6b7bcb4d4cd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[34544020-767c-4291-96c7-3d5bf5c49967]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] <== disconnect_volume: return (561ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:52:40 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Deleting instance files /opt/stack/data/nova/instances/62a98765-8951-464c-8070-28f0852c31af_del
Nov 06 13:52:40 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Deletion of /opt/stack/data/nova/instances/62a98765-8951-464c-8070-28f0852c31af_del complete
Nov 06 13:52:40 user nova-compute[74821]: INFO nova.compute.manager [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Took 1.42 seconds to destroy the instance on the hypervisor.
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: 62a98765-8951-464c-8070-28f0852c31af] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 62a98765-8951-464c-8070-28f0852c31af] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] No VIF found with MAC fa:16:3e:a2:37:ad, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-12cba192-9d84-4fb7-a0fd-23ed1342beec tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "d17ee78d-8824-4212-9322-cbbb6eed4825" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.005s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:52:40 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 62a98765-8951-464c-8070-28f0852c31af] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:52:40 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: 62a98765-8951-464c-8070-28f0852c31af] Took 0.41 seconds to deallocate network for instance.
Nov 06 13:52:41 user nova-compute[74821]: INFO nova.compute.manager [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 62a98765-8951-464c-8070-28f0852c31af] Took 0.92 seconds to detach 1 volumes for instance.
Nov 06 13:52:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:52:41 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:52:42 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:52:42 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:52:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.200s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:52:42 user nova-compute[74821]: DEBUG nova.compute.manager [req-9bba1058-df23-4e45-85ff-8081902a6849 req-453bc476-700b-496c-84a7-9a4ab482e46b service nova] [instance: 62a98765-8951-464c-8070-28f0852c31af] Received event network-vif-deleted-94fd8191-6c39-4785-a499-0897389bb521 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:52:42 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Deleted allocations for instance 62a98765-8951-464c-8070-28f0852c31af
Nov 06 13:52:42 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-2281384a-dd0e-49cc-9bb5-da1d1e98bfd6 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "62a98765-8951-464c-8070-28f0852c31af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.227s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:52:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:52:45 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:52:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "d17ee78d-8824-4212-9322-cbbb6eed4825" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:52:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "d17ee78d-8824-4212-9322-cbbb6eed4825" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:52:47 user nova-compute[74821]: DEBUG nova.objects.instance [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lazy-loading 'flavor' on Instance uuid d17ee78d-8824-4212-9322-cbbb6eed4825 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:52:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "d17ee78d-8824-4212-9322-cbbb6eed4825" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:52:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "d17ee78d-8824-4212-9322-cbbb6eed4825" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:52:47 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "d17ee78d-8824-4212-9322-cbbb6eed4825" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:52:47 user nova-compute[74821]: INFO nova.compute.manager [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Attaching volume f579ec4a-cdf7-49ac-a843-5a9b9a995676 to /dev/vdc
Nov 06 13:52:47 user nova-compute[74821]: DEBUG os_brick.utils [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:52:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:52:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:52:47 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63a875a-f543-4e90-9c9a-1cff84bfac57]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ca6c62faf8bd\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:52:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:52:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:52:47 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2af9f5-bf07-4476-9c80-f4e6b3e7d74b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:52:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:52:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:52:47 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b959d888-67be-48ed-8804-236528e021e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:52:47 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[933ad0aa-f81f-44ea-899f-b5b4ed87ec51]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:52:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Running cmd (subprocess): nvme version {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:52:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] 'nvme version' failed. Not Retrying. {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:52:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] nvme not present on system {{(pid=74821) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 06 13:52:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:52:47 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 06 13:52:47 user nova-compute[74821]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 06 13:52:47 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[427253a9-5676-4fa5-82c0-f72892ce5c14]: (4, '') {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:52:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74821) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 06 13:52:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 06 13:52:47 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.lightos [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] LIGHTOS: no hostnqn found. {{(pid=74821) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 06 13:52:47 user nova-compute[74821]: DEBUG os_brick.utils [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ca6c62faf8bd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:52:47 user nova-compute[74821]: DEBUG nova.virt.block_device [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Updating existing volume attachment record: af714fd4-0b33-4061-b546-3c5a12439031 {{(pid=74821) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 06 13:52:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:52:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:52:57 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:52:57 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:52:57 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Rebuilding the list of instances to heal {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 13:52:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "refresh_cache-9ad0a4b2-8071-48cb-8cca-bd05bf40c590" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:52:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquired lock "refresh_cache-9ad0a4b2-8071-48cb-8cca-bd05bf40c590" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:52:58 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Forcefully refreshing network info cache for instance {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 06 13:52:58 user nova-compute[74821]: DEBUG nova.objects.instance [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lazy-loading 'info_cache' on Instance uuid 9ad0a4b2-8071-48cb-8cca-bd05bf40c590 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:52:58 user nova-compute[74821]: DEBUG nova.network.neutron [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Updating instance_info_cache with network_info: [{"id": "5b1366a3-69e9-4118-8e38-026944e8d7a6", "address": "fa:16:3e:c1:bd:02", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1366a3-69", "ovs_interfaceid": "5b1366a3-69e9-4118-8e38-026944e8d7a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:52:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Releasing lock "refresh_cache-9ad0a4b2-8071-48cb-8cca-bd05bf40c590" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:52:58 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Updated the network info_cache for instance {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 06 13:52:59 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:52:59 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:52:59 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:52:59 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:52:59 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:53:00 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:53:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:53:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:53:00 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:53:00 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:53:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:53:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17ee78d-8824-4212-9322-cbbb6eed4825/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17ee78d-8824-4212-9322-cbbb6eed4825/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17ee78d-8824-4212-9322-cbbb6eed4825/disk --force-share --output=json {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:01 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d17ee78d-8824-4212-9322-cbbb6eed4825/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74821) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:01 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74821) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 06 13:53:01 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:53:01 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:53:01 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=8902MB free_disk=25.101913452148438GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:53:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:53:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:53:01 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance 9ad0a4b2-8071-48cb-8cca-bd05bf40c590 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:53:01 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Instance d17ee78d-8824-4212-9322-cbbb6eed4825 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74821) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 06 13:53:01 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:53:01 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:53:01 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Refreshing inventories for resource provider a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 06 13:53:02 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Updating ProviderTree inventory for provider a45ec519-15f5-48fe-877b-466db09f8afe from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 06 13:53:02 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Updating inventory in ProviderTree for provider a45ec519-15f5-48fe-877b-466db09f8afe with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 06 13:53:02 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Refreshing aggregate associations for resource provider a45ec519-15f5-48fe-877b-466db09f8afe, aggregates: None {{(pid=74821) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 06 13:53:02 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Refreshing trait associations for resource provider a45ec519-15f5-48fe-877b-466db09f8afe, traits: COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE42 {{(pid=74821) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 06 13:53:02 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:53:02 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:53:02 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:53:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.446s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:53:03 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:53:03 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:53:03 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:53:04 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Calling os-brick to attach iSCSI Volume {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjLdmzIK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:53:08 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:53:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:53:08 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:53:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:53:08 user nova-compute[74821]: INFO os_brick.initiator.connectors.iscsi [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 06 13:53:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676 -p 172.16.0.220:3260 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d30ecfe-6d43-4c20-816d-299cc5b41f41]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 06 13:53:08 user nova-compute[74821]:  {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676 -p 172.16.0.220:3260 --interface default --op new {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4777d1-5ee3-480e-bd0a-a190cf18d494]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676] added\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676] added
Nov 06 13:53:08 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ed6d88-de22-4539-9bc2-e23469b0f8f8]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda98fd1-1446-4d13-a6db-ea1774b434b5]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wjLdmzIK {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wjLdmzIK" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a608f6-c319-4230-80fa-c939265c18a1]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wjLdmzIK'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3258b996-e1e6-48ed-847e-b44ecb59cd82]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[599cff64-027c-41de-800e-dbccb7970b59]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 (non-flash)
Nov 06 13:53:08 user nova-compute[74821]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 (non-flash)
Nov 06 13:53:08 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 (non-flash)
Nov 06 13:53:08 user nova-compute[74821]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 (non-flash)
Nov 06 13:53:08 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676 -p 172.16.0.220:3260 --login {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d1ca71-8038-451d-af50-3b33d908e334]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676, portal: 172.16.0.220,3260]
Nov 06 13:53:08 user nova-compute[74821]: Login to [iface: default, target: iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676, portal: 172.16.0.220,3260] successful.
Nov 06 13:53:08 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7a46a2-ea9e-445a-8518-50278ca7f5c9]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfd4cb6-848e-44a7-87a9-fe01e27b8830]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 (non-flash)
Nov 06 13:53:08 user nova-compute[74821]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 (non-flash)
Nov 06 13:53:08 user nova-compute[74821]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676 (non-flash)
Nov 06 13:53:08 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 (non-flash)
Nov 06 13:53:08 user nova-compute[74821]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 (non-flash)
Nov 06 13:53:08 user nova-compute[74821]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676 (non-flash)
Nov 06 13:53:08 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Connected to 172.16.0.220:3260 {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=74821) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74821) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[d211e787-3d06-4899-83a6-9588dc0f5b77]: (4, ('- - 0', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:08 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: None {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:53:09 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74821) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 06 13:53:09 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjLdmzIK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74821) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 06 13:53:09 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:53:09 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26264323639623736', 'path': '/dev/sdc'} {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:53:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264323639623736', 'path': '/dev/sdc'} {{(pid=74821) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 06 13:53:09 user nova-compute[74821]: DEBUG nova.objects.instance [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lazy-loading 'flavor' on Instance uuid d17ee78d-8824-4212-9322-cbbb6eed4825 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:53:09 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] attach device xml: <disk type="block" device="disk">
Nov 06 13:53:09 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:53:09 user nova-compute[74821]:   <source dev="/dev/sdc"/>
Nov 06 13:53:09 user nova-compute[74821]:   <target dev="vdc" bus="virtio"/>
Nov 06 13:53:09 user nova-compute[74821]:   <serial>f579ec4a-cdf7-49ac-a843-5a9b9a995676</serial>
Nov 06 13:53:09 user nova-compute[74821]: </disk>
Nov 06 13:53:09 user nova-compute[74821]:  {{(pid=74821) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 06 13:53:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:53:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:53:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:53:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:53:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:53:09 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:53:10 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] No BDM found with device name vda, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:53:10 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:53:10 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74821) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 06 13:53:10 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] No VIF found with MAC fa:16:3e:a2:37:ad, not building metadata {{(pid=74821) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 06 13:53:10 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-c1ec0458-cb9a-4640-989f-72c27132518b tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "d17ee78d-8824-4212-9322-cbbb6eed4825" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.820s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:53:10 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:53:11 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "d17ee78d-8824-4212-9322-cbbb6eed4825" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:53:11 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "d17ee78d-8824-4212-9322-cbbb6eed4825" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:53:11 user nova-compute[74821]: INFO nova.compute.manager [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Detaching volume 6ca266c5-13b5-40f9-bec7-f048d159a333
Nov 06 13:53:11 user nova-compute[74821]: INFO nova.virt.block_device [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Attempting to driver detach volume 6ca266c5-13b5-40f9-bec7-f048d159a333 from mountpoint /dev/vdb
Nov 06 13:53:11 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Attempting to detach device vdb from instance d17ee78d-8824-4212-9322-cbbb6eed4825 from the persistent domain config. {{(pid=74821) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 13:53:11 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:53:11 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:53:11 user nova-compute[74821]:   <source dev="/dev/sdd"/>
Nov 06 13:53:11 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:53:11 user nova-compute[74821]:   <serial>6ca266c5-13b5-40f9-bec7-f048d159a333</serial>
Nov 06 13:53:11 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:53:11 user nova-compute[74821]: </disk>
Nov 06 13:53:11 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:53:11 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Successfully detached device vdb from instance d17ee78d-8824-4212-9322-cbbb6eed4825 from the persistent domain config.
Nov 06 13:53:11 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d17ee78d-8824-4212-9322-cbbb6eed4825 from the live domain config. {{(pid=74821) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 13:53:11 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:53:11 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:53:11 user nova-compute[74821]:   <source dev="/dev/sdd"/>
Nov 06 13:53:11 user nova-compute[74821]:   <target dev="vdb" bus="virtio"/>
Nov 06 13:53:11 user nova-compute[74821]:   <serial>6ca266c5-13b5-40f9-bec7-f048d159a333</serial>
Nov 06 13:53:11 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 06 13:53:11 user nova-compute[74821]: </disk>
Nov 06 13:53:11 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:53:11 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d17ee78d-8824-4212-9322-cbbb6eed4825 {{(pid=74821) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 13:53:14 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:53:15 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:53:18 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:53:19 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:53:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:53:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:53:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:53:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:53:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:53:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:53:29 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:53:31 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d17ee78d-8824-4212-9322-cbbb6eed4825 is timed out.
Nov 06 13:53:31 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Successfully detached device vdb from instance d17ee78d-8824-4212-9322-cbbb6eed4825 from the live domain config.
Nov 06 13:53:31 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:53:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PdIQUupT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:53:31 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:53:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:53:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:53:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf1e07f-1a22-4095-9a4c-c83a9fbb01b9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:53:31 user nova-compute[74821]: No targets found.
Nov 06 13:53:31 user nova-compute[74821]: iSNS:
Nov 06 13:53:31 user nova-compute[74821]: No targets found.
Nov 06 13:53:31 user nova-compute[74821]: STATIC:
Nov 06 13:53:31 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333
Nov 06 13:53:31 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:53:31 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:53:31 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8
Nov 06 13:53:31 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:53:31 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:53:31 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676
Nov 06 13:53:31 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:53:31 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:53:31 user nova-compute[74821]: FIRMWARE:
Nov 06 13:53:31 user nova-compute[74821]: No targets found.
Nov 06 13:53:31 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:53:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:53:31 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:53:31 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:53:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:53:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3c1df4-5a5b-4b7b-ad79-91c3e733e9cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[632bc75d-8726-4b63-a8ba-d5e8bf1f5ea5]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 (non-flash)
Nov 06 13:53:31 user nova-compute[74821]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 (non-flash)
Nov 06 13:53:31 user nova-compute[74821]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676 (non-flash)
Nov 06 13:53:31 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:53:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 (non-flash)
Nov 06 13:53:31 user nova-compute[74821]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 (non-flash)
Nov 06 13:53:31 user nova-compute[74821]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676 (non-flash)
Nov 06 13:53:31 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:53:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e500e2320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333'): ({'sdd'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:53:31 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Removing single pathed devices sdd {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:53:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[419f71db-d2a0-4ee0-976b-9b9b8b6caa0a]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd1f42d-d3e7-4a43-8127-995162fe2922]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:31 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Flushing IO for device /dev/sdd {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:53:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5d04f2-9758-4861-b082-f06850182714]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:31 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:53:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:31 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[e952896d-614a-40e7-8737-027dd6f16f04]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:31 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:53:31 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] SCSI volumes sdd have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:53:31 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:53:31 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:32 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b6d6fc-34e2-40af-892f-37b7c101d4f3]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:53:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:32 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[364d9443-aa91-445d-b951-3f455767b944]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333, portal: 172.16.0.220,3260]
Nov 06 13:53:32 user nova-compute[74821]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333, portal: 172.16.0.220,3260] successful.
Nov 06 13:53:32 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:53:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:32 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ca266c5-13b5-40f9-bec7-f048d159a333 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:32 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[84484bd5-75b2-41bf-8904-b87d9831ad81]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:53:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:53:32 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] <== disconnect_volume: return (311ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:53:32 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:53:32 user nova-compute[74821]: DEBUG nova.objects.instance [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lazy-loading 'flavor' on Instance uuid d17ee78d-8824-4212-9322-cbbb6eed4825 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:53:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-a361aecb-371b-4c14-8d20-7bd1ff3e326d tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "d17ee78d-8824-4212-9322-cbbb6eed4825" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.763s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:53:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "d17ee78d-8824-4212-9322-cbbb6eed4825" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:53:33 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "d17ee78d-8824-4212-9322-cbbb6eed4825" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:53:33 user nova-compute[74821]: INFO nova.compute.manager [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Detaching volume f579ec4a-cdf7-49ac-a843-5a9b9a995676
Nov 06 13:53:33 user nova-compute[74821]: INFO nova.virt.block_device [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Attempting to driver detach volume f579ec4a-cdf7-49ac-a843-5a9b9a995676 from mountpoint /dev/vdc
Nov 06 13:53:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Attempting to detach device vdc from instance d17ee78d-8824-4212-9322-cbbb6eed4825 from the persistent domain config. {{(pid=74821) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 06 13:53:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:53:34 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:53:34 user nova-compute[74821]:   <source dev="/dev/sdc"/>
Nov 06 13:53:34 user nova-compute[74821]:   <target dev="vdc" bus="virtio"/>
Nov 06 13:53:34 user nova-compute[74821]:   <serial>f579ec4a-cdf7-49ac-a843-5a9b9a995676</serial>
Nov 06 13:53:34 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 06 13:53:34 user nova-compute[74821]: </disk>
Nov 06 13:53:34 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:53:34 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Successfully detached device vdc from instance d17ee78d-8824-4212-9322-cbbb6eed4825 from the persistent domain config.
Nov 06 13:53:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance d17ee78d-8824-4212-9322-cbbb6eed4825 from the live domain config. {{(pid=74821) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 06 13:53:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.guest [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] detach device xml: <disk type="block" device="disk">
Nov 06 13:53:34 user nova-compute[74821]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 06 13:53:34 user nova-compute[74821]:   <source dev="/dev/sdc"/>
Nov 06 13:53:34 user nova-compute[74821]:   <target dev="vdc" bus="virtio"/>
Nov 06 13:53:34 user nova-compute[74821]:   <serial>f579ec4a-cdf7-49ac-a843-5a9b9a995676</serial>
Nov 06 13:53:34 user nova-compute[74821]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 06 13:53:34 user nova-compute[74821]: </disk>
Nov 06 13:53:34 user nova-compute[74821]:  {{(pid=74821) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 06 13:53:34 user nova-compute[74821]: DEBUG nova.virt.libvirt.driver [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance d17ee78d-8824-4212-9322-cbbb6eed4825 {{(pid=74821) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 06 13:53:34 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:53:39 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:53:44 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:53:49 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:53:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:53:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-751bc45e-b56e-45be-8b1f-e0feef3e9e62 req-7a35710c-f975-4e50-a135-075a6870fa49 service nova] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Received event network-changed-5b1366a3-69e9-4118-8e38-026944e8d7a6 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:53:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-751bc45e-b56e-45be-8b1f-e0feef3e9e62 req-7a35710c-f975-4e50-a135-075a6870fa49 service nova] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Refreshing instance network info cache due to event network-changed-5b1366a3-69e9-4118-8e38-026944e8d7a6. {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 06 13:53:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-751bc45e-b56e-45be-8b1f-e0feef3e9e62 req-7a35710c-f975-4e50-a135-075a6870fa49 service nova] Acquiring lock "refresh_cache-9ad0a4b2-8071-48cb-8cca-bd05bf40c590" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 06 13:53:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-751bc45e-b56e-45be-8b1f-e0feef3e9e62 req-7a35710c-f975-4e50-a135-075a6870fa49 service nova] Acquired lock "refresh_cache-9ad0a4b2-8071-48cb-8cca-bd05bf40c590" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 06 13:53:52 user nova-compute[74821]: DEBUG nova.network.neutron [req-751bc45e-b56e-45be-8b1f-e0feef3e9e62 req-7a35710c-f975-4e50-a135-075a6870fa49 service nova] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Refreshing network info cache for port 5b1366a3-69e9-4118-8e38-026944e8d7a6 {{(pid=74821) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 06 13:53:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "9ad0a4b2-8071-48cb-8cca-bd05bf40c590" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:53:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "9ad0a4b2-8071-48cb-8cca-bd05bf40c590" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:53:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "9ad0a4b2-8071-48cb-8cca-bd05bf40c590-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:53:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "9ad0a4b2-8071-48cb-8cca-bd05bf40c590-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:53:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "9ad0a4b2-8071-48cb-8cca-bd05bf40c590-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:53:52 user nova-compute[74821]: INFO nova.compute.manager [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Terminating instance
Nov 06 13:53:52 user nova-compute[74821]: DEBUG nova.compute.manager [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:53:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:53:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:53:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:53:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:53:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-adc9e1f3-5cbc-4d4a-88f7-291e96c9ed0e req-5f973879-be6f-4088-a759-14ff4dd16807 service nova] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Received event network-vif-unplugged-5b1366a3-69e9-4118-8e38-026944e8d7a6 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:53:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-adc9e1f3-5cbc-4d4a-88f7-291e96c9ed0e req-5f973879-be6f-4088-a759-14ff4dd16807 service nova] Acquiring lock "9ad0a4b2-8071-48cb-8cca-bd05bf40c590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:53:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-adc9e1f3-5cbc-4d4a-88f7-291e96c9ed0e req-5f973879-be6f-4088-a759-14ff4dd16807 service nova] Lock "9ad0a4b2-8071-48cb-8cca-bd05bf40c590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:53:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-adc9e1f3-5cbc-4d4a-88f7-291e96c9ed0e req-5f973879-be6f-4088-a759-14ff4dd16807 service nova] Lock "9ad0a4b2-8071-48cb-8cca-bd05bf40c590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:53:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-adc9e1f3-5cbc-4d4a-88f7-291e96c9ed0e req-5f973879-be6f-4088-a759-14ff4dd16807 service nova] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] No waiting events found dispatching network-vif-unplugged-5b1366a3-69e9-4118-8e38-026944e8d7a6 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:53:52 user nova-compute[74821]: DEBUG nova.compute.manager [req-adc9e1f3-5cbc-4d4a-88f7-291e96c9ed0e req-5f973879-be6f-4088-a759-14ff4dd16807 service nova] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Received event network-vif-unplugged-5b1366a3-69e9-4118-8e38-026944e8d7a6 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:53:52 user nova-compute[74821]: DEBUG nova.network.neutron [req-751bc45e-b56e-45be-8b1f-e0feef3e9e62 req-7a35710c-f975-4e50-a135-075a6870fa49 service nova] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Updated VIF entry in instance network info cache for port 5b1366a3-69e9-4118-8e38-026944e8d7a6. {{(pid=74821) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 06 13:53:52 user nova-compute[74821]: DEBUG nova.network.neutron [req-751bc45e-b56e-45be-8b1f-e0feef3e9e62 req-7a35710c-f975-4e50-a135-075a6870fa49 service nova] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Updating instance_info_cache with network_info: [{"id": "5b1366a3-69e9-4118-8e38-026944e8d7a6", "address": "fa:16:3e:c1:bd:02", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1366a3-69", "ovs_interfaceid": "5b1366a3-69e9-4118-8e38-026944e8d7a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:53:52 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-751bc45e-b56e-45be-8b1f-e0feef3e9e62 req-7a35710c-f975-4e50-a135-075a6870fa49 service nova] Releasing lock "refresh_cache-9ad0a4b2-8071-48cb-8cca-bd05bf40c590" {{(pid=74821) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 06 13:53:53 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Instance destroyed successfully.
Nov 06 13:53:53 user nova-compute[74821]: DEBUG nova.objects.instance [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lazy-loading 'resources' on Instance uuid 9ad0a4b2-8071-48cb-8cca-bd05bf40c590 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:48:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2118364660',display_name='tempest-TestVolumeBootPattern-server-2118364660',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2118364660',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfkJ+gcSdYeVBScTbHfbQppT+GyWkt0sgvXBBnJvMr4dzybcwiVijK0IZrgpO4n3M0oU/D2RJOqwTHI/tQmkgtCEBZc1yLKKsxKLmfpxs7+Nu7iryecTOj297JFUnXZvw==',key_name='tempest-TestVolumeBootPattern-11065527',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:48:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c8e811a3a30417a8dc6ccad03f2f8e0',ramdisk_id='',reservation_id='r-7w7vkics',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1930796442',owner_user_name='tempest-TestVolumeBootPattern-1930796442-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:48:55Z,user_data=None,user_id='3bb6a168d90a4795a72b8ac69eeadcc9',uuid=9ad0a4b2-8071-48cb-8cca-bd05bf40c590,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b1366a3-69e9-4118-8e38-026944e8d7a6", "address": "fa:16:3e:c1:bd:02", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1366a3-69", "ovs_interfaceid": "5b1366a3-69e9-4118-8e38-026944e8d7a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Converting VIF {"id": "5b1366a3-69e9-4118-8e38-026944e8d7a6", "address": "fa:16:3e:c1:bd:02", "network": {"id": "a5febdfb-6f24-4b85-9519-05f8e476fe61", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-386968612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8e811a3a30417a8dc6ccad03f2f8e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1366a3-69", "ovs_interfaceid": "5b1366a3-69e9-4118-8e38-026944e8d7a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:bd:02,bridge_name='br-int',has_traffic_filtering=True,id=5b1366a3-69e9-4118-8e38-026944e8d7a6,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b1366a3-69') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG os_vif [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:bd:02,bridge_name='br-int',has_traffic_filtering=True,id=5b1366a3-69e9-4118-8e38-026944e8d7a6,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b1366a3-69') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b1366a3-69, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed6fe8f3-fc09-4b92-a667-807b1403f1c4) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:53:53 user nova-compute[74821]: INFO os_vif [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:bd:02,bridge_name='br-int',has_traffic_filtering=True,id=5b1366a3-69e9-4118-8e38-026944e8d7a6,network=Network(a5febdfb-6f24-4b85-9519-05f8e476fe61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b1366a3-69')
Nov 06 13:53:53 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ytXCSQzf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:53:53 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:53:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[45927512-8fb5-4a4b-b0a3-267c426bbc8a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:53:53 user nova-compute[74821]: No targets found.
Nov 06 13:53:53 user nova-compute[74821]: iSNS:
Nov 06 13:53:53 user nova-compute[74821]: No targets found.
Nov 06 13:53:53 user nova-compute[74821]: STATIC:
Nov 06 13:53:53 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8
Nov 06 13:53:53 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:53:53 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:53:53 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676
Nov 06 13:53:53 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:53:53 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:53:53 user nova-compute[74821]: FIRMWARE:
Nov 06 13:53:53 user nova-compute[74821]: No targets found.
Nov 06 13:53:53 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:53:53 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:53:53 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[02419847-87dd-4f6e-b5c6-4d9271f6171e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[430ac9d7-bce0-4385-af04-1f227a13a0dd]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 (non-flash)
Nov 06 13:53:53 user nova-compute[74821]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676 (non-flash)
Nov 06 13:53:53 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 (non-flash)
Nov 06 13:53:53 user nova-compute[74821]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676 (non-flash)
Nov 06 13:53:53 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e40491630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8'): ({'sdb'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Removing single pathed devices sdb {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ba0805-2dd2-4420-9928-a24e11c8dd80]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbabc42-17ed-4761-8f3b-9b89534d4282]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Flushing IO for device /dev/sdb {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23c93ca-7857-4e66-8ac6-6f30fd2c5aad]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7e1bec-077f-4a78-811e-254c875e458d]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] SCSI volumes sdb have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_73f47e5e', '/dev/disk/by-id/scsi-26434646637643463', '/dev/disk/by-id/scsi-1SCST_BIO73f47e5e-d4df7d4c7ae8981c') {{(pid=85818) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[70441285-5d37-4c02-8aa1-186c36ef410a]: (4, None) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01db59a-5875-4dc3-9cc4-9eed876d8afb]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f32694-866b-4c06-a686-61ca00316cc5]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8, portal: 172.16.0.220,3260]
Nov 06 13:53:53 user nova-compute[74821]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8, portal: 172.16.0.220,3260] successful.
Nov 06 13:53:53 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9600620b-087a-4abc-bee1-b4e3c18b77e8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29230d9-0404-4bee-9858-d2902864f68f]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] <== disconnect_volume: return (306ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:53:53 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Deleting instance files /opt/stack/data/nova/instances/9ad0a4b2-8071-48cb-8cca-bd05bf40c590_del
Nov 06 13:53:53 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Deletion of /opt/stack/data/nova/instances/9ad0a4b2-8071-48cb-8cca-bd05bf40c590_del complete
Nov 06 13:53:53 user nova-compute[74821]: INFO nova.compute.manager [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 06 13:53:53 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:53:53 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:53:53 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Took 0.40 seconds to deallocate network for instance.
Nov 06 13:53:54 user nova-compute[74821]: DEBUG nova.compute.manager [req-59ca604e-2da6-41b5-ae70-7aa0f08d6b25 req-f09fed83-ef30-48af-9eaa-f618521b7dfa service nova] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Received event network-vif-deleted-5b1366a3-69e9-4118-8e38-026944e8d7a6 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:53:54 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance d17ee78d-8824-4212-9322-cbbb6eed4825 is timed out.
Nov 06 13:53:54 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Successfully detached device vdc from instance d17ee78d-8824-4212-9322-cbbb6eed4825 from the live domain config.
Nov 06 13:53:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] calling os-brick to detach iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7e503d48b0>, {'target_iqn': 'iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjLdmzIK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 06 13:53:54 user nova-compute[74821]: WARNING os_brick.initiator.connectors.base [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 06 13:53:54 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[533d5968-d850-4771-9045-5503252ae7ca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 06 13:53:54 user nova-compute[74821]: No targets found.
Nov 06 13:53:54 user nova-compute[74821]: iSNS:
Nov 06 13:53:54 user nova-compute[74821]: No targets found.
Nov 06 13:53:54 user nova-compute[74821]: STATIC:
Nov 06 13:53:54 user nova-compute[74821]: Target: iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676
Nov 06 13:53:54 user nova-compute[74821]:         Portal: 172.16.0.220:3260,-1
Nov 06 13:53:54 user nova-compute[74821]:                 Iface Name: default
Nov 06 13:53:54 user nova-compute[74821]: FIRMWARE:
Nov 06 13:53:54 user nova-compute[74821]: No targets found.
Nov 06 13:53:54 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 06 13:53:54 user nova-compute[74821]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 06 13:53:54 user nova-compute[74821]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74821) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676', 0)] {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebe0ae3-b60f-4f61-8ac9-446fba0461f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e18aa46-da5a-40b5-8fdd-5a968ed171c4]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676 (non-flash)\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676 (non-flash)
Nov 06 13:53:54 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676 (non-flash)
Nov 06 13:53:54 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7e40493ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676'): ({'sdc'}, set())}) {{(pid=74821) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Removing single pathed devices sdc {{(pid=74821) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4562b2be-7b03-4f7f-abd2-09334bf813e6]: (4, ('path checker states:\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38588cb-835c-4168-9f9e-a46058886a8d]: (4, ('ok\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Flushing IO for device /dev/sdc {{(pid=74821) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c79528f-de78-4601-863f-6be70581353b]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74821) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[4644a361-39f1-4b3a-a4b3-76937b0a3e73]: (4, ('1', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG os_brick.initiator.linuxscsi [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] SCSI volumes sdc have been removed. {{(pid=74821) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676')] {{(pid=74821) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[47760662-4b09-4086-89a7-b80eaef187cd]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676 -p 172.16.0.220:3260 --logout {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff89cb9-b048-480c-9ae9-ce154bfbe564]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676, portal: 172.16.0.220,3260]
Nov 06 13:53:54 user nova-compute[74821]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676, portal: 172.16.0.220,3260] successful.
Nov 06 13:53:54 user nova-compute[74821]:  stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676 -p 172.16.0.220:3260 --op delete {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f579ec4a-cdf7-49ac-a843-5a9b9a995676 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85818) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db527b0-18e3-4109-b497-2b0c130302c7]: (4, ('', '')) {{(pid=85818) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74821) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.base [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG os_brick.initiator.connectors.iscsi [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] <== disconnect_volume: return (306ms) None {{(pid=74821) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG nova.virt.libvirt.volume.iscsi [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Disconnected iSCSI Volume {{(pid=74821) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 06 13:53:54 user nova-compute[74821]: INFO nova.compute.manager [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Took 0.94 seconds to detach 1 volumes for instance.
Nov 06 13:53:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG nova.compute.manager [req-9a6641b0-3ee4-49cd-b1af-79d119d23e0a req-c8e5b71d-8aa5-4b3c-9bb3-f1f91d4d4b99 service nova] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Received event network-vif-plugged-5b1366a3-69e9-4118-8e38-026944e8d7a6 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-9a6641b0-3ee4-49cd-b1af-79d119d23e0a req-c8e5b71d-8aa5-4b3c-9bb3-f1f91d4d4b99 service nova] Acquiring lock "9ad0a4b2-8071-48cb-8cca-bd05bf40c590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-9a6641b0-3ee4-49cd-b1af-79d119d23e0a req-c8e5b71d-8aa5-4b3c-9bb3-f1f91d4d4b99 service nova] Lock "9ad0a4b2-8071-48cb-8cca-bd05bf40c590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-9a6641b0-3ee4-49cd-b1af-79d119d23e0a req-c8e5b71d-8aa5-4b3c-9bb3-f1f91d4d4b99 service nova] Lock "9ad0a4b2-8071-48cb-8cca-bd05bf40c590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:53:54 user nova-compute[74821]: DEBUG nova.compute.manager [req-9a6641b0-3ee4-49cd-b1af-79d119d23e0a req-c8e5b71d-8aa5-4b3c-9bb3-f1f91d4d4b99 service nova] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] No waiting events found dispatching network-vif-plugged-5b1366a3-69e9-4118-8e38-026944e8d7a6 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:53:54 user nova-compute[74821]: WARNING nova.compute.manager [req-9a6641b0-3ee4-49cd-b1af-79d119d23e0a req-c8e5b71d-8aa5-4b3c-9bb3-f1f91d4d4b99 service nova] [instance: 9ad0a4b2-8071-48cb-8cca-bd05bf40c590] Received unexpected event network-vif-plugged-5b1366a3-69e9-4118-8e38-026944e8d7a6 for instance with vm_state active and task_state deleting.
Nov 06 13:53:54 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:53:55 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:53:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.160s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:53:55 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Deleted allocations for instance 9ad0a4b2-8071-48cb-8cca-bd05bf40c590
Nov 06 13:53:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-6c3bebfc-2c46-4e43-b72b-1e4091f38db3 tempest-TestVolumeBootPattern-1930796442 tempest-TestVolumeBootPattern-1930796442-project-member] Lock "9ad0a4b2-8071-48cb-8cca-bd05bf40c590" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.883s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:53:55 user nova-compute[74821]: DEBUG nova.objects.instance [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lazy-loading 'flavor' on Instance uuid d17ee78d-8824-4212-9322-cbbb6eed4825 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:53:55 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-291d3241-b75e-40c8-b4c4-ee2e5ed56491 tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "d17ee78d-8824-4212-9322-cbbb6eed4825" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.823s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:53:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f086e5cf-96b9-4f02-a16c-a3513f41637e tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "d17ee78d-8824-4212-9322-cbbb6eed4825" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:53:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f086e5cf-96b9-4f02-a16c-a3513f41637e tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "d17ee78d-8824-4212-9322-cbbb6eed4825" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:53:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f086e5cf-96b9-4f02-a16c-a3513f41637e tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "d17ee78d-8824-4212-9322-cbbb6eed4825-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:53:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f086e5cf-96b9-4f02-a16c-a3513f41637e tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "d17ee78d-8824-4212-9322-cbbb6eed4825-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:53:56 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f086e5cf-96b9-4f02-a16c-a3513f41637e tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "d17ee78d-8824-4212-9322-cbbb6eed4825-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:53:56 user nova-compute[74821]: INFO nova.compute.manager [None req-f086e5cf-96b9-4f02-a16c-a3513f41637e tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Terminating instance
Nov 06 13:53:56 user nova-compute[74821]: DEBUG nova.compute.manager [None req-f086e5cf-96b9-4f02-a16c-a3513f41637e tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Start destroying the instance on the hypervisor. {{(pid=74821) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 06 13:53:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:53:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:53:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:53:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:53:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:53:57 user nova-compute[74821]: DEBUG nova.compute.manager [req-c1076d42-2e29-4335-8e4d-928dd8cdf60b req-292a68de-af18-4c74-8998-9f14cef111dd service nova] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Received event network-vif-unplugged-d24821b0-564a-4201-87d3-fee351a1f359 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:53:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c1076d42-2e29-4335-8e4d-928dd8cdf60b req-292a68de-af18-4c74-8998-9f14cef111dd service nova] Acquiring lock "d17ee78d-8824-4212-9322-cbbb6eed4825-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:53:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c1076d42-2e29-4335-8e4d-928dd8cdf60b req-292a68de-af18-4c74-8998-9f14cef111dd service nova] Lock "d17ee78d-8824-4212-9322-cbbb6eed4825-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:53:57 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-c1076d42-2e29-4335-8e4d-928dd8cdf60b req-292a68de-af18-4c74-8998-9f14cef111dd service nova] Lock "d17ee78d-8824-4212-9322-cbbb6eed4825-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:53:57 user nova-compute[74821]: DEBUG nova.compute.manager [req-c1076d42-2e29-4335-8e4d-928dd8cdf60b req-292a68de-af18-4c74-8998-9f14cef111dd service nova] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] No waiting events found dispatching network-vif-unplugged-d24821b0-564a-4201-87d3-fee351a1f359 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:53:57 user nova-compute[74821]: DEBUG nova.compute.manager [req-c1076d42-2e29-4335-8e4d-928dd8cdf60b req-292a68de-af18-4c74-8998-9f14cef111dd service nova] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Received event network-vif-unplugged-d24821b0-564a-4201-87d3-fee351a1f359 for instance with task_state deleting. {{(pid=74821) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 06 13:53:57 user nova-compute[74821]: INFO nova.virt.libvirt.driver [-] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Instance destroyed successfully.
Nov 06 13:53:57 user nova-compute[74821]: DEBUG nova.objects.instance [None req-f086e5cf-96b9-4f02-a16c-a3513f41637e tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lazy-loading 'resources' on Instance uuid d17ee78d-8824-4212-9322-cbbb6eed4825 {{(pid=74821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 06 13:53:57 user nova-compute[74821]: DEBUG nova.virt.libvirt.vif [None req-f086e5cf-96b9-4f02-a16c-a3513f41637e tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-06T13:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2055241102',display_name='tempest-AttachVolumeTestJSON-server-2055241102',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2055241102',id=51,image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlGyjYTEpDOjHV+PsBYEfZQaY41KhxLEdbxt/ZVNSujzI+qVDBOQK6X/7thRI2Q3mV4nN5yZZuaU7n9RPKLv6g3Hue5CPCmRL5rtz9AGGzALQY0s7fSY+6geloiW9Rrtg==',key_name='tempest-keypair-1319999646',keypairs=<?>,launch_index=0,launched_at=2023-11-06T13:50:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f3e02b312774fffa90b9aea7611b7d2',ramdisk_id='',reservation_id='r-y5npli50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bbed6343-3ff2-4f28-897a-55ddcbbc8268',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1920917363',owner_user_name='tempest-AttachVolumeTestJSON-1920917363-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-06T13:50:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88ff13567ecb4157898a278d3ae6e0d0',uuid=d17ee78d-8824-4212-9322-cbbb6eed4825,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d24821b0-564a-4201-87d3-fee351a1f359", "address": "fa:16:3e:a2:37:ad", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24821b0-56", "ovs_interfaceid": "d24821b0-564a-4201-87d3-fee351a1f359", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 06 13:53:57 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-f086e5cf-96b9-4f02-a16c-a3513f41637e tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Converting VIF {"id": "d24821b0-564a-4201-87d3-fee351a1f359", "address": "fa:16:3e:a2:37:ad", "network": {"id": "a2ec52e9-7476-4ced-9810-d58d3f9eec4d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1163687191-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f3e02b312774fffa90b9aea7611b7d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24821b0-56", "ovs_interfaceid": "d24821b0-564a-4201-87d3-fee351a1f359", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 06 13:53:57 user nova-compute[74821]: DEBUG nova.network.os_vif_util [None req-f086e5cf-96b9-4f02-a16c-a3513f41637e tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:37:ad,bridge_name='br-int',has_traffic_filtering=True,id=d24821b0-564a-4201-87d3-fee351a1f359,network=Network(a2ec52e9-7476-4ced-9810-d58d3f9eec4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24821b0-56') {{(pid=74821) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 06 13:53:57 user nova-compute[74821]: DEBUG os_vif [None req-f086e5cf-96b9-4f02-a16c-a3513f41637e tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:37:ad,bridge_name='br-int',has_traffic_filtering=True,id=d24821b0-564a-4201-87d3-fee351a1f359,network=Network(a2ec52e9-7476-4ced-9810-d58d3f9eec4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24821b0-56') {{(pid=74821) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 06 13:53:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:53:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd24821b0-56, bridge=br-int, if_exists=True) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:53:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:53:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:53:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:53:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6ec3a1db-aed1-4cda-be97-fd68d55793e9) {{(pid=74821) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 06 13:53:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:53:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:53:57 user nova-compute[74821]: INFO os_vif [None req-f086e5cf-96b9-4f02-a16c-a3513f41637e tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:37:ad,bridge_name='br-int',has_traffic_filtering=True,id=d24821b0-564a-4201-87d3-fee351a1f359,network=Network(a2ec52e9-7476-4ced-9810-d58d3f9eec4d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24821b0-56')
Nov 06 13:53:57 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-f086e5cf-96b9-4f02-a16c-a3513f41637e tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Deleting instance files /opt/stack/data/nova/instances/d17ee78d-8824-4212-9322-cbbb6eed4825_del
Nov 06 13:53:57 user nova-compute[74821]: INFO nova.virt.libvirt.driver [None req-f086e5cf-96b9-4f02-a16c-a3513f41637e tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Deletion of /opt/stack/data/nova/instances/d17ee78d-8824-4212-9322-cbbb6eed4825_del complete
Nov 06 13:53:57 user nova-compute[74821]: INFO nova.compute.manager [None req-f086e5cf-96b9-4f02-a16c-a3513f41637e tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 06 13:53:57 user nova-compute[74821]: DEBUG oslo.service.loopingcall [None req-f086e5cf-96b9-4f02-a16c-a3513f41637e tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74821) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 06 13:53:57 user nova-compute[74821]: DEBUG nova.compute.manager [-] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Deallocating network for instance {{(pid=74821) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 06 13:53:57 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] deallocate_for_instance() {{(pid=74821) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 06 13:53:58 user nova-compute[74821]: DEBUG nova.network.neutron [-] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Updating instance_info_cache with network_info: [] {{(pid=74821) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 06 13:53:58 user nova-compute[74821]: INFO nova.compute.manager [-] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Took 0.58 seconds to deallocate network for instance.
Nov 06 13:53:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f086e5cf-96b9-4f02-a16c-a3513f41637e tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:53:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f086e5cf-96b9-4f02-a16c-a3513f41637e tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:53:58 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-f086e5cf-96b9-4f02-a16c-a3513f41637e tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:53:58 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-f086e5cf-96b9-4f02-a16c-a3513f41637e tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:53:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f086e5cf-96b9-4f02-a16c-a3513f41637e tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.116s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:53:58 user nova-compute[74821]: INFO nova.scheduler.client.report [None req-f086e5cf-96b9-4f02-a16c-a3513f41637e tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Deleted allocations for instance d17ee78d-8824-4212-9322-cbbb6eed4825
Nov 06 13:53:58 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-f086e5cf-96b9-4f02-a16c-a3513f41637e tempest-AttachVolumeTestJSON-1920917363 tempest-AttachVolumeTestJSON-1920917363-project-member] Lock "d17ee78d-8824-4212-9322-cbbb6eed4825" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.756s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:53:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-95e17d38-8f17-4789-ac82-bed17860df90 req-8bc72bd3-23c7-4a9f-b934-57e95615bcbc service nova] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Received event network-vif-plugged-d24821b0-564a-4201-87d3-fee351a1f359 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:53:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-95e17d38-8f17-4789-ac82-bed17860df90 req-8bc72bd3-23c7-4a9f-b934-57e95615bcbc service nova] Acquiring lock "d17ee78d-8824-4212-9322-cbbb6eed4825-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:53:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-95e17d38-8f17-4789-ac82-bed17860df90 req-8bc72bd3-23c7-4a9f-b934-57e95615bcbc service nova] Lock "d17ee78d-8824-4212-9322-cbbb6eed4825-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:53:59 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [req-95e17d38-8f17-4789-ac82-bed17860df90 req-8bc72bd3-23c7-4a9f-b934-57e95615bcbc service nova] Lock "d17ee78d-8824-4212-9322-cbbb6eed4825-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:53:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-95e17d38-8f17-4789-ac82-bed17860df90 req-8bc72bd3-23c7-4a9f-b934-57e95615bcbc service nova] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] No waiting events found dispatching network-vif-plugged-d24821b0-564a-4201-87d3-fee351a1f359 {{(pid=74821) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 06 13:53:59 user nova-compute[74821]: WARNING nova.compute.manager [req-95e17d38-8f17-4789-ac82-bed17860df90 req-8bc72bd3-23c7-4a9f-b934-57e95615bcbc service nova] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Received unexpected event network-vif-plugged-d24821b0-564a-4201-87d3-fee351a1f359 for instance with vm_state deleted and task_state None.
Nov 06 13:53:59 user nova-compute[74821]: DEBUG nova.compute.manager [req-95e17d38-8f17-4789-ac82-bed17860df90 req-8bc72bd3-23c7-4a9f-b934-57e95615bcbc service nova] [instance: d17ee78d-8824-4212-9322-cbbb6eed4825] Received event network-vif-deleted-d24821b0-564a-4201-87d3-fee351a1f359 {{(pid=74821) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 06 13:53:59 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:53:59 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:53:59 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Didn't find any instances for network info cache update. {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 13:54:00 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:54:01 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:54:01 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:54:01 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:54:01 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:54:01 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:54:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:54:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:54:01 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:54:01 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:54:02 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:54:02 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:54:02 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=9110MB free_disk=25.120346069335938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:54:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:54:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:54:02 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:54:02 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:54:02 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:54:02 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:54:02 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:54:02 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:54:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:54:05 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:54:05 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:54:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:54:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:54:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:54:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:54:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:54:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:54:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:54:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:54:18 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:54:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:54:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:54:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:54:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:54:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:54:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:54:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:54:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:54:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:54:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:54:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:54:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:54:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:54:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:54:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:54:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:54:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:54:54 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:54:56 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:54:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:55:00 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:55:01 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:55:01 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:55:01 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Rebuilding the list of instances to heal {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 13:55:01 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Didn't find any instances for network info cache update. {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 13:55:01 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:55:01 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:55:01 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:55:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:55:02 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:55:02 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:55:03 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:55:03 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:55:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:55:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:55:04 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:55:04 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:55:04 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:55:04 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=9189MB free_disk=25.118629455566406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:55:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:55:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:55:04 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:55:04 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:55:04 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:55:04 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:55:04 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:55:04 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.115s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:55:07 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:55:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:55:07 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:55:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:55:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:55:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:55:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:55:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:55:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:55:14 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:55:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:55:18 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:55:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:55:24 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:55:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:55:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:55:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:55:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:55:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:55:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:55:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:55:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:55:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:55:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:55:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:55:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:55:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:55:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:55:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:55:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:55:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:56:01 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:56:01 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:56:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:56:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:56:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:56:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:56:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:56:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:56:03 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:56:03 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:56:03 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:56:03 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:56:03 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:56:03 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Rebuilding the list of instances to heal {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 13:56:03 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Didn't find any instances for network info cache update. {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 13:56:05 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:56:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:56:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:56:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:56:05 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:56:06 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:56:06 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:56:06 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=9212MB free_disk=25.116851806640625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:56:06 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:56:06 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:56:06 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:56:06 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:56:06 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:56:06 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:56:06 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:56:06 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.111s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:56:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:56:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:56:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74821) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 06 13:56:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:56:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74821) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 06 13:56:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:56:08 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:56:08 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:56:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:56:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:56:20 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:56:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:56:27 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:56:32 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:56:35 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:56:37 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:56:42 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:56:47 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:56:52 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:56:57 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:57:02 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:57:03 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:57:03 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:57:03 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74821) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 06 13:57:04 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:57:04 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Starting heal instance info cache {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 06 13:57:04 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Rebuilding the list of instances to heal {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 06 13:57:04 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Didn't find any instances for network info cache update. {{(pid=74821) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 06 13:57:04 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:57:05 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:57:05 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager.update_available_resource {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:57:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:57:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:57:05 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:57:05 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Auditing locally available compute resources for user (node: user) {{(pid=74821) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 06 13:57:06 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:57:06 user nova-compute[74821]: WARNING nova.virt.libvirt.driver [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 06 13:57:06 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Hypervisor/Node resource view: name=user free_ram=9229MB free_disk=25.114349365234375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74821) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 06 13:57:06 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 06 13:57:06 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 06 13:57:06 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 06 13:57:06 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74821) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 06 13:57:06 user nova-compute[74821]: DEBUG nova.compute.provider_tree [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed in ProviderTree for provider: a45ec519-15f5-48fe-877b-466db09f8afe {{(pid=74821) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 06 13:57:06 user nova-compute[74821]: DEBUG nova.scheduler.client.report [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Inventory has not changed for provider a45ec519-15f5-48fe-877b-466db09f8afe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74821) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 06 13:57:06 user nova-compute[74821]: DEBUG nova.compute.resource_tracker [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Compute_service record updated for user:user {{(pid=74821) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 06 13:57:06 user nova-compute[74821]: DEBUG oslo_concurrency.lockutils [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=74821) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 06 13:57:07 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 06 13:57:09 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:57:09 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:57:09 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:57:09 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Cleaning up deleted instances {{(pid=74821) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 06 13:57:09 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] There are 0 instances to clean {{(pid=74821) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 06 13:57:12 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:57:15 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:57:15 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:57:15 user nova-compute[74821]: DEBUG nova.compute.manager [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Cleaning up deleted instances with incomplete migration  {{(pid=74821) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 06 13:57:17 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 06 13:57:21 user nova-compute[74821]: DEBUG oslo_service.periodic_task [None req-5e55a0c7-f0fe-4325-b82e-5191d984f6cc None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74821) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 06 13:57:22 user nova-compute[74821]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74821) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}